In modern industrial and organizational psychology, evaluating human workplace behavior with objectivity, validity, and fairness represents an enduring scientific pursuit. Behaviorally Anchored Rating Scales (BARS) emerged as a groundbreaking psychometric instrument designed to reduce human rater subjectivity by anchoring performance rating scale points to concrete, observable behavioral statements rather than vague numerical labels or ambiguous adjectives. By establishing explicit standards of exemplary, competent, and unacceptable workplace conduct, BARS transforms routine appraisal from speculative impressionism into systematic behavioral measurement.
Behaviorally Anchored Rating Scales (BARS)
1. Concise Definition
Behaviorally Anchored Rating Scales (BARS) are qualitative-quantitative appraisal tools used in organizational psychology and performance management to measure employee performance against specific, observable behavioral exemplars established across designated scale points. Rather than relying on abstract descriptors such as "poor," "average," or "outstanding," a BARS instrument calibrates each graduation of an interval scale with precise narrative descriptions of actual job behaviors.
Conceptually, BARS bridges the gap between traditional numerical rating formats and descriptive qualitative observations. Developed through collaborative, multi-step job analysis methodologies involving subject matter experts, BARS provides raters with standardized behavioral anchors derived from real workplace critical incidents. This operational framing assists evaluators in categorizing observed actions accurately, thereby significantly reducing common psychometric errors such as halo effects, central tendency bias, and leniency skew.
2. Etymology and Linguistic Origin
The acronym BARS stands for "Behaviorally Anchored Rating Scales." The term reflects the confluence of mid-twentieth-century American behavioral psychology and psychometric measurement theory. The adverbial modifier "behaviorally" derives via Middle English from the Old English root behabban, meaning "to hold, contain, or restrain," which evolved into the psychological designation of observable human actions and functioning. The verb "anchor" stems from the Latin ancora and Greek ankyra (signifying a curved hook or stabilizing weight), metaphorically imported into psychophysics and psychometrics to denote a fixed, stable reference point against which variable stimuli or perceptions are compared.
The concept entered academic literature through the seminal work of industrial psychologists Patricia Cain Smith and L. M. Kendall in their landmark 1963 article, "Retranslation of Expectations: An Approach to the Construction of Ambiguous Anchors for Rating Scales," published in the Journal of Applied Psychology. Although initially designated under the methodological umbrella of "behavioral expectation scales" (BES), the nomenclature evolved rapidly in organizational research during the early 1970s into the definitive phrasing "Behaviorally Anchored Rating Scales," formalizing its identity as an objective measurement framework.
3. Pronunciation and Grammatical Form
Pronunciation: /bɑːrz/ (rhyming with "bars") or articulated initialistically as B-A-R-S (/biː eɪ ɑːr ɛs/).
Grammatically, BARS functions primarily as an acronymic noun phrase, used either as a plural count noun (e.g., "The researchers designed multiple BARS for the executive team") or as a singular collective conceptual noun (e.g., "BARS provides greater construct validity than standard graphic scales"). It frequently serves as an attributive noun adjunct modifying appraisal concepts, as observed in expressions like "BARS methodology," "BARS development protocol," and "BARS-based evaluations."
4. Detailed Conceptual Explanation
Behaviorally Anchored Rating Scales operate on the premise that human performance cannot be fairly, reliably, or validly assessed without establishing explicit behavioral referents. In conventional performance appraisal instruments—such as traditional Graphic Rating Scales (GRS)—evaluators are confronted with broad evaluative traits (e.g., "dependability," "initiative," "professionalism") accompanied by generic scalar labels (e.g., 1 = Unsatisfactory, 3 = Average, 5 = Excellent). Such subjective formats force raters to impose their idiosyncratic cognitive frameworks onto the rating continuum, producing pronounced inter-rater variance, severe perceptual distortions, and defensive employee reactions during appraisal feedback.
In contrast, BARS grounds every scale division in descriptive, real-world behavioral realities. The scale design process begins by parsing complex job roles into critical performance dimensions (e.g., "Crisis Management," "Interpersonal Communication," or "Technical Problem Solving"). For each identified dimension, a vertical continuum—frequently spanning 5, 7, or 9 points—is populated with standardized behavioral anchors. These anchors do not describe hypothetical or idealized characteristics; instead, they delineate discrete, recognizable actions that an employee at that specific performance tier would predictably exhibit.
The theoretical scope of BARS encompasses both observed behavior and anticipated behavioral capacity. In original formulations, anchors were frequently phrased in conditional, prospective language known as Behavioral Expectation Scales (BES), using statements such as "Could be expected to remain calm and systematically delegate tasks when an emergency occurs." Subsequent adaptations introduced Behavioral Observation Scales (BOS), which assess the observed frequency of specific behaviors, and Behavioral Summary Scales (BSS), which summarize typical observed actions. Regardless of minor taxonomic variants, the conceptual boundaries of BARS remain firmly tethered to observable, verifiable operational behaviors rather than inferred personality traits, motives, or emotional dispositions.
By anchoring evaluations to distinct behavioral illustrations, BARS establishes a shared perceptual frame of reference between managers and subordinates. Supervisors function less as subjective arbiters and more as calibrated observers. Consequently, performance reviews transition from evaluative debates about an individual’s intrinsic worth into constructive dialogues regarding observable work behaviors, skill acquisition, and targeted developmental goals.
5. Historical Development
The genesis of BARS is inextricably linked to the mid-century evolution of industrial psychology, particularly the search for psychometrically rigorous methods to evaluate occupational proficiency. During World War II, John C. Flanagan formulated the Critical Incident Technique (CIT) as an empirical protocol to identify the human performance variables responsible for mission success or failure among military aviators. Flanagan's method provided an objective framework for gathering firsthand descriptive accounts of exceptionally effective and ineffective behaviors.
A decade later, Patricia Cain Smith and L. M. Kendall recognized that while Flanagan's critical incidents provided an invaluable repository of qualitative job data, organizations lacked an empirical method to systematically scale these behaviors into quantitative appraisal instruments. In their classic 1963 study focusing on the evaluation of registered nurses, Smith and Kendall pioneered the "retranslation" methodology. This innovation required independent groups of job incumbents and supervisors to iteratively sort, assign, and scale critical incidents across predefined performance dimensions, ensuring that only items achieving rigorous statistical consensus were retained as permanent scale anchors.
Throughout the 1970s and 1980s, organizational researchers such as Donald P. Schwab, Herbert G. Heneman III, Richard R. Reilly, and Frank J. Landy extensively investigated the comparative psychometric properties of BARS. While early theoretical claims suggested BARS would completely eliminate rater errors, subsequent empirical research documented that while it moderately improved discriminant validity and rater agreement, its greatest utility resided in administrative defensibility, content validity, and performance feedback efficacy. Today, BARS remains a foundational methodology in performance appraisal, high-stakes recruitment assessments, clinical competencies, and structured behavioral interviewing.
6. Theoretical Foundations
The architectural logic of BARS rests at the intersection of several prominent theoretical paradigms in psychometrics, cognitive psychology, and behavioral science:
Psychophysical Scaling and Thurstone’s Law of Comparative Judgment: BARS methodology directly incorporates L. L. Thurstone's psychophysical scaling principles, treating complex human performance dimensions as psychological continua along which behavioral stimuli can be reliably positioned. Through repeated iterative retranslation, BARS establishes equal-appearing intervals, stabilizing scale properties through empirical consensus rather than arbitrary managerial discretion.
Cognitive Information Processing Theory: Cognitive models of performance appraisal emphasize that evaluators must encode, store, retrieve, and integrate behavioral information regarding ratees. Traditional scales place substantial cognitive load on working memory, prompting raters to rely on cognitive heuristics and stereotyping. BARS acts as an external cognitive scaffolding mechanism; by providing vivid behavioral retrieval cues, it simplifies cognitive search processes, minimizes schema-driven distortions, and standardizes categorization thresholds across disparate raters.
Behaviorism and Functional Behavioral Analysis: Derived from B. F. Skinner's radical behaviorism, BARS rejects the measurement of unobservable mentalistic constructs (e.g., "motivation," "integrity," "loyalty") in favor of overt, measurable behavioral demonstrations. By evaluating individuals solely on demonstrable competencies and operational behaviors, BARS minimizes subjective inferential leaps and aligns appraisal directly with operational job requirements.
7. Key Components, Types, and Dimensions
Developing and implementing a rigorous BARS requires several structural components and operational taxonomies:
- Performance Dimensions: Distinct, independent job categories (e.g., Technical Proficiency, Customer Relationship Management, Safety Compliance) derived through formal job analysis that encompass the core responsibilities of the role.
- Numerical Continuum: A standardized rating scale, typically ranging from 5 to 9 points, representing a spectrum from extreme ineffectiveness to exceptional competence.
- Behavioral Anchors: Carefully edited, illustrative narrative statements positioned alongside specific scale points that exemplify the level of performance required to earn that score.
- Behavioral Expectation Scales (BES): The classical variation of BARS wherein anchors describe expected or hypothetical future behaviors using conditional grammar ("Can be expected to…").
- Behavioral Observation Scales (BOS): A related variant developed by Latham and Wexley that uses Likert-type frequency scales (e.g., 1 = Almost Never to 5 = Almost Always) to assess how often a worker exhibits specific critical behaviors.
- Behavioral Summary Scales (BSS): An operational simplification where anchors represent summarized clusters of typical behaviors observed over an extended appraisal cycle.
8. Examples and Illustrative Cases
To demonstrate the architectural construction of BARS, consider an illustrative 7-point scale developed for an emergency department triage nurse under the performance dimension "Patient Communication under Acute Pressure":
- Point 7 (Superior Performance): Actively calms highly distressed patients and family members using empathetic, de-escalating verbal techniques while simultaneously gathering exhaustive medical histories and coordinating immediate clinical triage without hesitation.
- Point 6 (Very Good Performance): Clearly and calmly articulates triage procedures and anticipated wait times to anxious patients, anticipating unvoiced patient concerns and maintaining professional composure during peak operational volumes.
- Point 5 (Good / Competent Performance): Consistently informs patients of standard intake protocols in a polite, professional manner; answers direct inquiries accurately without showing visible irritation.
- Point 4 (Adequate / Moderate Performance): Communicates clinical instructions effectively but relies strictly on routine scripts; occasionally appears rushed or emotionally detached when ward occupancy reaches maximum capacity.
- Point 3 (Marginal Performance): Frequently uses overly technical medical jargon that confuses patients; occasionally speaks abruptly when interrupted by concerned family members during busy shifts.
- Point 2 (Poor Performance): Openly expresses frustration in front of waiting patients; fails to provide updates regarding severe treatment delays, escalating family anxiety.
- Point 1 (Extremely Ineffective Performance): Verbally confronts or berates distraught patients or relatives; displays overt hostility, completely neglecting standard communication and intake protocols.
In practice, a supervising physician or nurse manager assesses an employee's performance over the preceding review period by determining which behavioral anchor most accurately characterizes their typical clinical conduct, providing an objective, documented rationale for the numerical score assigned.
9. Measurement and Assessment
The construction of a psychometrically sound BARS involves a meticulous, five-stage retranslation methodology designed to ensure superior content validity and reliability:
Step 1: Critical Incident Collection: A panel of Subject Matter Experts (SMEs)—comprising top-performing incumbents and experienced supervisors—generates hundreds of concrete critical incidents depicting exceptionally effective, average, and ineffective workplace performances via the job analysis protocol.
Step 2: Dimension Identification: The research team or organizational psychologists cluster these collected narrative incidents into 5 to 10 comprehensive, mutually exclusive performance dimensions.
Step 3: Retranslation (Sorting Process): A secondary, independent panel of SMEs receives the randomized list of critical incidents and the dimension definitions. These experts independently sort each incident back into the dimension they believe it represents. Any critical incident that fails to achieve a predefined agreement threshold (commonly 60% to 75% unanimous placement) is permanently discarded for lack of categorical clarity.
Step 4: Scale Value Assignment: The retained incidents are evaluated by a third group of SMEs who rate each behavior along an interval continuum (e.g., 1 through 7) according to its level of effectiveness. The mean (or median) score determines its scalar anchor position, while the standard deviation reflects inter-rater ambiguity. Items exhibiting substantial standard deviations (typically SD > 1.5) are eliminated due to lack of consensus regarding their evaluative value.
Step 5: Instrument Finalization: The final instrument is populated by selecting anchors that possess low standard deviations and whose mean values align closely with each scale point along the continuum, ensuring equidistant and unambiguous behavioral benchmarks across all dimensions.
10. Applications and Practical Significance
Behaviorally Anchored Rating Scales play a critical role across diverse human resource management and organizational development settings:
Legally Defensible Performance Appraisals: In high-stakes employment contexts involving promotions, compensation, or termination, standard evaluation systems often struggle under judicial scrutiny. In employment discrimination litigation, courts favor BARS due to its direct derivation from systematic job analyses, explicit behavioral criteria, and reduced vulnerability to personal bias.
Structured Behavioral Interviewing: The architectural framework of BARS provides the evaluative scoring benchmarks for behavioral interviewing techniques such as the Situation, Task, Action, Result (STAR) model. Interviewers evaluate applicant responses by comparing their self-reported past conduct directly against scaled behavioral rubrics.
High-Stakes Technical Training and Simulation: High-reliability organizations—including commercial aviation, military operations, emergency medicine, and nuclear power generation—regularly employ BARS in flight simulators and clinical simulations. Evaluators assess pilots and clinicians using granular behavioral indicators, ensuring uncompromising adherence to safety and operational standards.
Actionable Developmental Feedback: Unlike traditional numerical scores that leave employees confused regarding paths to improvement, BARS offers unambiguous roadmaps. An employee scoring at a Level 3 can inspect the Level 5 anchor to see precisely which behaviors are required to achieve organizational advancement.
11. Research and Empirical Evidence
Decades of psychometric research have scrutinized the empirical merits of Behaviorally Anchored Rating Scales relative to alternate appraisal formats:
Early theoretical assumptions posited that BARS would virtually eradicate classical rating errors such as leniency, halo effect, and central tendency bias. In an influential meta-analytic review, Schwab, Heneman, and DeCotiis (1975) concluded that while BARS did not consistently eliminate all psychometric errors to the extent originally hypothesized, it produced superior convergence across raters when combined with rater training programs.
Subsequent psychometric investigations by Frank Landy and colleagues documented that the primary empirical strength of BARS resides in its exceptional content validity, face validity, and construct clarity. When evaluators undergo frame-of-reference training (FORT) alongside BARS implementation, inter-rater reliability coefficients regularly surpass those of unanchored Likert scales. Modern research continues to demonstrate that employees perceive BARS-driven appraisal systems as significantly fairer, more procedurally transparent, and less discriminatory than traditional trait-based reviews.
12. Cultural and Cross-Cultural Considerations
Applying BARS across multinational and multicultural environments introduces complex psychometric and social dynamics:
Power Distance and Hierarchical Expectations: In cultures characterized by high power distance (e.g., parts of East Asia, Latin America, and the Middle East), subordinates may hesitate to endorse or engage in behavioral anchors that demand egalitarian questioning of authority. Conversely, organizations operating in low power distance environments (e.g., Scandinavia, Anglo nations) routinely anchor superior performance to proactive initiative, flat communication, and constructive dissent.
Individualism versus Collectivism: Behavioral anchors constructed in Western, individualistic settings typically emphasize solo problem-solving, autonomy, and individual achievement. When imported into collectivist cultures, these identical anchors can produce evaluation friction, as optimal workplace functioning in such contexts is often characterized by consensus building, relational harmony, and collaborative teamwork.
Linguistic Nuance in Behavioral Translation: Translating BARS instruments into other languages is fraught with semantic risk. Subtleties in tone, modality, and verb aspect can dramatically shift the perceived severity or competence described in a behavioral anchor. Consequently, cross-cultural deployment requires rigorous cross-cultural adaptation, including double back-translation and local expert retranslation panels.
13. Criticisms, Debates, and Limitations
Despite its conceptual elegance and psychometric benefits, BARS is subject to several well-documented operational limitations and scholarly debates:
Resource-Intensive Construction: The foremost practical barrier to BARS is the extensive labor, time, and financial cost required for development. Conducting rigorous job analyses, gathering hundreds of critical incidents, and convening multiple expert panels across dozens of organizational roles can cost hundreds of thousands of dollars and take months to complete, rendering it impractical for rapidly evolving positions or small enterprises.
The "Behavioral Mismatch" Dilemma: In complex, dynamic modern roles, evaluators frequently observe employee behaviors that do not neatly match any of the designated anchors. A manager may observe a worker who exhibits Level 7 behaviors in one aspect of a dimension but Level 3 behaviors in another, leading to evaluator confusion and arbitrary score averaging.
Activity versus Outcome Confusion: Critics argue that BARS focuses disproportionately on behavioral means rather than substantive outcomes. An employee may adhere scrupulously to every prescribed behavioral anchor yet fail to achieve overarching strategic goals due to market volatility or exogenous systemic constraints.
14. Related Terms and Distinctions
Understanding BARS requires delineating its boundaries relative to neighboring performance management and psychometric instruments:
- Graphic Rating Scale (GRS): A traditional appraisal tool assessing abstract employee traits (e.g., "initiative") using generic numerical or adjective-labeled scales. Unlike BARS, GRS provides no specific behavioral descriptions along its continuum.
- Behavioral Observation Scale (BOS): A related behavioral scale developed by Latham and Wexley where raters evaluate the explicit frequency (e.g., from "Almost Never" to "Almost Always") with which an employee exhibits specific critical behaviors, rather than picking a single anchor along a continuum.
- Behavioral Expectation Scale (BES): The original conceptual variant of BARS pioneered by Smith and Kendall that frames behavioral anchors in terms of predicted or expected future conduct rather than observed historical conduct.
- Management by Objectives (MBO): An outcome-oriented performance management framework establishing quantifiable goals (e.g., sales targets, revenue growth). In contrast to BARS, MBO measures outputs rather than the behavioral processes utilized to achieve them.
- Checklist Method: A basic measurement format where raters indicate whether specific statements apply to an employee, lacking the continuous psychometric scaling and dimensional calibration inherent to BARS.
15. Summary and Key Takeaways
Behaviorally Anchored Rating Scales represent a gold standard for objective behavioral evaluation in modern organizations. By systematically replacing vague descriptive labels with concrete, empirically calibrated accounts of workplace performance, BARS enhances evaluation reliability, safeguards administrative defensibility, and fosters transparent, actionable feedback dialogues. Although developing BARS demands substantial organizational resources and expert curation, its capacity to clarify performance expectations and mitigate cognitive evaluation biases makes it an indispensable tool for rigorous human resource management, high-risk operational environments, and applied organizational research.
References
- Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 51(4), 327–358. https://doi.org/10.1037/h0061470
- Landy, F. J., & Farr, J. L. (1980). Performance rating. Psychological Bulletin, 87(1), 72–107. https://doi.org/10.1037/0033-2909.87.1.72
- Latham, G. P., & Wexley, K. N. (1977). Behavioral observation scales for performance appraisal purposes. Personnel Psychology, 30(2), 255–268. https://doi.org/10.1111/j.1744-6570.1977.tb02092.x
- Schwab, D. P., Heneman, H. G., & DeCotiis, T. A. (1975). Behaviorally anchored rating scales: Review of the state of the art. Personnel Psychology, 28(4), 549–562. https://doi.org/10.1111/j.1744-6570.1975.tb01398.x
- Smith, P. C., & Kendall, L. M. (1963). Retranslation of expectations: An approach to the construction of ambiguous anchors for rating scales. Journal of Applied Psychology, 47(2), 149–155. https://doi.org/10.1037/h0047031