Affective Learning and Teacher Evaluation measures

Abstract

The Affective Learning and Teacher Evaluation measures, formally designated in instructional communication literature as the Affective Learning and Instructor Evaluation Scales (ALIES), represent a seminal psychometric instrument developed by James C. McCroskey (1994). Grounded in Bloom’s taxonomy of educational objectives—specifically the affective domain formalized by Krathwohl, Bloom, and Masia (1964)—the instrument was engineered to rectify widespread methodological and conceptual confounds in educational assessment. Historically, instructional researchers conflated students’ emotional disposition toward academic subject matter with their interpersonal appraisals of the instructor. The ALIES addresses this psychometric challenge by dividing 16 bipolar semantic differential items across four distinct 4-item subscales: (1) Affect Toward Course Content, (2) Affect Toward Taking Future Courses in Content Area, (3) Affect Toward Instructor, and (4) Affect Toward Taking Future Courses with Instructor.

Methodologically, the instrument organizes these four subscales into two higher-order, orthogonal or semi-independent constructs: Affective Learning (subscales 1 and 2, comprising items 1–8) and Instructor Evaluation (subscales 3 and 4, comprising items 9–16). Responses are gathered across a 7-point bipolar semantic continuum anchored by opposing evaluative and behavioral-intent adjectives (e.g., Good–Bad, Valuable–Worthless, Likely–Unlikely). Extensive psychometric validation across collegiate and secondary educational cohorts demonstrates remarkable internal consistency, with Cronbach’s alpha coefficients regularly exceeding .90 for each subscale and reaching .92 to .96 for the composite dimensions. Confirmatory factor analyses validate the dual-construct, four-factor latent structure, establishing robust discriminant validity between teacher evaluation and genuine student affective learning. The ALIES remains one of the most widely deployed assessment tools in instructional communication, organizational training, and pedagogical research.

Keywords

Affective Learning, Instructor Evaluation, Teacher Evaluation, Instructional Communication, James C. McCroskey, Semantic Differential Scale, Krathwohl Taxonomy, Teacher Immediacy, Student Engagement, Psychometrics

Authors

The scale was developed and standardized by James C. McCroskey, Ed.D. (1934–2012), one of the most prolific scholars in the discipline of communication studies. McCroskey served for decades as Professor and Chair of the Department of Communication Studies at West Virginia University (WVU) and later held appointments at the University of Alabama at Birmingham. Recognized internationally for his pioneering work on communication apprehension, nonverbal immediacy, and instructional communication dynamics, McCroskey authored or co-authored over 200 journal articles, books, and standardized measurement tools.

The scale’s evolution traces back to collaborative research conducted in the late 1970s and 1980s alongside prominent instructional communication scholars, including Janis F. Andersen (San Diego State University), Virginia P. Richmond (West Virginia University), and Joan S. Gorham (West Virginia University). McCroskey refined and codified the dual-construct assessment battery in 1994 to provide a reliable, standardized metric that isolated student learning outcomes from instructor popularity ratings.

Purpose

The overarching purpose of the Affective Learning and Teacher Evaluation measures is to provide educational researchers, academic administrators, and faculty developers with an analytically rigorous diagnostic instrument capable of assessing student affective outcomes without confounding them with teacher evaluation ratings. In higher education and instructional environments, researchers examine three primary domains of learning: cognitive (knowledge acquisition, recall, synthesis, and critical thinking), affective (attitudes, values, emotional resonance, and intrinsic motivation toward the subject matter), and psychomotor (development of neuromuscular or behavioral proficiencies).

Extensive empirical literature in instructional communication demonstrates that instructor communication behaviors—such as nonverbal immediacy (e.g., eye contact, smiling, open posture), verbal immediacy (e.g., inclusive pronouns, personal humor, soliciting student feedback), clarity, and socio-communicative style—exert their most direct and profound influence on the affective domain. Students who cultivate positive affect toward an academic discipline demonstrate elevated self-directed study, higher rates of persistence, lower drop-out rates, and greater likelihood of pursuing subsequent coursework or career pathways tied to that discipline. Consequently, accurately measuring affective learning is essential to understanding the efficacy of classroom pedagogy.

However, early empirical research in the 1970s and 1980s fell prey to severe methodological limitations. First, historical scales incorporated measures asking students whether they intended to implement the specific behaviors recommended in the course throughout their future lives. While pertinent for applied or professional courses (e.g., public speaking, clinical nursing), this metric was ecologically invalid when applied to purely theoretical or general education classes (e.g., historical linguistics, abstract algebra), creating unfair comparative disparities. Second, researchers committed an analytic error by subjecting all survey items across content, instructor, and behavioral intention to a single exploratory factor analysis, subsequently aggregating them into a single omnibus composite score labeled “Affective Learning.”

McCroskey (1994) critiqued this practice as the quintessential statistical aggregation of “apples and oranges.” An enthusiastic admiration or fondness for a teacher’s charismatic personality (Instructor Evaluation) does not equate to genuine cognitive-affective internalizations of academic subject matter (Affective Learning). A student may find an instructor charming and engaging while simultaneously concluding that the academic subject itself is dull, useless, and irrelevant. Conversely, a student may find the pedagogical style of a professor uninspiring yet develop an enduring passion for organic chemistry. The ALIES was deliberately created to disentangle these constructs, establishing two distinct operational profiles that enable researchers to identify whether an educational intervention impacts true disciplinary learning, teacher rapport, or both.

Psychological Construct

The psychological architecture of the ALIES operationalizes two primary latent constructs, each composed of an attitudinal evaluative subscale and a behavioral intention subscale:

1. Affective Learning Construct

Affective learning represents the acquisition and internalization of positive sentiments, intellectual curiosity, and appreciation toward an academic field of study. Rooted in the taxonomy of Krathwohl et al. (1964), this construct measures the degree to which learners progress from passively receiving subject matter to actively valuing and organizing it within their personal cognitive schema. Within the ALIES, Affective Learning is assessed through eight items split across two dimensions:

• Affect Toward Content (Items 1–4): Evaluates the student’s cognitive-affective appraisal of the course subject matter itself, independent of the delivery agent. Measured through four bipolar evaluative adjectives (Bad–Good, Valuable–Worthless, Unfair–Fair, Positive–Negative), this subscale captures whether the curriculum is perceived as meaningful, socially valid, and intellectually enriching.
• Affect Toward Classes in This Content Area (Items 5–8): Assesses the behavioral intentionality of the student regarding future engagement with the discipline (Unlikely–Likely, Possible–Impossible, Improbable–Probable, Would–Would Not). Behavioral intention serves as a standard proxy in social cognitive and planned behavior theories (Ajzen, 1991), indicating whether current classroom affect translates into persistent academic pursuit.

2. Instructor Evaluation Construct

Instructor evaluation reflects the interpersonal appraisal and relational satisfaction experienced by the learner toward the individual instructor. While not an instructional learning outcome in the strict educational psychological sense, teacher appraisal functions as a critical mediating variable within educational ecology. It comprises eight items across two dimensions:

• Affect Toward Instructor (Items 9–12): Assesses the direct evaluative judgment of the instructor’s personal and professional presence in the classroom using the same bipolar evaluative anchors (Bad–Good, Valuable–Worthless, Unfair–Fair, Positive–Negative). This dimension taps interpersonal warmth, perceived competence, fairness, and student-teacher rapport.
• Affect Toward Taking Classes with This Instructor (Items 13–16): Measures the behavioral commitment of the student to enroll in future instructional offerings led specifically by that individual teacher (Unlikely–Likely, Possible–Impossible, Improbable–Probable, Would–Would Not), isolating interpersonal attraction and instructional endorsement from subject matter interest.

Theoretical Framework

The theoretical foundation of the ALIES rests at the convergence of three foundational paradigms: Krathwohl’s Affective Domain Taxonomy, Bandura’s Social Cognitive Theory, and the Rhetorical and Relational Goals Theory of Instructional Communication (Mottet et al., 2006).

In educational psychology, Krathwohl, Bloom, and Masia (1964) posited that educational objectives exist along a continuum of internalization. At the lowest level (Receiving), a learner simply tolerates instructional stimuli. As they advance through Responding (active participation) and Valuing (attributing intrinsic worth to the knowledge), the information transitions from extrinsic compliance to personal identity (Organization and Characterization). McCroskey adapted this taxonomy to communication theory, arguing that teachers do not merely transmit abstract information; they construct interpersonal communication environments that stimulate or inhibit affective internalization. When students experience psychological safety and communicative warmth, their affective appraisal shifts toward intrinsic valuing of the discipline.

Concurrently, the Principle of Nonverbal Immediacy, originally formulated by social psychologist Albert Mehrabian (1969, 1971) and adapted into instructional communication by Andersen (1979) and McCroskey et al. (1996), provides the operational engine for the scale. Immediacy behaviors—actions that enhance physical and psychological closeness—induce positive physiological and emotional arousal. According to the Affective-Cognitive Learning Model (Rodriguez, Plax, & Kearney, 1996), teacher immediacy directly drives student affect toward both the instructor and the course content. This heightened positive affect subsequently functions as an indispensable motivational catalyst, prompting greater mental effort, attention allocation, and deep cognitive processing.

The Rhetorical and Relational Goals Theory (Mottet et al., 2006) further explicates why Affective Learning and Instructor Evaluation must be conceptualized as separate constructs. In any instructional encounter, instructors pursue rhetorical goals (structuring the message, explaining clear content) and relational goals (building interpersonal affinity, conveying empathy). Correspondingly, students evaluate whether their relational needs are fulfilled (leading to high Instructor Evaluation) and whether their intellectual, academic aspirations are satisfied (leading to high Affective Learning). By structurally isolating these theoretical components, the ALIES maintains precise alignment with modern educational communication theory.

Validity

The psychometric validity of the Affective Learning and Instructor Evaluation Scales has been substantiated through dozens of empirical investigations across secondary, undergraduate, and postgraduate educational populations.

Content and Face Validity

The scale possesses high face and content validity. The paired bipolar adjectives utilized in the semantic differential arrays (e.g., Good/Bad, Valuable/Worthless, Fair/Unfair, Positive/Negative) were selected from Charles Osgood’s foundational research on the measurement of meaning (Osgood, Suci, & Tannenbaum, 1957). These specific evaluative dimensions are universally understood linguistic markers for general affective valence. The behavioral intention items (e.g., Likely/Unlikely, Probable/Improbable) directly operationalize established conventions in behavioral intention assessment.

Construct and Discriminant Validity

The most decisive validity milestones for the ALIES involve the demonstration of discriminant validity between Affective Learning and Instructor Evaluation. Early studies that forced a unidimensional solution reported inflated correlations that obscured unique variance. In contrast, modern structural equation modeling (SEM) and confirmatory factor analysis (CFA) demonstrate that a two-construct, four-factor model provides a significantly superior fit compared to single-factor models (McCroskey et al., 2006). Inter-factor correlations between the Affect Toward Content composite and the Affect Toward Instructor composite typically range from .45 to .65. While moderately correlated—as expected within an active classroom environment—they share only 20% to 42% of variance, confirming that they assess fundamentally distinct psychological phenomena.

Predictive and Convergent Validity

The predictive validity of the scale is exceptionally strong. Extensive empirical literature demonstrates that scores on the Affective Learning dimensions correlate significantly with:

• Cognitive Learning Indicators: Meta-analyses by Witt, Wheeless, and Allen (2004) revealed consistent positive correlations between affective learning and perceived student learning (r ≈ .50 to .65) as well as modest, statistically significant relationships with standardized cognitive test performance (r ≈ .15 to .25).
• Teacher Nonverbal and Verbal Immediacy: Hundreds of studies have documented strong, positive associations between perceived instructor immediacy and both Affective Learning (r = .40 to .60) and Instructor Evaluation (r = .55 to .75) (Richmond et al., 1987; Gorham, 1988).
• Academic Retention and Major Selection: Longitudinal studies demonstrate that students scoring in the highest quartile on Affect Toward Content Area are significantly more likely to persist in the major, declare minors in the discipline, and enroll in elective advanced seminars compared to those scoring in lower quartiles.

Reliability

The internal consistency of the ALIES is documented across instructional communication research. Decades of administrative administrations indicate that the 4-item bipolar semantic differential format minimizes measurement error and yields stable responses.

Internal Consistency (Cronbach’s Alpha)

Empirical studies consistently report Cronbach’s alpha coefficients well above accepted psychometric thresholds:

• Affect Toward Content (4 items): Alpha coefficients typically range from .85 to .92.
• Affect Toward Classes in This Content (4 items): Alpha coefficients consistently exceed .90, typically reported between .91 and .95.
• Affect Toward Instructor (4 items): Alpha coefficients regularly exceed .90, ranging from .90 to .94.
• Affect Toward Taking Classes with Instructor (4 items): Alpha coefficients consistently fall between .92 and .96.
• Affective Learning Composite (8 items, Content + Content Classes): Internal consistency estimates consistently exceed .92, often reaching .95.
• Instructor Evaluation Composite (8 items, Instructor + Instructor Classes): Estimates consistently range from .93 to .96.

Test-Retest Stability

In experimental settings assessing test-retest reliability across short administrative intervals (2 to 3 weeks without instructional intervention), temporal stability coefficients have been observed between r = .78 and r = .86. However, because affective states are naturally dynamic and sensitive to cumulative classroom interactions, assessments conducted across an entire academic semester appropriately capture genuine temporal fluctuations in student attitudes.

Factor Analysis

The structural dimensionality of the ALIES has been subjected to rigorous factor analytic scrutiny since its initial formulation.

Historical Factor Analytic Missteps

In the formative era of instructional communication metrics (1970s–1980s), investigators routinely performed unconstrained Exploratory Factor Analysis (EFA) using Principal Component Analysis with orthogonal (Varimax) rotation across entire batteries of 20 to 30 classroom evaluation items. Because evaluative items share general positive-negative semantic polarity, eigenvalues frequently suggested a massive primary factor accounting for 50% or more of total variance. This led researchers to inappropriately conclude that student affect was unidimensional, combining course affect, instructor liking, and future behavior into a single indiscriminate index.

Confirmatory Factor Analytic Findings

Subsequent psychometric investigations utilizing maximum likelihood Confirmatory Factor Analysis (CFA) demonstrated that the unidimensional model exhibits poor structural fit. Instead, the data conform cleanly to a correlated four-factor first-order model or a two-factor second-order model:

Fit indices from structural modeling studies (e.g., McCroskey et al., 2006) demonstrate superior parameters for the two-construct conceptualization: Comparative Fit Index (CFI) > .95, Tucker-Lewis Index (TLI) > .94, Root Mean Square Error of Approximation (RMSEA) < .06, and Standardized Root Mean Square Residual (SRMR) < .05. Factor loadings for each item onto its designated latent construct uniformly exceed .75, with cross-loadings remaining negligible.

Instrument / Measurement Tool

The scale is formatted as an objective, self-administered survey utilizing a 7-point semantic differential continuum.

• Format: Paper-and-pencil or computerized self-report questionnaire.
• Administration Time: Approximately 3 to 5 minutes.
• Item Composition: 16 items divided into four distinct sets of 4 bipolar adjective pairs.
• Target Population: Secondary, undergraduate, and graduate students, as well as participants in adult corporate training environments.
• Response Continuum: 7-point bipolar continuum between opposing anchor adjectives (scored 1 to 7).
• Subscale Breakdown:
  • Affect Toward Content: Items 1 to 4
  • Affect Toward Classes in Content: Items 5 to 8
  • Affect Toward Instructor: Items 9 to 12
  • Affect Toward Taking Classes with Instructor: Items 13 to 16
• Reverse Keying: To counteract acquiescence and response set bias, the scale systematically reverses polarity on alternate items. Specifically, in each 4-item block, the 1st and 3rd items place the negative anchor at ‘1’ and positive anchor at ‘7’ (or vice versa), while the 2nd and 4th items reverse this direction.
• Standard Scoring Algorithms:
  • Affect Toward Content: 16 + (Item 1 + Item 3) - (Item 2 + Item 4). (Possible range: 4 to 28).
  • Affect Toward Classes in This Content: 16 + (Item 5 + Item 7) - (Item 6 + Item 8). (Possible range: 4 to 28).
  • Affect Toward Instructor: 16 + (Item 9 + Item 11) - (Item 10 + Item 12). (Possible range: 4 to 28).
  • Affect Toward Taking Classes with This Instructor: 16 + (Item 13 + Item 15) - (Item 14 + Item 16). (Possible range: 4 to 28).
• Composite Constructs:
  • Affective Learning Score: Calculated by summing Affect Toward Content + Affect Toward Classes in Content (Theoretical range: 8 to 56). Higher scores represent stronger affective learning, subject matter appreciation, and willingness to study the discipline further.
  • Instructor Evaluation Score: Calculated by summing Affect Toward Instructor + Affect Toward Taking Classes with Instructor (Theoretical range: 8 to 56). Higher scores represent elevated interpersonal rapport, positive teacher evaluation, and pedagogical satisfaction.
  • Critical Methodological Caveat: Investigators must never aggregate all 16 items into a single unified composite score labeled “Affective Learning.” Doing so violates the construct integrity established by educational psychometrics.

Permissions & Fee and Test Year

The standardized version of this measurement tool was formally published by James C. McCroskey in 1994 in the proceedings of the Speech Communication Association Summer Conference on Assessment. Dr. McCroskey maintained an open-access philosophy regarding his measurement inventories to facilitate pedagogical advancement and communication research. Consequently, the Affective Learning and Instructor Evaluation Scales are considered in the public domain for scholarly, academic, and non-commercial educational research purposes.

No licensing fees or formal institutional permissions are required for non-commercial educational use, provided that appropriate bibliographic attribution is documented in all resulting publications, reports, or dissertations. Parties interested in proprietary, commercial, or consulting software integration must contact the copyright holders and the Department of Communication Studies at West Virginia University.

References

Andersen, J. F. (1979). Teacher immediacy as a predictor of teaching effectiveness. In D. Nimmo (Ed.), Communication Yearbook 3 (pp. 543–559). Transaction Books.

Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179–211. https://doi.org/10.1016/0749-5978(91)90020-T

Gorham, J. (1988). The relationship between verbal teacher immediacy behaviors and student learning. Communication Education, 37(1), 40–53. https://doi.org/10.1080/03634528809378702

Krathwohl, D. R., Bloom, B. S., & Masia, B. B. (1964). Taxonomy of educational objectives: The classification of educational goals. Handbook II: Affective domain. David McKay Company.

McCroskey, J. C. (1994). Assessment of affect toward communication and affect toward instruction in communication. In S. Morreale & M. Brooks (Eds.), 1994 SCA summer conference proceedings and prepared remarks: Assessing college student competence in speech communication (pp. 55–71). Speech Communication Association.

McCroskey, J. C., Richmond, V. P., & McCroskey, L. L. (2006). The role of communication in predicting student affective learning. Communication Education, 55(4), 401–412. https://doi.org/10.1080/03634520600879162

McCroskey, J. C., Sallinen, A., Fayer, J. M., Richmond, V. P., & Barraclough, R. A. (1996). Nonverbal immediacy and cognitive learning: A cross-cultural investigation. Communication Education, 45(3), 200–211. https://doi.org/10.1080/03634529609379049

Mehrabian, A. (1969). Some referents and measures of nonverbal behavior. Behavior Research Methods and Instrumentation, 1(6), 203–207. https://doi.org/10.3758/BF03208096

Mehrabian, A. (1971). Silent messages. Wadsworth Publishing.

Mottet, T. P., Richmond, V. P., & McCroskey, J. C. (Eds.). (2006). Handbook of instructional communication: Rhetorical and relational perspectives. Allyn & Bacon.

Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957). The measurement of meaning. University of Illinois Press.

Richmond, V. P., Gorham, J. S., & McCroskey, J. C. (1987). The relationship between selected immediacy behaviors and cognitive learning. In M. L. McLaughlin (Ed.), Communication Yearbook 10 (pp. 574–590). Sage Publications.

Rodriguez, J. I., Plax, T. G., & Kearney, P. (1996). Clarifying the relationship between teacher nonverbal immediacy and student cognitive learning: Affective learning as the central causal mediator. Communication Education, 45(4), 293–305. https://doi.org/10.1080/03634529609379059

Witt, P. L., Wheeless, L. R., & Allen, M. (2004). A meta-analytical review of the relationship between teacher immediacy and student learning. Communication Monographs, 71(2), 184–207. https://doi.org/10.1080/0363452042000228054

13. Items of the Scale (Questionnaire)