Chess Self-efficacy Scale (CSS)

1. Abstract

The Chess Self-efficacy Scale (CSS) (Olivo & Barbaranelli, 2023) is an advanced, domain-specific psychometric instrument designed to evaluate competitive chess players' beliefs regarding their cognitive, strategic, and emotional capabilities to exert control over their game performance, analytical problem-solving, and competitive environment. Developed within the conceptual architecture of Albert Bandura's Social Cognitive Theory, the scale captures the nuanced cognitive-emotional interface unique to mind sports, where physical exertion is negligible yet cognitive fatigue, acute time pressure, and prolonged tactical tension induce profound psychological strain. The initial pool of items was generated through the critical incident technique administered to active tournament competitors, yielding an operational 38-item self-report inventory that was empirically validated within a competitive Italian player sample.

Psychometric evaluations established a sophisticated hierarchical factor architecture comprising four distinct first-order dimensions: Preparation and Game, Problem-Solving, Negative Emotions, and Positive Emotions. These primary factors systematically converge into two higher-order second-order constructs—namely, the Performance dimension (subsuming tactical preparation, game management, and strategic problem-solving) and the Emotion dimension (subsuming the affective regulation of both debilitating negative states and facilitative positive affective surges). At the apex of this model sits a third-order overarching General Chess Self-Efficacy factor. Both Exploratory Factor Analysis (EFA) accompanied by parallel analysis and advanced Exploratory Structural Equation Modeling (ESEM; χ²(557) = 992, p < .001, RMSEA = .046, SRMR = .039) verified the structural integrity of the instrument. Confirmatory Factor Analysis (CFA) substantiated excellent internal consistency across scales, with Cronbach's alpha and McDonald's omega values ranging from .77 to .90 and .75 to .95, respectively. Demonstrating robust criterion validity, the scale differentiated among players stratified by international Elo rating bands across the first-order factors of Preparation and Game and Problem-Solving, establishing the CSS as a premier diagnostic and research tool in nonphysical sports, cognitive performance psychology, and competitive analytics.

2. Keywords

Chess Self-efficacy Scale, Self-Efficacy, Nonphysical Sports, Cognitive Performance, Emotional Regulation, Problem-Solving, Preparation and Game, Competitive Chess, Exploratory Structural Equation Modeling, Psychometrics, Social Cognitive Theory, Performance Psychology

3. Authors

The Chess Self-efficacy Scale (CSS) was developed and validated by researchers affiliated with the Department of Psychology at Sapienza University of Rome, Italy:

• Ilaria Olivo, Ph.D. — Department of Psychology, Sapienza University of Rome, Rome, Italy. Specialist in psychometrics, sports psychology, and cognitive performance assessment within competitive domains.
• Claudio Barbaranelli, Ph.D. (Corresponding Author) — Full Professor of Psychometrics, Department of Psychology, Sapienza University of Rome, Via dei Marsi 78, 00185 Rome, Italy. Email: [email protected]. Internationally recognized psychometrician noted for contributions to structural equation modeling, personality assessment, organizational psychology, and methodology.

4. Purpose

The primary purpose of the Chess Self-efficacy Scale (CSS) is to provide an empirically rigorous, domain-specific measurement tool capable of quantifying a competitive chess player's perceived capability to organize, execute, and sustain the complex cognitive, behavioral, and emotional courses of action required to manage tournament demands. For decades, empirical investigations into elite chess performance have predominantly focused on objective cognitive architecture, examining domains such as perceptual chunking (De Groot, 1965; Chase & Simon, 1973), deliberate practice frameworks (Ericsson et al., 1993), calculation speed, working memory capacity, and algorithmic pattern recognition. However, an exclusive cognitive paradigm frequently fails to explain why players possessing equivalent tactical acumen, master titles, and theoretical opening repertoires exhibit wide disparities under tournament conditions, particularly when confronting severe time trouble (zeitnot), unexpected opening novelties, psychological blunders, or multi-round physical-cognitive exhaustion.

The CSS bridges this theoretical chasm by evaluating the motivational and emotional self-regulatory mechanisms that determine how effectively an individual translates latent chess knowledge into realized competitive output. In classical physical sports (e.g., athletics, swimming, team sports), performance decrements are visibly tied to physiological thresholds, biomechanical breakdown, and kinesthetic self-efficacy. Conversely, in nonphysical or cognitive mind sports such as chess, competitive failure is mediated almost entirely through psychological processes: catastrophic cognitive interference triggered by acute competitive anxiety, premature resignation stemming from low self-efficacy after a tactical mistake, or loss of vigilance caused by poorly regulated positive affect (e.g., complacency or premature celebration in advantageous positions).

From a research perspective, the CSS addresses fundamental questions within performance psychology: How do cognitive self-efficacy and emotional regulation interact to predict competitive resilience? To what degree does domain-specific self-efficacy mediate the relationship between accumulated chess training hours and Elo rating progression? From a clinical, coaching, and applied perspective, the CSS serves as a diagnostic questionnaire. Coaches and sport psychologists working with competitive chess players, grandmasters, and developing juniors can deploy the CSS to profile a competitor's psychological strengths and vulnerabilities. Rather than treating poor tournament results as a mere deficit in opening theory or endgame technique, practitioners can isolate whether the athlete suffers from low confidence in problem-solving under ambiguity, insufficient pre-game preparation routines, debilitating negative emotion loops (e.g., fear of losing rating points), or dysregulated euphoric states that lead to tactical carelessness.

5. Psychological Construct

The psychological construct operationalized by the CSS is Domain-Specific Chess Self-Efficacy. Rooted in Bandura's social cognitive framework, self-efficacy does not reflect an individual's objective skill level, generalized self-esteem, or broad trait confidence; rather, it reflects a generative capability in which cognitive, social, emotional, and behavioral subskills must be orchestrated to serve diverse purposes under dynamic, demanding, and stressful conditions. In chess, this construct requires a multifaceted architecture because competitive play requires continuous oscillation between analytical calculation, temporal management, affective modulation, and metacognitive monitoring.

The CSS structural model is formally articulated across four primary first-order dimensions, grouped under two higher-order domains, which culminate in a global third-order factor:

First-Order Factors

• Preparation and Game: This dimension assesses an athlete's confidence in executing the behavioral and strategic routines necessary before and during a tournament match. It captures perceived competence in conducting targeted opening preparation against specific opponents, managing physical and psychological energy across multi-day events, maintaining focus through classical four-to-six-hour playing sessions, and implementing disciplined time management on the chess clock. An exemplar belief within this domain involves a player's perceived capability to maintain strategic clarity even when an opponent deviates from known theoretical preparation on move eight.
• Problem-Solving: This dimension taps into cognitive self-efficacy under tactical and strategic ambiguity. It measures a player's belief in their ability to calculate deep, branching variations, evaluate complex dynamic imbalances, formulate coherent long-term strategic plans in quiet positional setups, and identify creative counter-tactics when placed under sustained positional pressure. It reflects perceived competence in maintaining analytical objectivity when standard heuristics no longer apply.
• Negative Emotions: This affective-regulatory dimension measures an individual's perceived capability to withstand, modulate, and neutralize distressing affective states. Competitive chess is notorious for inducing intense acute distress, including performance anxiety, dread when facing a higher-rated opponent, frustration following a missed tactical win, and acute panic during severe time pressure. Self-efficacy in this subscale reflects the belief that one can prevent negative emotions from spilling into subsequent moves or future tournament rounds.
• Positive Emotions: Affective self-regulation in competitive chess is not limited to mitigating negative states; it requires the proactive governance of positive emotions. This dimension evaluates the player's perceived capability to manage feelings of excitement, triumph, and relief. High confidence in an overwhelmingly winning position frequently produces catastrophic lapses in vigilance (the "won game syndrome"). This subscale quantifies the player's belief in their capacity to maintain analytical sobriety, resist complacency, and execute technically precise conversion play regardless of psychological exhilaration.

Higher-Order Structural Constructs

• Performance Higher-Order Factor: A second-order latent construct that unifies the operational, procedural, and cognitive dimensions of the game by integrating Preparation and Game with Problem-Solving. It reflects overall perceived tactical and cognitive mastery.
• Emotion Higher-Order Factor: A second-order latent construct that synthesizes the affective components of performance by integrating the regulation of Negative Emotions and Positive Emotions into a cohesive emotional self-regulatory agency.
• General Chess Self-Efficacy: The apex third-order latent construct, representing the player's overarching, integrated belief in their capability to triumph over the multifaceted mental, tactical, and emotional challenges presented by competitive tournament chess.

6. Theoretical Framework

The theoretical bedrock of the Chess Self-efficacy Scale is Albert Bandura's Social Cognitive Theory (1986, 1997), specifically the construct of perceived self-efficacy. Bandura posited that human agency operates within a model of triadic reciprocal determinism, wherein internal cognitive/affective events, behavioral patterns, and environmental influences continuously interact. Within this architecture, self-efficacy beliefs function as the central cognitive mediator of human motivation, thought processes, emotional states, and behavioral actions. Bandura strongly emphasized that self-efficacy is inherently domain-specific: generalized measures of confidence or global self-esteem possess markedly low predictive validity for performance in specialized domains because they do not reflect the specific situational contingencies, stressors, and task demands of that activity.

Applying this theoretical imperative to chess requires synthesizing social cognitive theory with the cognitive psychology of expertise. Landmark studies by De Groot (1965) and Chase and Simon (1973) demonstrated that elite chess skill is underpinned by extensive, hierarchically organized perceptual knowledge structures (chunks and templates) stored in long-term memory. However, more recent sport and cognitive psychologists (e.g., Ericsson et al., 1993; Charness et al., 2005) have highlighted that cognitive expertise remains inert unless animated by sustained motivational commitment and emotional equanimity. In competitive encounters, two players with identical chess knowledge will generate vastly different decisions depending on their efficacy beliefs. A player with high problem-solving self-efficacy perceives a complicated, sharp, double-edged position as an invigorating challenge, intensifying cognitive search, extending visual calculation horizons, and persisting through analytical fatigue. Conversely, a player plagued by low self-efficacy perceives the exact same tactical complexity as a direct threat, triggering sympathetic autonomic arousal, narrowing visual attention, and inducing cognitive paralysis or premature simplification into inferior endgames.

Furthermore, the CSS integrates modern frameworks of Emotional Self-Regulation (Gross, 1998; Lazarus, 2000). Lazarus's Cognitive-Motivational-Relational Theory articulates how cognitive appraisal determines emotional response. In chess, every move made by the opponent forces a re-appraisal of one's survival, standing, and strategic health. The inclusion of distinct positive and negative emotional efficacy factors directly acknowledges that affect regulation in high-stakes intellectual contests is bidirectional. Negative emotional dysregulation manifests as catastrophizing, somatic tension, and depressive rumination after a blunder. Positive emotional dysregulation manifests as cognitive loosening, superficial calculation, and premature victory celebrations that betray tactical vulnerability. Thus, the CSS theoretical framework operates at the intersection of Bandurian agentic self-efficacy, cognitive expertise paradigms, and contemporary emotion regulation models.

7. Validity

The psychometric validation of the Chess Self-efficacy Scale followed a rigorous multi-stage empirical protocol designed to establish construct, criterion, and structural validity within competitive tournament populations.

Content and Construct Validity

To ensure high ecological and content validity, the item development phase did not rely on generic adaptations of existing sports inventories. Instead, Olivo and Barbaranelli utilized Flanagan's (1954) Critical Incident Technique. Semi-structured interviews and incident logs were gathered from active competitive chess players, prompting them to delineate specific situations that had definitively facilitated or compromised their performance in tournament conditions. Qualitative thematic analysis of these incidents generated an initial pool of domain-specific challenges (e.g., handling rapid time controls, coping with blunders, maintaining vigilance against lower-rated opponents, calculating intricate tactical sequences). Subsequent expert review pruned the pool to 38 finely calibrated items, demonstrating exceptional content coverage of the competitive chess experience.

Criterion-Related Validity

Criterion validity was established by testing whether the CSS could meaningfully differentiate players across objective performance standards. The primary external criterion utilized was the official Elo rating of the participants, which represents the internationally standard metric of chess skill established by the International Chess Federation (FIDE). Participants were categorized into distinct skill bands based on their official competitive ratings.

Univariate and multivariate analyses of variance (ANOVA/MANOVA) demonstrated significant, systematic differences across rating tiers:

• Preparation and Game Factor: A statistically significant main effect emerged across player rating categories, F(2, 319) = 5.304, p < .01, η² = 0.032. Higher-rated players reported significantly elevated efficacy regarding their pre-game preparation protocols, energetic management, and match pacing.
• Problem-Solving Factor: The scale exhibited strong discriminatory power for cognitive problem-solving, F(2, 319) = 10.321, p < .001, η² = 0.061. This medium effect size underscores that perceived analytical efficacy closely mirrors objective chess mastery, validating the instrument's sensitivity to cognitive expertise levels.

Interestingly, the emotional factors did not display linear divergence across rating bands, aligning with psychological theory: master-level players and club-level players alike must grapple with acute tournament anxiety and euphoric overconfidence, though their cognitive apparatus for resolving the physical board state differs fundamentally.

8. Reliability

The internal consistency of the Chess Self-efficacy Scale was thoroughly evaluated across all structural levels using both classical test theory metrics (Cronbach's alpha, α) and modern model-based composite reliability coefficients (McDonald's omega, ω). Because Cronbach's alpha relies on the restrictive assumption of tau-equivalence (equal factor loadings across all indicators), McDonald's omega provides a superior, unbiased estimate of reliability when utilizing Confirmatory Factor Analysis and Structural Equation Modeling frameworks.

All first-order subscales and higher-order composite factors demonstrated exceptional reliability values exceeding standard psychometric thresholds (i.e., α ≥ .70, ω ≥ .70):

The McDonald's omega value of .95 for the overarching General Self-Efficacy factor highlights outstanding composite reliability, indicating that the 38-item battery produces stable, low-error variance scores when applied to competitive chess populations.

9. Factor Analysis

The structural dimensionality of the 38-item CSS was investigated using a state-of-the-art sequence of Exploratory Factor Analysis (EFA), Exploratory Structural Equation Modeling (ESEM), and Confirmatory Factor Analysis (CFA).

Exploratory Factor Analysis & Parallel Analysis

To determine the exact number of latent dimensions without relying on the often-flawed Kaiser-Guttman criterion (eigenvalues > 1), the researchers conducted Horn's Parallel Analysis comparing empirical real-data eigenvalues against eigenvalues derived from 95th percentile random data matrices. The parallel analysis conclusively verified four major latent factors:

• Factor 4: The fourth real-data eigenvalue was 4.4706, comfortably exceeding the fourth average random eigenvalue (3.198) and the 95th percentile artificial eigenvalue (3.317).
• Factor 5: In contrast, the fifth real-data eigenvalue dropped to 3.027, which fell completely below the fifth average random eigenvalue (3.099) and the 95th percentile threshold (3.218).

This empirical divergence conclusively confirmed a 4-factor retention rule. The 4-factor solution accounted for 34.93% of the total variance across the item pool, which represents a substantial proportion for broad social-cognitive self-report instruments prior to residual clustering.

Exploratory Structural Equation Modeling (ESEM)

Because traditional CFA often imposes unrealistic zero-loading constraints on cross-loadings—leading to inflated inter-factor correlations and distorted model parameters—the authors estimated an Exploratory Structural Equation Model (ESEM) with target rotation. The 4-factor ESEM model yielded excellent goodness-of-fit indices:

• Chi-Square: χ²(557) = 992, p < .001 (a typical significant finding given sample sensitivity)
• Root Mean Square Error of Approximation (RMSEA): .046 (90% CI [.041, .050]; p(RMSEA < .05) = .93), demonstrating outstanding close fit
• Standardized Root Mean Square Residual (SRMR): .039, well below the conservative .05 threshold

Confirmatory Factor Analysis (CFA) & Hierarchical Modeling

Subsequent CFA modeling tested and verified the hypothesized hierarchical model. The primary factors of Preparation and Game and Problem-Solving loaded onto the higher-order Performance construct, while Negative Emotions and Positive Emotions loaded cleanly onto the higher-order Emotion construct. Finally, both higher-order dimensions loaded significantly onto the global General Chess Self-Efficacy apex factor. This confirms that while performance management and emotional regulation represent distinct psychological tasks, they are unified under an integrated agentic self-efficacy framework.

10. Instrument / Measurement Tool

• Instrument Name: Chess Self-efficacy Scale (CSS)
• Test Type: Domain-specific psychometric self-report questionnaire / inventory
• Target Population: Human adults (≥ 18 years), male and female, active in competitive chess tournaments
• Administration Format: Standardized electronic questionnaire (compatible with web-based testing platforms, mobile interfaces, and digital survey frameworks)
• Item Count: 38 items
• Subscale Structure:
  • First-Order Subscales (4): Preparation and Game, Problem-Solving, Negative Emotions, Positive Emotions
  • Second-Order Subscales (2): Performance (aggregating Preparation/Game + Problem-Solving), Emotion (aggregating Negative Emotions + Positive Emotions)
  • Third-Order Scale (1): General Chess Self-Efficacy (aggregate total scale)
• Response Scale: 5-point Likert-type rating format:
  • 1 = Not confident at all
  • 2 = Slightly confident
  • 3 = Moderately confident
  • 4 = Very confident
  • 5 = Completely confident
• Scoring Procedures: Item responses within each subscale are summed or averaged to yield dimension-specific scores. Higher mean scores indicate greater perceived self-efficacy in that specific cognitive or emotional domain. Composite scores for the Performance dimension, Emotion dimension, and General Chess Self-Efficacy scale are calculated via the linear aggregation of corresponding subscale indicators or via factor-score weights derived from structural equation modeling.

11. Permissions & Fee and Test Year

• Year of Initial Publication: 2023
• Commercial Status: Non-commercial instrument. The scale is freely accessible for non-commercial academic research, empirical psychological studies, and educational training.
• Administration Fee: No fee is charged for academic, non-commercial utilization.
• Permissions and Inquiries: Researchers, coaches, and clinicians intending to administer, translate, or adapt the Chess Self-efficacy Scale must contact the corresponding author, Prof. Claudio Barbaranelli, at the Department of Psychology, Sapienza University of Rome, Via dei Marsi 78, 00185 Rome, Italy (Email: [email protected]).

12. References

• Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Prentice-Hall.
• Bandura, A. (1997). Self-efficacy: The exercise of control. W. H. Freeman and Company.
• Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive Psychology, 4(1), 55–81. https://doi.org/10.1016/0010-0285(73)90004-2
• Charness, N., Tuffiash, M., Krampe, R., Reingold, E., & Vasyukova, E. (2005). The role of deliberate practice in chess expertise. Applied Cognitive Psychology, 19(2), 151–165. https://doi.org/10.1002/acp.1106
• De Groot, A. D. (1965). Thought and choice in chess. Mouton & Co.
• Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100(3), 363–406. https://doi.org/10.1037/0033-295X.100.3.363
• Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 51(4), 327–358. https://doi.org/10.1037/h0061470
• Gross, J. J. (1998). The emerging field of emotion regulation: An integrative review. Review of General Psychology, 2(3), 271–299. https://doi.org/10.1037/1089-2680.2.3.271
• Lazarus, R. S. (2000). How emotions influence performance in competitive sports. The Sport Psychologist, 14(3), 229–252. https://doi.org/10.1123/tsp.14.3.229
• Olivo, I., & Barbaranelli, C. (2023). Checking your chess! Development and validation of the Chess Self-efficacy Scale in a competitive setting. TPM – Testing, Psychometrics, Methodology in Applied Psychology, 30(3), 303–318. https://doi.org/10.4473/TPM30.3.4

13. Items of the Scale