Digital Transformation Stress Scale (DTSS)

1. Abstract

The Digital Transformation Stress Scale (DTSS) is a standardized, concise, self-report psychometric instrument engineered to evaluate and quantify acute psychological distress stemming specifically from the introduction, deployment, and supervisory management of Information and Communication Technology (ICT) systems within organizational ecosystems. As contemporary enterprises undergo rapid technological overhauls, workers frequently experience elevated strain generated by condensed timelines, heightened quantitative workloads, continuous skill obsolescence, and institutional demands for exponential productivity gains. The DTSS captures the affective, cognitive, and evaluative dimensions of employee stress specifically provoked by enterprise-wide technological restructuring.

Developed through a rigorous multi-phase psychometric protocol by an interdisciplinary team of organizational psychologists and human-computer interaction researchers (Makowska-Tłomak et al., 2023), the instrument originated from a candidate pool of 20 items adapted from established perceived stress inventories, notably the Perceived Stress Scale (PSS) and the Perceived Stress at Work scale. These foundational items were operationalized through the theoretical lenses of the Transactional Model of Stress and Coping and the Conservation of Resources (COR) Theory. Following iterative content validation by an expert panel of judges, the scale was distilled into a 6-item unidimensional architecture.

The scale was evaluated across two independent empirical investigations encompassing diverse cohorts of professionally active individuals aged 20 to 69 years. Factor analytic evaluations confirmed a robust, single-factor latent structure accounting for more than 68% of the total variance. Both initial and cross-validation studies demonstrated exceptional internal consistency, yielding Cronbach’s alpha values of .91 and .90, respectively. Item Response Theory (IRT) parameters revealed high discriminatory capability, particularly for individuals experiencing moderate-to-severe digital transformation stress. Construct validity was corroborated via convergent associations with generalized occupational stress (r = .45, R² = .20) and discriminant divergence from self-reported technical literacy inventories. The DTSS represents a vital, open-access diagnostic tool for industrial-organizational researchers, human resource managers, and organizational health professionals navigating digital change management.

2. Keywords

Digital Transformation, Technostress, Occupational Stress, Information and Communication Technology, Conservation of Resources Theory, Stress Appraisal Theory, Psychometrics, Factor Analysis, Item Response Theory, Workplace Well-Being, Employee Resistance to Change, Technology Acceptance

3. Authors

The Digital Transformation Stress Scale was developed by a specialized research consortium affiliated with prominent Polish academic institutions specializing in cognitive psychology, work and organizational psychology, and computer science:

• Ewa Makowska-Tłomak, M.Sc., Ph.D. candidate (ORCID: 0000-0002-6010-4210) — Faculty of Psychology, Institute of Psychology, SWPS University of Social Sciences and Humanities, Warsaw, Poland. Correspondence: [email protected], [email protected].
• Sylwia Bedyńska, Ph.D., Hab. (ORCID: 0000-0001-8255-1946) — Professor of Psychology, Center for Research on Social Relations, Institute of Psychology, SWPS University of Social Sciences and Humanities, Warsaw, Poland.
• Kinga Skorupska, Ph.D. — Human-Computer Interaction Center, Polish-Japanese Academy of Information Technology (PJAIT), Warsaw, Poland.
• Radosław Nielek, Ph.D., Hab. — Department of Multimedia, Polish-Japanese Academy of Information Technology, Warsaw, Poland.
• Monika Kornacka, Ph.D. — Emotion Cognition Lab, Institute of Psychology, SWPS University of Social Sciences and Humanities, Warsaw, Poland.
• Wiesław Kopeć, Ph.D., Hab. — Human-Computer Interaction Center, Polish-Japanese Academy of Information Technology, Warsaw, Poland.

4. Purpose

The primary purpose of the Digital Transformation Stress Scale (DTSS) is to deliver an empirical, methodologically sound, and ecologically valid instrument tailored specifically to capture the strain reactions induced by organizational digital transformation. Across global labor markets, enterprise restructuring driven by Enterprise Resource Planning (ERP) suites, cloud migration, collaborative SaaS platforms, artificial intelligence, and algorithmic workflow management systems has profoundly altered traditional job roles. While digital transformation aims to optimize productivity, enhance market agility, and streamline internal operations, it frequently triggers adverse psychological consequences among the workforce.

Historically, broad occupational stress inventories fail to isolate whether employee strain arises from interpersonal conflict, generalized role ambiguity, or specific technological disruption. Conversely, earlier technostress measures typically address broad technology usage or daily human-computer interactions, such as smartphone interruptions or software malfunctions. The DTSS departs from these generalized perspectives by concentrating explicitly on the administrative, procedural, and cultural disruptions characteristic of systemic corporate digital transformation. Specifically, the scale focuses on:

• The structural manner and administrative velocity of ICT deployment, where tools are implemented top-down without adequate employee consultation.
• The acute compression of operational timelines, resulting in severe subjective time pressure as staff must simultaneously fulfill daily obligations while mastering complex platforms.
• The inflation of performance expectations, wherein management presumes that digital automation instantaneously translates to higher individual productivity, generating disproportionate performance anxiety.
• The sudden shifts in professional roles, job autonomy, and internal workflows imposed by automated algorithms and new digital procedures.

From an applied organizational and clinical perspective, the DTSS serves multiple functions:

Organizational Change Monitoring and Risk Assessment: Industrial and organizational psychologists can deploy the DTSS longitudinally before, during, and after major digital rollouts. Identifying escalating stress scores allows leadership to recognize “change fatigue” or psychological distress early, permitting timely management interventions such as pacing rollout schedules, recalibrating quarterly deliverables, or expanding technical onboarding.

Diagnosis of Professional Resistance to Technology: When employees actively or passively resist new digital workflows, managers frequently mischaracterize this behavior as personal obstinacy or generational antipathy toward technology. The DTSS provides empirical evidence indicating whether resistance is driven by perceived loss of control, feelings of professional inadequacy, or systemic cognitive overload, facilitating empathetic and targeted change-management strategies.

Occupational Well-Being and Occupational Health Interventions: Digital transformation stress is a known antecedent of emotional exhaustion, physical fatigue, and clinical burnout. Occupational health teams can integrate the DTSS into annual organizational health audits to track the psychological toll of continuous digital disruption, ensuring compliance with evolving occupational safety standards concerning cognitive ergonomics.

Empirical Academic Research: The scale enables organizational researchers to test structural equation models that position digital transformation stress as a mediator or moderator linking technological implementation characteristics to job performance, turnover intention, organizational citizenship behavior, and digital self-efficacy.

5. Psychological Construct

The construct captured by the DTSS—termed Digital Transformation Stress (DTS)—is conceptualized as an acute, context-specific psychological strain reaction characterized by negative affective evaluations, perceived depletion of cognitive resources, and feelings of operational disempowerment triggered by enterprise-level ICT modifications. Although psychometrically unidimensional, the construct embodies four theoretical facets that collectively define the subjective experience of digital change-induced distress:

5.1. Technologically Induced Emotional Agitation and Frustration

At the affective level, digital transformation stress manifests as recurring irritation, tension, and emotional volatility directly elicited by new software architectures and digital workflows. Rather than reflecting an individual’s enduring neuroticism, this agitation arises when new ICT solutions disrupt familiar professional habits, generate unpredictable technical roadblocks, and impair established workplace efficacy. For instance, an employee who previously completed client intakes smoothly may experience severe irritation when a new digital interface crashes or imposes mandatory, labyrinthine verification steps. This continuous emotional activation, as represented in Item 1 (“How often have you felt upset in connection with new ICT programs/systems?”) and Item 2 (“How often have you felt irritated in connection with new ICT solutions which have affected your professional duties/tasks?”), constitutes the foundational affective core of DTS.

5.2. Technology-Induced Loss of Control and Autonomy Deficit

A central tenet of organizational psychology is the preservation of employee autonomy. Digital transformations frequently compromise worker agency by automating decisions, standardizing workflow execution paths, and centralizing organizational oversight. Employees often experience a total loss of personal discretion regarding how, when, and with what tools their responsibilities are executed. This loss of perceived control is tapped directly by Item 3 (“How often have you felt that you had no control over ICT changes connected with new procedures and your tasks?”). When digital systems mandate strict operational protocols without leaving room for individual adjustment, workers perceive their professional agency as being compromised by non-human algorithms.

5.3. Procedural Disenfranchisement and Alienation

In many enterprise contexts, digital implementations are executed via top-down administrative fiats. Strategic decisions regarding system migrations, vendor selections, and procedural modifications are made by senior leadership or external consultants without meaningful consultation with end-users. This structural disconnect produces feelings of procedural disenfranchisement, captured by Item 4 (“How often have you felt annoyed because of new work tasks/rules in connection with system/program changes whose implementation you had no influence on?”). The worker is forced to absorb systemic changes in role identity, administrative protocols, and reporting lines, fostering alienation and resentment toward organizational leadership and technological platforms alike.

5.4. Technological Overload and Perceived Competence Threat

Digital transformation fundamentally alters the value of an employee’s accumulated skills. Veteran professionals who mastered legacy protocols suddenly find their institutional knowledge marginalized, generating acute impostor fears and self-efficacy threats. Items 5 and 6 measure this existential and operational strain: Item 5 addresses subjective resource exhaustion (“How often have you felt that what was expected of you due to technological or IT changes was too much for you, to the point where you couldn’t cope with it?”), whereas Item 6 directly probes the subjective threat to professional mastery (“How often have you felt that your competences and skills were insufficient to be proficient in new IT tools implemented at your workplace?”). Together, these facets represent the cognitive realization that the technological environment exceeds the individual’s adaptive capacity.

6. Theoretical Framework

The construction and operationalization of the DTSS are grounded in two foundational, complementary paradigms within stress psychology: the Transactional Model of Stress and Coping and the Conservation of Resources (COR) Theory, augmented by the Job Demands-Resources (JD-R) model.

6.1. Lazarus and Folkman’s Transactional Model of Stress and Coping

According to the classic transactional paradigm developed by Richard S. Lazarus and Susan Folkman (1984), psychological stress is not an intrinsic property of the external environment, nor is it purely an internal somatic state. Rather, stress is an evaluative transaction between the individual and their environment, governed by two continuous cognitive mechanisms:

• Primary Appraisal: The employee evaluates an organizational event (e.g., the introduction of an enterprise-wide AI platform or new cloud CRM). The event is categorized as irrelevant, benign-positive, or stressful (representing harm/loss, threat, or challenge). Within digital transformation, sudden mandatory software shifts are commonly appraised as personal threats to job security, competence, and professional standing.
• Secondary Appraisal: The employee evaluates their internal and external coping options, assessing whether their personal skills, time buffers, and organizational support are sufficient to satisfy the demands. When an individual concludes that technological expectations vastly outweigh their coping resources, acute distress emerges.

The DTSS reflects this transactional calculus. The scale items do not assess the objective objective attributes of the software (e.g., server uptime, lines of code, or interface click-depth); rather, they measure the employee’s subjective cognitive appraisal of their capacity to adapt to these technologies relative to organizational expectations.

6.2. Hobfoll’s Conservation of Resources (COR) Theory

The Conservation of Resources (COR) Theory, formulated by Stevan E. Hobfoll (1989, 2018), posits that individuals strive to acquire, protect, retain, and foster valued resources. These resources encompass material objects, personal characteristics, conditions (e.g., tenure, autonomy), and energies (e.g., time, cognitive bandwidth). Psychological stress ensues when:

• Key resources are actively threatened with loss;
• Key resources are irretrievably lost; or
• Individuals fail to gain expected resource returns following significant resource investment.

Digital transformations trigger severe “resource loss spirals” within enterprise settings. First, employees must expend substantial energy resources (cognitive effort, extra work hours, emotional patience) to learn new digital tools, drastically depleting their cognitive bandwidth. Second, the disruption often threatens existing condition resources, such as status, peer authority, and established workflow autonomy. When workers observe that their substantial investment of time and energy does not alleviate workflow bottlenecks, COR theory predicts rapid disengagement, acute psychological strain, and workplace burnout. The DTSS captures the precise operational moments where resource loss is experienced as overwhelming coping capacity.

6.3. Integration with the Job Demands-Resources (JD-R) Perspective

The Job Demands-Resources model (Bakker & Demerouti, 2007) categorizes occupational working conditions into job demands (physical, psychological, social, or organizational aspects that require sustained effort and entail physiological and psychological costs) and job resources (aspects functional in achieving goals, reducing demands, or stimulating growth). Digital transformation simultaneously inflates job demands (accelerated task pace, perpetual multitasking, cognitive retooling) while undermining traditional job resources (autonomy, mastery, process predictability). The DTSS directly registers the resultant strain state provoked by this profound structural imbalance.

7. Validity

The psychometric integrity of the Digital Transformation Stress Scale was established across multiple validation samples, evaluating construct, convergent, criterion, and discriminant validity in accordance with AERA/APA/NCME Standards for Educational and Psychological Testing.

7.1. Convergent and Criterion Validity

To demonstrate convergent validity, researchers examined the linear relationship between the DTSS and generalized occupational strain using established measures of workplace stress (notably the Perceived Stress at Work scale; Chirkowska-Smolak, 2016). A moderate, statistically significant positive correlation was identified:

r = .45, p < .001

This empirical coefficient reveals that generalized occupational stress and digital transformation stress share approximately 20% common variance (R² = .20). This shared variance confirms that the DTSS appropriately reflects broader stress phenomenology, while the 80% unshared variance underscores that digital transformation stress represents a distinct construct rather than a simple redundancy of general workplace strain. It demonstrates that an individual can experience manageable general job demands yet suffer severe, acute stress caused by digital and technological overhauls.

7.2. Discriminant and Divergent Validity

To establish that the DTSS does not merely mirror an individual’s objective or subjective digital illiteracy, Makowska-Tłomak et al. (2023) administered the scale alongside an exhaustive self-assessment inventory of ICT technical skills. Crucially, the correlation between the DTSS and self-assessed digital competencies was statistically non-significant and near zero:

r ≈ .00, p > .05

This finding provides powerful evidence of discriminant validity. It establishes that digital transformation stress is not confined to individuals with low computer literacy. Highly proficient software developers, data analysts, and advanced digital specialists can experience extreme digital transformation stress if organizational rollouts are poorly managed, characterized by unrealistic time frames, arbitrary operational restructuring, or loss of technical control.

7.3. Known-Groups and Construct Validity

Criterion-related validity was further substantiated through known-groups comparisons reflecting organizational conditions:

• Active Implementation vs. Stable Environments: Employees in organizations actively executing major IT implementations demonstrated statistically significant elevations in DTSS scores compared to counterparts working in digitally stable environments without ongoing rollouts.
• Impact of the COVID-19 Operational Shift: The scale successfully differentiated workers whose professional tasks were radically altered by emergency remote work and rapid digital tool deployment during the COVID-19 pandemic from workers whose operational parameters remained unaffected. Those undergoing pandemic-accelerated digital transitions reported significantly higher DTS levels, validating the scale’s sensitivity to real-world technological shocks.

8. Reliability

The DTSS demonstrates strong internal consistency and measurement precision across empirical investigations and statistical frameworks.

8.1. Internal Consistency

Classical test theory reliability estimates were computed across two large-scale independent investigations involving diverse working populations:

• Initial Psychometric Study: In the preliminary validation sample, the 6-item scale exhibited an internal consistency of α = .91 (Cronbach’s alpha).
• Advanced Cross-Validation Study: In the independent replication sample, the scale demonstrated stable reliability with α = .90.

These values comfortably exceed the conventional .80 threshold recommended for empirical research and meet the stringent .90 standard required for diagnostic use in organizational assessment. The scale exhibits high inter-item correlations, with no single item’s deletion leading to an improvement in the overall alpha coefficient.

8.2. Item Response Theory (IRT) Precision Across the Latent Continuum

Using Item Response Theory (IRT) modeling (specifically graded response modeling), the authors mapped the scale’s Test Information Function (TIF) across the standardized latent trait continuum (θ, where M = 0, SD = 1). The findings indicated that:

• The DTSS achieves its peak measurement precision in the moderate-to-severe range of the latent stress continuum (θ between 0.0 and +3.0). Standard errors of measurement (SEM) are lowest in this sector.
• The instrument is sensitive at identifying individuals undergoing clinically and organizationally meaningful levels of digital stress.
• Conversely, measurement precision is lower at the extreme bottom of the continuum (θ < -1.5). The scale functions primarily to detect and stratify the presence and severity of stress, rather than differentiating finely between individuals who feel virtually zero technological strain.

9. Factor Analysis

The structural dimensionality of the DTSS was investigated using both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA), complemented by IRT parameter estimations.

9.1. Exploratory Factor Analysis (EFA)

In the primary psychometric development phase, principal component and common factor exploratory analyses were executed on the 6 candidate items. Both the Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy and Bartlett’s Test of Sphericity confirmed the matrix factorability. Analysis revealed a single dominant latent factor based on Cattell’s scree plot inflection and eigenvalues exceeding 1.0. This single factor accounted for over 68% of the total cumulative variance. All 6 items loaded heavily on this single latent dimension, with standardized factor loadings uniformly exceeding .75, demonstrating a cohesive unidimensional construct.

9.2. Confirmatory Factor Analysis (CFA)

To verify the unidimensional construct architecture, Confirmatory Factor Analysis was conducted using structural equation modeling (SEM). The baseline one-factor model yielded initial fit parameters that suggested minor localized strain due to semantic overlap between two specific indicators.

Inspection of modification indices identified significant error covariance between Item 5 (“How often have you felt that what was expected of you due to technological or IT changes was too much for you, to the point where you couldn’t cope with it?”) and Item 6 (“How often have you felt that your competences and skills were insufficient to be proficient in new IT tools implemented at your workplace?”). This covariance is theoretically grounded: both items probe internal competence appraisal and subjective coping capacity under operational pressure, whereas items 1 to 4 focus primarily on external procedural changes, control, and affective frustration.

Upon specifying an unconstrained error covariance of r = .48 between items 5 and 6, the respecified unidimensional model demonstrated excellent fit across all standard psychometric criteria:

• Comparative Fit Index (CFI): > .97
• Tucker-Lewis Index (TLI): > .95
• Root Mean Square Error of Approximation (RMSEA): < .06
• Standardized Root Mean Square Residual (SRMR): < .04

All standardized factor loadings remained statistically significant (p < .001) and substantial (ranging from .72 to .88), providing structural validation for the single-factor scoring approach.

9.3. Item Discrimination and Difficulty Parameters (IRT)

Parametric analysis under the Graded Response Model demonstrated that all 6 items exhibit high and balanced discrimination parameters (a-parameters), indicating that each item discriminates well between high-stress and low-stress employees. The threshold difficulty parameters (b-parameters) revealed that the item thresholds span evenly across the upper half of the trait distribution, supporting the scale’s utility for targeted organizational diagnostic evaluations.

10. Instrument / Measurement Tool

• Instrument Name: Digital Transformation Stress Scale (DTSS)
• Original Authors: Ewa Makowska-Tłomak, Sylwia Bedyńska, Kinga Skorupska, Radosław Nielek, Monika Kornacka, and Wiesław Kopeć (2023)
• Instrument Classification: Short-form, self-report psychometric rating scale
• Intended Target Population: Professionally active adults (aged 18 to 69+) across all enterprise and organizational sectors experiencing technological, digital, or IT software implementations
• Primary Construct Assessed: Digital Transformation Stress (DTS)—strain, frustration, loss of control, and perceived inadequacy resulting from enterprise ICT implementations
• Item Inventory: 6 brief, unambiguous items formulated in parallel English and Polish versions
• Reference Time Window: Respondents evaluate their experiences over the preceding four weeks (“during the last four weeks”)
• Response Scale & Scoring Anchors: 5-point Likert frequency scale:
  • 1 = Never (Polish: Nigdy)
  • 2 = Rarely (Polish: Rzadko)
  • 3 = Sometimes (Polish: Czasami)
  • 4 = Often (Polish: Często)
  • 5 = Very often (Polish: Bardzo często)
• Reverse-Coded Items: None. All 6 items are scored in the direct pathological direction
• Scoring Computation: An overall digital transformation stress score is derived by computing the arithmetic mean across all 6 completed items (Sum of responses divided by 6). The resulting composite score ranges continuously from 1.00 to 5.00:
• Score Interpretation Guidelines:
  • 1.00 – 2.00: Low Digital Transformation Stress. The individual perceives minimal operational friction and adapts comfortably to digital workflows.
  • 2.01 – 3.49: Moderate Digital Transformation Stress. Noticeable strain and occasional operational frustration; monitoring and resource replenishment are advisable.
  • 3.50 – 5.00: High to Severe Digital Transformation Stress. Substantial distress characterized by feelings of lost autonomy, acute competence threat, and coping depletion. Requires immediate organizational intervention, technical support, and workload calibration.
• Estimated Completion Time: Approximately 2 to 3 minutes, minimizing survey fatigue in corporate field settings

11. Permissions & Fee and Test Year

The Digital Transformation Stress Scale was published in 2023 by Makowska-Tłomak and colleagues in the open-access, peer-reviewed journal PLoS ONE. The scale, its documentation, and its translations are released under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0).

Under this legal framework, researchers, educators, human resource practitioners, and clinicians are permitted to freely copy, reproduce, administer, distribute, translate, and adapt the DTSS for both non-commercial research and commercial organizational assessment purposes, without paying licensing fees or securing explicit prior written permission from the authors or publisher. The sole requirement is that appropriate credit and formal academic citation are attributed to the original authors and the primary PLOS ONE publication.

12. References

Bakker, A. B., & Demerouti, E. (2007). The Job Demands-Resources model: State of the art. Journal of Managerial Psychology, 22(3), 309–328. https://doi.org/10.1108/02683940710733115

Chirkowska-Smolak, T. (2016). Stres w pracy: Pomiary i konsekwencje [Stress at work: Measurement and consequences]. Wydawnictwo Naukowe Wydziału Nauk Społecznych UAM.

Cohen, S., Kamarck, T., & Mermelstein, R. (1983). A global measure of perceived stress. Journal of Health and Social Behavior, 24(4), 385–396. https://doi.org/10.2307/2136404

Hobfoll, S. E. (1989). Conservation of resources: A new attempt at conceptualizing stress. American Psychologist, 44(3), 513–524. https://doi.org/10.1037/0003-066X.44.3.513

Hobfoll, S. E., Halbesleben, J., Neveu, J.-P., & Westman, M. (2018). Conservation of resources in the organizational context: The reality of resources and their consequences. Annual Review of Organizational Psychology and Organizational Behavior, 5, 103–128. https://doi.org/10.1146/annurev-orgpsych-032117-104640

Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal, and coping. Springer Publishing Company.

Makowska-Tłomak, E., Bedyńska, S., Skorupska, K., Nielek, R., Kornacka, M., & Kopeć, W. (2023). Measuring digital transformation stress at the workplace–Development and validation of the Digital Transformation Stress Scale. PLoS ONE, 18(10), Article e0287223. https://doi.org/10.1371/journal.pone.0287223

Tarafdar, M., Tu, Q., Ragu-Nathan, B. S., & Ragu-Nathan, T. S. (2007). The impact of technostress on role stress and productivity. Journal of Management Information Systems, 24(1), 301–328. https://doi.org/10.2753/MIS0742-1222240109

13. Items of the Scale