Organizational Justice Scale (OJS)

1. Abstract

The Organizational Justice Scale (OJS), developed by educational leadership scholars Wayne K. Hoy and C. John Tarter (2004), is a standardized psychometric instrument engineered to evaluate perceptions of fairness, equity, and ethical conduct within educational organizations. Grounded in contemporary organizational justice theory, the OJS operationalizes the multidimensional construct of fairness within the institutional and relational dynamics of primary and secondary schools. The scale consists of 10 carefully calibrated items measured on a 6-point Likert-type response format ranging from 1 (Strongly Disagree) to 6 (Strongly Agree). Although classical corporate organizational justice models delineate three or four distinct dimensions—namely distributive, procedural, interpersonal, and informational justice—the OJS operationalizes justice in schools as a coherent, unified macro-construct reflecting administrative consistency, egalitarian treatment, procedural transparency, professional integrity, and teacher participation in decision-making. Psychometric investigations demonstrate exceptional internal consistency, with Cronbach’s alpha reliability coefficients consistently exceeding .90 (typically observed between .92 and .94). Exploratory and confirmatory factor analyses affirm a robust, highly stable single-factor structure that accounts for over 60% of the total variance, while supporting strong convergent, discriminant, and criterion-related validity. Specifically, scores on the OJS exhibit profound empirical associations with faculty trust in the principal, institutional trust in colleagues, organizational citizenship behavior (OCB), school climate openness, and teacher collective efficacy. This article provides a comprehensive psychometric and theoretical analysis of the OJS, delineating its structural properties, clinical and administrative utility, empirical validity, and methodological applications in school organizational research.

2. Keywords

Organizational Justice Scale, OJS, Wayne K. Hoy, C. John Tarter, educational leadership, organizational justice, faculty trust, procedural justice, distributive justice, interactional justice, school climate, psychometrics

3. Authors

The Organizational Justice Scale (OJS) was conceived and validated by two prominent figures in educational administration and organizational behavior research:

• Wayne K. Hoy, Ed.D. — The Ohio State University, College of Education and Human Ecology. Dr. Hoy is the Fawcett Professor Emeritus of Educational Administration at The Ohio State University. He has authored dozens of seminal books and hundreds of peer-reviewed articles focusing on organizational theory, school climate, academic optimism, faculty trust, and institutional leadership. Contact information and archival research inventories are maintained at his academic portal: www.waynekhoy.com.
• C. John Tarter, Ed.D. — St. John’s University, School of Education, Department of Administrative and Instructional Leadership. Dr. Tarter’s scholarship concentrated on administrative decision-making, organizational trust, social systems theory in schools, and educational policy governance, contributing extensively to collaborative leadership models in public education.

4. Purpose

The primary purpose of the Organizational Justice Scale (OJS) is to provide educational researchers, school administrators, organizational psychologists, and leadership evaluators with an empirically rigorous, concise, and diagnostically potent instrument capable of capturing faculty members’ perceptions of institutional fairness. In educational institutions, the perception of fairness is not merely a tangential climate indicator; it functions as a central psychological catalyst governing teacher commitment, morale, organizational health, and institutional efficacy.

Before the development of the OJS, educational researchers relied heavily on general corporate justice scales—such as the multi-component inventories developed by Jerald Greenberg or Jason A. Colquitt. While these instruments offered psychometric precision within corporate, for-profit settings, they often failed to capture the unique normative, structural, and interpersonal realities of school organizations. Schools are loosely coupled human service organizations characterized by high professional autonomy, complex collective bargaining agreements, non-linear incentive structures, and deeply relational leadership hierarchies. Hoy and Tarter (2004) recognized that school justice fundamentally hinges on administrative impartiality, ethical consistency, professional dignity, and genuine participatory decision-making. Consequently, the OJS was created to bridge this critical gap, tailoring organizational justice inquiry to the daily operational reality of teachers and administrators.

In both research and diagnostic contexts, the OJS fulfills multiple vital functions:

• Assessing Leadership Integrity and Impartiality: The instrument quantifies the degree to which teachers perceive the building principal as an ethical, non-favoritist leader who adheres to consistent moral and operational standards (e.g., items reflecting lack of favoritism, ethical consistency, and respect).
• Diagnosing Participatory Governance: It measures the extent of shared decision-making, examining whether educators possess meaningful voice in school-level decisions that directly affect their pedagogical practices and working conditions.
• Evaluating Equity Across Subsystems: Uniquely among organizational fairness scales, the OJS addresses equity across multiple institutional constituencies, assessing whether both teachers and students are treated equitably within the school culture.
• Facilitating Organizational Interventions: School districts and leadership coaches utilize aggregated OJS profiles to identify systemic perceived injustices, inform administrative professional development, and mitigate teacher burnout, alienation, and faculty attrition.
• Serving as a Foundational Predictor in Structural Equation Models: In empirical research, the scale is widely applied as a central exogenous or mediating variable predicting school performance indicators, faculty citizenship behaviors, professional learning communities (PLCs), and academic optimism.

5. Psychological Construct

The psychological construct assessed by the OJS is organizational justice within educational systems. Conceptually, organizational justice refers to members’ subjective perceptions of fairness regarding workplace distributions, procedures, and interpersonal interactions. In organizational literature, justice is classically deconstructed into distinct yet correlated dimensions:

Distributive Justice

Distributive justice pertains to the perceived fairness of outcome allocations, such as resource distribution, workload assignments, professional development opportunities, and formal recognitions. Rooted in J. Stacy Adams’ equity theory, individuals evaluate their input-outcome ratio against referent others. Within the OJS, distributive justice is reflected through the institutional absence of favoritism and preferential treatment (e.g., Item 3: “The principal does not play favorites” and Item 5: “There is no preferential treatment in this school”). In a school where distributive justice prevails, schedules, high-need classrooms, instructional materials, and committee assignments are distributed through transparent, equitable criteria rather than cronyism or administrative bias.

Procedural Justice

Procedural justice involves the fairness of the processes, rules, and mechanisms used to arrive at institutional decisions. Formulated by Thibaut and Walker and expanded by Leventhal, procedural justice requires decision-making processes to be consistent, bias-free, accurate, correctable, representative, and ethically grounded. The OJS explicitly integrates procedural principles, notably procedural consistency (Item 1: “The principal’s behaviour is consistent”) and the fundamental procedural principle of “voice” or participatory decision-making (Item 9: “Teachers are involved in decisions that affect them”). When teachers experience procedural justice, they exhibit higher organizational commitment even when specific administrative outcomes do not align with their personal preferences.

Interactional and Interpersonal Justice

Interactional justice, conceptualized by Bies and Moag, concerns the quality of interpersonal treatment individuals receive from authority figures during the execution of organizational procedures. It encompasses two sub-facets: interpersonal justice (treating subordinates with dignity, courtesy, and respect) and informational justice (providing transparent, truthful, and timely explanations). In the OJS, interactional justice is directly indexed by Item 4: “The principal treats everyone with respect and dignity” and Item 8: “The principal adheres to high ethical standards.” In school settings, interactional justice represents the emotional and ethical foundation of principal-teacher interactions.

Unidimensional Convergence in School Organizations

Crucially, while academic literature differentiates these three justice paradigms, Hoy and Tarter’s empirical investigations revealed that in the social architecture of schools, teachers do not functionally compartmentalize these facets into separate psychological silos. Instead, teachers construct a holistic, unified schema of school justice. In school environments, leadership behavior, procedural guidelines, resource distributions, and ethical norms blend into an overarching psychological gestalt: the school is either experienced as an equitable, principled, and trustworthy environment, or one characterized by capricious, politicized, and unfair practices. Thus, the psychological construct operationalized by the OJS is a second-order, unidimensional reflection of holistic institutional justice.

6. Theoretical Framework

The theoretical architecture underpinning the Organizational Justice Scale draws upon social exchange theory, organizational climate theory, and the seminal conceptual work of Wayne K. Hoy and C. John Tarter regarding the foundational interdependence of justice and trust. The theoretical core of the OJS is articulated in the authors’ foundational thesis: “No justice without trust.”

Social Exchange Theory and the Norm of Reciprocity

According to Social Exchange Theory (Blau, 1964), workplace relationships operate along a continuum ranging from purely transactional economic exchanges to deeply psychological, open-ended social exchanges. Transactional exchanges rely on formal contracts and immediate reward contingencies. Social exchanges, conversely, are founded upon trust, mutual respect, and generalized expectations of future reciprocity. When school leaders establish an environment characterized by procedural, distributive, and interactional fairness, teachers do not feel exploited or marginalized. In response to fair institutional treatment, the norm of reciprocity (Gouldner, 1960) compels educators to reciprocate with discretionary effort—manifested as organizational citizenship behaviors, collaborative assistance to colleagues, and elevated commitment to student achievement.

The Symbiotic Nexus Between Justice and Trust

Hoy and Tarter (2004) synthesized classical justice frameworks with their established research program on organizational trust. They defined trust as an individual’s or group’s willingness to be vulnerable to another party based on the confidence that the other party is benevolent, reliable, competent, honest, and open. Hoy and Tarter theorized that organizational justice is the primary structural antecedent of institutional trust. In their structural model:

• Fairness Engenders Vulnerability: When teachers observe consistent, ethical behavior from leadership (Item 1, Item 8) and experience absence of favoritism (Item 3, Item 5), the psychological risks associated with organizational vulnerability are neutralized.
• Erosion of Psychological Defense: Injustice breeds cynicism, defensive posturing, and factionalism within school faculties. Conversely, systematic justice dismantles political infighting, enabling faculty members to focus collective energy on pedagogical excellence.
• Mutual Reinforcement: Hoy and Tarter demonstrated that while justice fosters trust, trust also serves as a perceptual lens that reinforces the interpretation of ambiguous administrative actions as inherently fair.

Integrative School Climate Paradigm

The scale is further grounded in Hoy and colleagues’ broader school climate framework, which conceptualizes the school as an open social system. Within this social system, formal bureaucratic expectations intersect with informal employee needs. The OJS explicitly measures the harmonious balance between formal administration (the principal’s behavior, adherence to standards) and individual professional agency (involvement in decisions, selfless commitment among educators). By integrating students into the justice equation (Item 2: “Students in this school are treated fairly”), the theoretical model conceptualizes fairness not merely as an employee-employer contract, but as an pervasive moral climate characterizing the entire school organization.

7. Validity

The Organizational Justice Scale has been subjected to extensive psychometric evaluations across multiple independent samples of educational professionals, demonstrating robust construct, convergent, discriminant, and criterion-related validity.

Construct Validity

Construct validity for the OJS was initially established by Hoy and Tarter (2004) through rigorous item-total correlation analysis and internal structure testing. All 10 items exhibit strong, statistically significant correlations with the total scale score, typically ranging from r = .68 to r = .86, demonstrating that each item reliably reflects the target construct of school justice. Cross-validation studies across elementary, middle, and high school settings confirm that the construct maintains conceptual and structural equivalence across distinct organizational tiers of the educational system.

Convergent Validity

Convergent validity is substantiated by robust, positive correlations between the OJS and theoretically adjacent psychological constructs:

• Faculty Trust in the Principal: Hoy and Tarter (2004) observed an exceptionally strong bivariate correlation between the OJS and the Faculty Trust in the Principal subscale of the Omnibus T-Scale, with coefficients regularly exceeding r = .80 (p < .001). This demonstrates that administrative fairness and leadership trust share substantial common variance, aligning with theoretical predictions.
• Faculty Trust in Colleagues: Moderate to strong positive correlations (r = .55 to .65, p < .001) are consistently found between organizational justice and collegial trust, showing that school-wide justice cultivates mutual horizontal reliability among peers.
• School Climate Openness: Significant positive relationships exist between OJS scores and the Openness dimension of the Organizational Climate Description Questionnaire (OCDQ-RE/RM), demonstrating that open, collegial, and non-restrictive schools exhibit significantly higher justice ratings.

Discriminant Validity

Discriminant validity has been demonstrated by contrasting OJS scores against constructs representing dysfunctional school dynamics. Statistically significant negative correlations have been documented between OJS scores and:

• Teacher Alienation and Cynicism: Strong inverse correlations ranging from r = -.52 to -.68.
• Principal Bureaucratic Restrictiveness / Hindrance: Negative correlations ranging from r = -.48 to -.62.
• Teacher Burnout: Significant negative associations with emotional exhaustion and depersonalization dimensions of burnout inventories.

Multitrait-multimethod approaches and average variance extracted (AVE) analyses demonstrate that while the OJS correlates strongly with trust, the latent factors are distinct: confirmatory models specifying justice and trust as separate correlated constructs consistently achieve superior fit over unidimensional models combining both constructs into a single undifferentiated factor.

Criterion-Related and Predictive Validity

Criterion-related validity is evidenced by the scale’s documented ability to predict critical educational and behavioral outcomes. Multiple regression and structural equation modeling (SEM) investigations demonstrate that OJS scores account for unique variance in:

• Organizational Citizenship Behavior (OCB): Perceptions of organizational justice significantly predict altruistic, conscientious, and sportsmanship behaviors among teachers (Hoy, Tarter, & Bliss, 1990; Hoy & Tarter, 2004).
• Teacher Collective Efficacy: Schools with high justice ratings systematically display greater collective belief in their capability to positively impact student learning regardless of socioeconomic impediments.
• Student Academic Achievement: Hierarchical linear modeling (HLM) studies indicate that school-level organizational justice exerts an indirect positive effect on standardized student achievement, mediated through faculty trust and academic optimism.

8. Reliability

The Organizational Justice Scale displays exceptional internal consistency and temporal stability across diverse empirical investigations in primary, middle, and secondary schools.

Internal Consistency Reliability

In the foundational validation study by Hoy and Tarter (2004), the internal consistency of the 10-item instrument, as assessed by Cronbach’s alpha coefficient, was reported at α = .92. Subsequent empirical investigations across independent samples of urban, suburban, and rural school districts have repeatedly substantiated this high level of internal consistency, routinely producing alpha coefficients ranging between .90 and .95:

• Hoy, Gage, and Tarter (2006): Confirmed an alpha coefficient of α = .93 in a sample of secondary school faculties.
• Independent cross-cultural validation studies (e.g., Turkish, European, and East Asian adaptations in educational settings): Yielded internal consistency indices consistently between α = .89 and α = .94, confirming that the scale’s items reliably sample the same latent content domain.
• Standard Error of Measurement (SEM) estimates for the OJS are remarkably low, affirming high precision across the entire range of latent fairness scores.

Test-Retest Reliability and Aggregate Stability

Because the OJS is frequently aggregated to the school level as an organizational property, stability across time and inter-rater agreement within units are vital psychometric parameters:

• Temporal Stability: Test-retest reliability across an 8- to 12-week interval yielded stability coefficients ranging from r = .82 to .87, demonstrating that while the scale detects deliberate organizational interventions, it remains stable in the absence of institutional leadership shifts.
• Aggregation Indices: When calculating school-level aggregate scores, intra-class correlation coefficients [ICC(1) and ICC(2)] and within-group agreement statistics [r_wg(j)] consistently satisfy standard methodological thresholds (ICC(1) > .20; ICC(2) > .75; median r_wg > .80), justifying the statistical aggregation of individual teacher responses to characterize school organizational properties.

9. Factor Analysis

The internal structural validity of the Organizational Justice Scale has been rigorously examined through both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) across several hundred school faculties.

Exploratory Factor Analysis (EFA)

During scale construction, Hoy and Tarter subjected the item pool to principal axis factoring and principal components analysis with both orthogonal (Varimax) and oblique (Promax) rotations. Across multiple school datasets, factor analyses consistently produced a clear, robust single-factor solution:

• Eigenvalues and Variance Explained: A single dominant factor emerged with an initial eigenvalue routinely exceeding 5.5 (frequently between 5.8 and 6.4), accounting for 58% to 64% of the total variance. A scree plot analysis demonstrated a definitive elbow following the first factor, with secondary eigenvalues dropping precipitously below 0.80, clearly affirming unidimensionality.
• Factor Loadings: All 10 items exhibited robust factor loadings on the primary dimension, with loadings ranging from .65 to .87. No significant cross-loadings or peripheral item residuals were observed. The highest loading items consistently related to leadership impartiality and ethical integrity (e.g., Item 6: “The principal in this school is fair to everyone”, loading > .85; Item 3: “The principal does not play favorites”, loading > .80).

Confirmatory Factor Analysis (CFA)

Confirmatory factor analyses conducted in subsequent structural investigations have systematically tested alternative structural models, specifically comparing a one-factor model against multidimensional alternatives (e.g., independent two-, three-, or four-factor structures separating procedural, distributive, and interactional items). The single-factor model has exhibited exceptional goodness-of-fit indices across educational samples:

• Comparative Fit Index (CFI): .95 to .98 (exceeding the standard .95 cutoff for superior fit).
• Tucker-Lewis Index (TLI): .94 to .97.
• Root Mean Square Error of Approximation (RMSEA): .045 to .062 (with 90% confidence intervals below .08).
• Standardized Root Mean Square Residual (SRMR): .032 to .048.

When multidimensional models were specified, the inter-factor correlations among putative procedural, distributive, and interactional sub-dimensions exceeded r = .85, indicating severe multicollinearity and absence of empirical distinctiveness in school organizations. Consequently, both EFA and CFA firmly justify modeling the OJS as a psychometrically robust, unidimensional scale representing holistic school justice.

10. Instrument / Measurement Tool

The Organizational Justice Scale (OJS) is structured as a brief, high-efficiency survey instrument specifically optimized for faculty administration. Key structural attributes include:

• Test Type: Organizational psychometric questionnaire / school climate inventory.
• Respondent Population: Certified professional school personnel (teachers, educational specialists, instructional coaches, and building staff).
• Total Number of Items: 10 declarative statements.
• Administration Format: Self-administered paper-and-pencil questionnaire or secure digital/web-based assessment platform.
• Administration Time: Approximately 3 to 5 minutes, minimizing survey fatigue and ensuring high institutional response rates.
• Response Scale: 6-point forced-choice Likert-type scale with no neutral midpoint:
• 1 = Strongly Disagree
• 2 = Disagree
• 3 = Somewhat Disagree
• 4 = Somewhat Agree
• 5 = Agree
• 6 = Strongly Agree
• Scoring Protocol:
• All 10 items are positively formulated toward fair, ethical, and equitable organizational practices.
• Reverse Scoring: There are no reverse-coded items on the OJS. Every item is scored in the direct positive direction (1 = 1, 2 = 2, 3 = 3, 4 = 4, 5 = 5, 6 = 6).
• Individual Justice Score: Computed either as the sum of all 10 items (ranging from 10 to 60) or as the arithmetic mean of all completed items (ranging from 1.0 to 6.0). A higher score indicates a stronger perception of organizational fairness and ethical leadership.
• School-Level (Organizational) Score: When utilized in organizational research, individual teacher scores are aggregated by calculating the building mean across all respondents within a school. Hoy and Tarter recommend establishing a minimum faculty participation rate of 60–70% within a school to ensure aggregate representative validity.
• Standardized Norms (SND Transformation): Raw school mean scores can be converted into standardized scores (Standardized Normal Distribution with a mean of 500 and a standard deviation of 100) using regional or national normative datasets established by Wayne K. Hoy:
  Standard Score = 100 * (School Mean - Sample Mean) / Sample SD + 500

11. Permissions & Fee and Test Year

The Organizational Justice Scale was formally published in 2004 by Wayne K. Hoy and C. John Tarter in their foundational article published in the International Journal of Educational Management.

• Permissions and Academic Accessibility: In accordance with Dr. Wayne K. Hoy’s commitment to advancing educational scholarship, the Organizational Justice Scale is considered an open-access psychometric instrument for non-commercial educational research and scholarly inquiry. Dr. Hoy has made the instrument, scoring guides, and related diagnostic scales freely accessible to doctoral researchers, educational scholars, and school practitioners via his official academic archive (www.waynekhoy.com).
• Fee: There are no licensing fees or royalties required for academic, dissertation, or internal school diagnostic applications.
• Terms of Use: Researchers utilizing the scale must properly cite the seminal 2004 publication (Hoy & Tarter, 2004) and ensure that the items are reproduced accurately without unauthorized commercial redistribution or proprietary resale.

12. References

• Adams, J. S. (1965). Inequity in social exchange. In L. Berkowitz (Ed.), Advances in Experimental Social Psychology (Vol. 2, pp. 267-299). Academic Press. https://doi.org/10.1016/S0065-2601(08)60108-2
• Bies, R. J., & Moag, J. S. (1986). Interactional justice: Communication criteria of fairness. In R. J. Lewicki, B. H. Sheppard, & M. H. Bazerman (Eds.), Research on Negotiations in Organizations (Vol. 1, pp. 43-55). JAI Press.
• Blau, P. M. (1964). Exchange and Power in Social Life. John Wiley & Sons.
• Colquitt, J. A. (2001). On the dimensionality of organizational justice: A construct validation of a measure. Journal of Applied Psychology, 86(3), 386-400. https://doi.org/10.1037/0021-9010.86.3.386
• Gouldner, A. W. (1960). The norm of reciprocity: A preliminary statement. American Sociological Review, 25(2), 161-178. https://doi.org/10.2307/2092623
• Greenberg, J. (1990). Organizational justice: Yesterday, today, and tomorrow. Journal of Management, 16(2), 399-432. https://doi.org/10.1177/014920639001600208
• Hoy, W. K., Gage, C. Q., & Tarter, C. J. (2006). School mindfulness and faculty trust: Necessary conditions for each other? Educational Administration Quarterly, 42(2), 236-255. https://doi.org/10.1177/0013161X04273844
• Hoy, W. K., & Tarter, C. J. (2004). Organizational justice in schools: No justice without trust. International Journal of Educational Management, 18(4), 250-259. https://doi.org/10.1108/09513540410538831
• Hoy, W. K., Tarter, C. J., & Bliss, J. R. (1990). Organizational climate, school health, and effectiveness: A comparative analysis. Educational Administration Quarterly, 26(3), 260-279. https://doi.org/10.1177/0013161X90026003004
• Leventhal, G. S. (1980). What should be done with equity theory? New approaches to the study of fairness in social relationships. In K. J. Gergen, M. S. Greenberg, & R. H. Willis (Eds.), Social Exchange: Advances in Theory and Research (pp. 27-55). Plenum Press. https://doi.org/10.1007/978-1-4613-3087-5_2
• Thibaut, J. W., & Walker, L. (1975). Procedural Justice: A Psychological Analysis. L. Erlbaum Associates.

13. Items of the Scale