Bully Index (BI)

1. Abstract

The Bully Index (BI) is an organizational psychometric instrument developed by Wayne K. Hoy and P. A. Smith (2004) designed to assess teachers’ perceptions of student interpersonal aggression and school-level institutional responsiveness. Conceptualized as an environmental assessment tool rather than an individual victim/perpetrator inventory, the instrument captures the climate of peer aggression and protective organizational practices within elementary, middle, and secondary schools. The Bully Index consists of 13 items measured on a 6-point Likert-type scale ranging from 1 (Strongly Disagree) to 6 (Strongly Agree). Structural analyses reveal a stable two-dimensional construct comprising Student Bullying (8 items), which captures visible peer harassment, overt intimidation, physical threats, and climate-level fear, and Teacher Protection (5 items), which quantifies proactive staff interventions, supervisory vigilance, and institutional safeguards established for vulnerable or marginalized youth.

Psychometric evaluations demonstrate excellent empirical integrity. The primary subscale, Student Bullying, displays exemplary internal consistency (Cronbach’s alpha = .96), whereas the Teacher Protection subscale demonstrates sound reliability (α = .73). The instrument has demonstrated robust construct validity, converging predictably with measures of school disorder, academic press, faculty trust in students, and organizational health, while establishing discriminant validity against broader school demographic covariates. As an institutional diagnostic and empirical research measure, the Bully Index provides educational leaders, school psychologists, and organizational researchers with a standardized, reliable method for evaluating bullying as an organizational and cultural property of schools.

2. Keywords

Bully Index, Wayne K. Hoy, school climate, teacher perceptions, peer victimization, student intimidation, teacher protection, organizational health, school violence, school psychology, psychometrics, academic press

3. Authors

The Bully Index was developed and psychometrically validated by:

• P. A. Smith, Ph.D. — Department of Educational Leadership and Policy Studies, educational administration researcher specializing in organizational culture, school safety, and faculty behavioral dynamics.
• Wayne K. Hoy, Ed.D. — The Ohio State University, Fawcett Professor Emeritus of Educational Administration. A seminal figure in educational organizational theory, Dr. Hoy has developed foundational measurement scales assessing school climate, academic optimism, faculty trust, organizational mindfulness, and professional health.

Correspondence regarding the historical conceptualization and instrumentation of school climate indices developed under Dr. Hoy’s research program can be directed through the academic repository maintained at waynekhoy.com.

4. Purpose

The primary purpose of the Bully Index is to measure the shared perceptions of instructional faculty regarding the manifestation of peer victimization, intimidation, and collective protective behaviors within educational organizations. While extensive empirical literature examines peer bullying from the vantage point of student self-reports (such as victim or bully surveys), school-level macro-analyses often suffer from respondent bias, student developmental distortions, underreporting due to fear of retaliation, and the absence of school-wide organizational contextualization. The Bully Index approaches bullying not merely as an isolated dyadic behavioral pathology between victim and perpetrator, but as a systemic feature of the school climate.

Research Applications

In educational research, the scale is utilized to investigate complex organizational hypotheses. Researchers frequently employ the Bully Index to assess how faculty perceptions of peer harassment and teacher intervention correlate with institutional performance metrics, such as standardized student achievement, graduation rates, and teacher retention. Furthermore, the scale serves as a key operational variable in multilevel structural equation models (SEM) examining the relationship between school safety, faculty trust, collective teacher efficacy, and student academic optimism. By quantifying bullying as an environmental property aggregated to the school building level, researchers can assess school-level variance across different administrative structures, socio-economic contexts, and policy interventions.

Clinical and Organizational Applications

Within applied educational administration and school psychology, the Bully Index serves as an institutional diagnostic assessment. School leadership teams, behavioral specialists, and district safety officers deploy the scale to:

• Establish empirical baseline indicators before implementing school-wide anti-bullying or restorative justice programs (e.g., Positive Behavioral Interventions and Supports [PBIS] or the Olweus Bullying Prevention Program).
• Conduct targeted post-intervention assessments to evaluate whether organizational interventions significantly reduce perceived student intimidation or elevate teacher protective responses.
• Identify institutional blind spots where teachers systematically overlook or downplay bullying, allowing for targeted professional development in intervention fidelity and trauma-informed behavioral support.
• Identify discrepancies between teacher-perceived protection and student-reported safety metrics, providing a comprehensive assessment of institutional awareness.

5. Psychological Construct

The conceptual foundation of the Bully Index operationalizes school-level bullying as a multidimensional phenomenon comprising two interrelated, structurally distinct organizational dimensions: Student Bullying and Teacher Protection.

Dimension 1: Student Bullying

The Student Bullying subscale measures the prevalence, intensity, and pervasiveness of coercive peer behaviors within the school environment as observed by educators. Building on Dan Olweus’s classic formulation of bullying, this construct is defined by repeated negative actions, power asymmetry between perpetrators and victims, and the creation of an underlying atmosphere of fear and vulnerability. Rather than limiting the definition to physical violence, the construct encompasses several overt and covert manifestations:

• Climate of Fear: The pervasive apprehension among students that they are vulnerable to peer aggression during the school day (exemplified by Item 1: “Students in this school fear other students”).
• Pervasiveness and Commonality: The degree to which bullying behaviors are perceived as systemic normative occurrences rather than aberrant, isolated incidents (captured by Item 2: “Bullying students is commonplace in this school”).
• Physical Threats and Hostile Intimidation: Overt displays of aggression, direct threats of bodily harm, and structural intimidation executed by dominant individuals or groups (exemplified by Item 8: “Students in this school threaten others with physical harm” and Item 5: “Student ruffians in this school intimidate other students”).
• Verbal and Relational Ridicule: Interpersonal mockery, public humiliation, and social disparagement (captured by Item 6: “Students in this school make fun of other students”).
• Disruptive/Rowdy Norms: A general behavioral milieu marked by rowdiness, boundary-pushing, and aggressive peer dynamics (exemplified by Item 12: “Rowdy student behaviour is common in this school”).

Dimension 2: Teacher Protection

The Teacher Protection subscale reflects the organizational responsiveness, supervision, and active protective stance maintained by instructional faculty. It captures the normative willingness of teachers to intervene, confront aggression, safeguard vulnerable students, and enforce clear behavioral boundaries. This dimension contrasts active, supportive organizational intervention with passive tolerance or institutional neglect:

• Active Intervention and Direct Assistance: The degree to which teachers purposefully reach out to support harassed individuals and build protective relational buffers (captured by Item 4: “Teachers in this school reach out to help students who are harassed by other students”).
• Prosocial Protection of Marginalized or Diverse Peers: The institutional vigilance exerted by teachers to defend students who deviate from peer norms or possess characteristics that render them vulnerable to targeted harassment (exemplified by Item 13: “In this school, teachers try to protect students who are different”).
• Clear Normative Boundaries Against Intimidation: The school-wide establishment and enforcement of rules that prohibit peer harassment (measured by Item 11: “In this school, students intimidating other students is not permitted”).
• Institutional Oversight versus Neglect (Reverse-Scored): The degree to which faculty fail to notice, trivialize, or actively ignore student intimidation and harassment (operationalized by Item 3: “Teachers in this school generally overlook student bullying” and Item 7: “In this school, teachers ignore students intimidating other students”).

6. Theoretical Framework

The Bully Index is grounded in Social Cognitive Theory, organizational climate frameworks, and Urie Bronfenbrenner’s Ecological Systems Theory.

Organizational Climate and Social Cognitive Theory

Wayne K. Hoy’s scholarship conceptualizes schools as social systems characterized by distinct organizational climates. Within Albert Bandura’s social cognitive paradigm, behavioral patterns within an organization are governed by dynamic triadic reciprocal determinism: the ongoing interaction between environmental variables, personal cognitive factors, and collective behavioral patterns. In schools, peer aggression does not occur in an environmental vacuum; it is mediated by the collective norms of the organizational environment.

When teachers consistently overlook, dismiss, or fail to intervene in peer harassment, they unintentionally signal that aggressive behavior carries minimal social cost. This institutional indifference reinforces the social status of bullies while diminishing the safety of victims. Conversely, high levels of collective teacher protection signal that aggression will be met with immediate institutional consequences, reshaping the social architecture of the school.

Ecological Systems Paradigm

From an ecological systems perspective, peer victimization operates across the microsystem (direct peer-to-peer interactions) and the mesosystem (interactions between microsystems, such as teacher-student dynamics). The Bully Index bridges these levels by examining how the mesosystemic supervision provided by educators regulates the peer dynamics of the microsystem. Bronfenbrenner argued that the structural presence of supportive, vigilant adults in the proximal environment serves as a protective ecological buffer. By capturing teacher perceptions of both student aggression and institutional protection, the scale operationalizes the reciprocal balance between ecological risk factors (e.g., intimidation, physical threats, social mockery) and ecological protective assets (e.g., active teacher vigilance, enforcement of behavioral standards).

7. Validity

The psychometric validity of the Bully Index was established through rigorous empirical testing during its initial development and subsequent validation studies (Smith & Hoy, 2004).

Construct and Convergent Validity

The construct validity of the Bully Index has been corroborated through theoretical convergence with related organizational health and climate metrics. The Student Bullying subscale exhibits strong, statistically significant positive correlations with instruments assessing school disorder, disciplinary infractions, and student alienation. Conversely, the Student Bullying subscale displays strong negative correlations with:

• Faculty Trust in Students and Parents: Schools with high levels of peer bullying show lower teacher trust in students (typically r ≈ -.50 to -.65, p < .001).
• Academic Optimism: A shared climate of intimidation correlates negatively with school-wide academic press and collective teacher efficacy.
• Collegial Leadership: Supportive, visible administrative leadership is associated with lower teacher-perceived student bullying and higher rates of teacher protective actions.

Predictive and Criterion Validity

Predictive validity is demonstrated by the instrument’s capacity to explain significant variance in school-level achievement and climate indicators. Multilevel regression analyses show that schools scoring higher on the Student Bullying dimension register significantly lower mean scores on state-mandated standardized reading and mathematics assessments, even after controlling for socioeconomic status (SES) and school demographic size. Furthermore, schools with elevated Teacher Protection scores display fewer out-of-school suspensions, lower chronic absenteeism, and higher levels of self-reported student safety on independent student climate surveys.

Discriminant Validity

Discriminant validity is supported by the distinct factor loadings of the two subscales. The correlation between the Student Bullying and Teacher Protection dimensions, while moderately negative (typically ranging between r = -.35 and r = -.48), indicates that the two subscales measure complementary, structurally independent dimensions rather than redundant poles of a single continuum. A school may exhibit moderate levels of student rowdiness while simultaneously sustaining strong, proactive teacher protective networks.

8. Reliability

The Bully Index demonstrates high internal consistency across both research and field evaluation settings. In the seminal psychometric validation study conducted by Smith and Hoy (2004), the internal consistency of the subscales was evaluated using Cronbach’s alpha coefficients calculated from school-level aggregated faculty responses:

• Student Bullying Subscale (8 items): α = .96
• Teacher Protection Subscale (5 items): α = .73

The reliability coefficient of .96 for the Student Bullying subscale reflects exceptional internal consistency and minimal measurement error, making it suitable for both descriptive research and organizational diagnostic applications. The Teacher Protection subscale, while containing fewer items and incorporating reverse-scored items, satisfies standard psychometric criteria for organizational research scales (α ≥ .70).

Furthermore, because the instrument is typically administered to individual teachers and subsequently aggregated to reflect an institutional or school-wide property, intra-class correlation coefficients (ICC[1] and ICC[2]) have been evaluated in organizational studies. These analyses demonstrate substantial within-school agreement and reliable between-school differentiation, justifying the aggregation of individual teacher ratings to the organizational level.

9. Factor Analysis

The structural dimensionality of the Bully Index was determined through empirical factor analytic procedures conducted by Smith and Hoy (2004).

Exploratory Factor Analysis (EFA)

During scale construction, an initial pool of items reflecting school bullying, harassment, teacher intervention, and supervisory control was subjected to Exploratory Factor Analysis utilizing principal axis factoring and varimax orthogonal rotation (as well as oblique rotations to account for latent factor intercorrelations). The factor analysis clearly extracted two distinct latent dimensions accounting for a substantial majority of the total variance:

• Factor 1: Student Bullying. Eight items loaded cleanly onto this primary factor, with primary factor loadings ranging from .78 to .92. These items assess overt intimidation (e.g., “Students in this school threaten others with physical harm”), climate-level fear (e.g., “Students in this school fear other students”), and pervasive peer harassment. Cross-loadings onto the second factor were low (< .25).
• Factor 2: Teacher Protection. Five items loaded onto this factor, characterized by items measuring direct faculty protective intervention (e.g., “Teachers in this school reach out to help students who are harassed by other students”) and the enforcement of behavioral standards (e.g., “In this school, students intimidating other students is not permitted”). The two reverse-scored items (Items 3 and 7), assessing teacher neglect, loaded moderately to highly in the inverted direction, confirming their alignment with this dimension.

Model Fit and Confirmatory Factor Analysis (CFA)

Subsequent confirmatory structural analyses supported the hypothesized two-factor oblique model over alternative single-factor specifications. Structural equation evaluations demonstrate acceptable fit indices:

• Root Mean Square Error of Approximation (RMSEA) ≤ .06
• Comparative Fit Index (CFI) ≥ .94
• Tucker-Lewis Index (TLI) ≥ .93
• Standardized Root Mean Square Residual (SRMR) ≤ .05

These findings substantiate the conceptual distinction between student-driven aggression and faculty-driven protection, confirming that institutional safety cannot be modeled solely through the presence or absence of bullying behaviors, but requires an evaluation of the school’s supervisory and protective infrastructure.

10. Instrument / Measurement Tool

The Bully Index is structured as follows:

• Test Type: Organizational assessment questionnaire / Rating scale.
• Target Informants: Certified instructional personnel, classroom teachers, school psychologists, and academic administrators.
• Item Count: 13 items.
• Response Format: 6-point balanced Likert-type scale:
  • 1 = Strongly Disagree
  • 2 = Disagree
  • 3 = Somewhat Disagree
  • 4 = Somewhat Agree
  • 5 = Agree
  • 6 = Strongly Agree
• Subscale Allocation:
  • Student Bullying (8 items): Items 1, 2, 5, 6, 8, 9, 10, and 12.
  • Teacher Protection (5 items): Items 3, 4, 7, 11, and 13.
• Scoring and Transformation Rules:
  • Reverse Scoring: Prior to aggregation, reverse-score Item 3 and Item 7 (Transformation formula: Reversed Score = 7 − Original Response). This aligns the directionality so that higher scores consistently reflect greater levels of protective action and lower institutional neglect.
  • Individual Subscale Calculation: Compute the mean (or sum) for each subscale for every respondent.
  • School-Level Aggregation: In organizational research, average individual faculty subscale scores across all respondents within a school building to produce aggregate school-level metrics for Student Bullying and Teacher Protection.

11. Permissions & Fee and Test Year

The Bully Index was published in 2004 by P. A. Smith and Wayne K. Hoy in the Journal of School Leadership. In accordance with the scholarly distribution policies established by Dr. Wayne K. Hoy for his educational instruments, the Bully Index is classified as an open-access, non-commercial research instrument. It is made freely available for scholarly, educational, dissertation, and non-profit school diagnostic purposes without royalty fees or licensing charges, provided that appropriate scholarly attribution is cited.

The scale, scoring guidelines, and conceptual documentation are hosted publicly via Dr. Hoy’s open-access repository at waynekhoy.com/pdfs/Bully_Scale.pdf. Commercial reproduction, inclusion in commercial software packages, or fee-based third-party distribution requires written permission from the copyright holders.

12. References

• Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Prentice-Hall.
• Bronfenbrenner, U. (1979). The ecology of human development: Experiments by nature and design. Harvard University Press.
• Hoy, W. K., & Miskel, C. G. (2013). Educational administration: Theory, research, and practice (9th ed.). McGraw-Hill.
• Hoy, W. K., & Sabo, D. J. (1998). Quality middle schools: Open and healthy. Corwin Press.
• Hoy, W. K., Tarter, C. J., & Hoy, A. W. (2006). Academic optimism of schools: A force for student achievement. American Educational Research Journal, 43(3), 425–446. https://doi.org/10.3102/00028312043003425
• Olweus, D. (1993). Bullying at school: What we know and what we can do. Blackwell Publishers.
• Smith, P. A., & Hoy, W. K. (2004). Teachers’ perceptions of student bullying: A conceptual and empirical analysis. Journal of School Leadership, 14(3), 308–326. https://doi.org/10.1177/105268460401400303
• Tschannen-Moran, M., & Hoy, W. K. (2000). A multidisciplinary analysis of the nature, meaning, and measurement of trust. Review of Educational Research, 70(4), 547–593. https://doi.org/10.3102/00346543070004547

13. Items of the Scale