1. Abstract
The Risk assessment and safety compliance culture in the chemical industry questionnaire is an established organizational evaluation tool developed by Dr. Toivo Niskanen to assess the systemic integration of occupational safety directives, chemical risk assessment practices, and safety culture within industrial chemical environments. Originally validated within the context of European Council Directive 98/24/EC on the protection of the health and safety of workers from the risks related to chemical agents at work, this psychometric and organizational survey instrument operationalizes occupational health and safety (OSH) management into quantifiable behavioral, procedural, and cultural dimensions. Administered across both managerial (employer) and operative (worker) strata, the instrument captures multi-level perspectives on safe chemical handling, regulatory compliance climate, proactive hazard identification, retrospective incident analysis, and occupational training adequacy. By linking regulatory mandates with social-cognitive indicators of safety culture, the tool evaluates whether risk assessments function as proactive, participatory safety tools or merely as symbolic administrative compliance. Psychometric evaluations of the scale demonstrate robust construct validity, high internal consistency across sub-dimensions, and solid criterion-related validity in distinguishing between high-compliance enterprises and facilities exhibiting high accident frequencies. This article provides an exhaustive psychometric, theoretical, and practical review of the instrument, outlining its structural framework, measurement properties, factorial architecture, and utility in high-reliability process industries.
2. Keywords
chemical safety culture, safety compliance climate, occupational health and safety, Chemical Agents Directive 98/24/EC, hazard identification, risk assessment, process safety management, occupational hygiene, organizational safety climate, high-hazard industries, Toivo Niskanen, OSH directives
3. Authors
The questionnaire was authored by Dr. Toivo Niskanen, an authority in occupational safety management, ergonomics, and safety legislation. Dr. Niskanen has served extensively as a Senior Adviser within the Ministry of Social Affairs and Health in Finland (Department for Occupational Safety and Health) and as a Docent and senior researcher affiliated with Finnish academic institutions, including the University of Eastern Finland (Kuopio campus) and the Finnish Institute of Occupational Health (FIOH). His research program has focused on the implementation of European Union safety legislation, safety climate modeling in manufacturing and chemical processing, socioeconomic evaluations of accident prevention, and the ergonomics of industrial workstations. Correspondence regarding the original national chemical survey methodology has historically been directed through institutional channels at the Ministry of Social Affairs and Health, Occupational Safety and Health Division, Tampere/Helsinki, Finland, or via academic communications associated with the Journal of Loss Prevention in the Process Industries.
4. Purpose
The primary purpose of the Risk assessment and safety compliance culture in the chemical industry survey is to evaluate the degree to which enterprise-level chemical management practices align with statutory risk assessment requirements and how deeply these obligations are embedded within the organizational culture. High-consequence processing facilities operate under pervasive operational hazards involving toxic, flammable, reactive, and explosive substances. In such settings, failure to adhere to chemical safety protocols can precipitate catastrophic industrial accidents, chronic occupational illnesses, and severe environmental contamination. Developed specifically to evaluate the practical enforcement and institutional penetration of European Council Directive 98/24/EC, the survey was designed to answer fundamental questions about the efficacy of occupational health and safety (OSH) legislation.
From an applied organizational perspective, the instrument evaluates whether statutory obligations are translated into daily shop-floor routines or relegated to superficial paperwork. The questionnaire systematically diagnoses whether safety activities are proactive (e.g., continuous exposure monitoring, prospective job safety analyses, hazard anticipation) or merely retrospective (e.g., compiling injury statistics, reacting only after catastrophic loss or regulatory inspection). Furthermore, it investigates the utilization gap: it measures not only whether risk assessments are carried out, but whether their findings directly inform engineering controls, standard operating procedures, maintenance schedules, and personal protective equipment (PPE) selection.
From a research and clinical-evaluative perspective, the tool serves several vital functions:
- Multi-Level Discrepancy Analysis: By collecting matched data from employers/managers and front-line workers, the survey allows researchers to quantify perception gaps across organizational hierarchies. Divergence between management’s perception of safety compliance and workers’ actual experiences reveals hidden vulnerabilities in the organizational safety climate.
- Diagnostic Benchmarking: Enterprises utilize the survey to benchmark their performance across chemical sub-branches (e.g., petrochemicals, basic chemicals, pharmaceuticals, agrochemicals, plastics manufacturing), isolating specific systemic deficiencies in workplace exposure controls or training pipelines.
- Policy and Regulatory Efficacy Evaluation: Public health authorities and regulatory bodies use the tool to identify which sections of national and European OSH legislation are effectively understood and implemented, and which require technical revision, simplified guidelines, or heightened regulatory oversight.
5. Psychological Construct
The instrument operationalizes safety culture and compliance climate within high-hazard industrial settings. Rather than treating safety culture as an abstract, monolithic entity, the scale deconstructs it into actionable psychological, behavioral, and organizational dimensions. Rooted in the distinction between safety climate (shared, surface-level perceptions of policies, procedures, and practices at a specific point in time) and safety culture (deep-seated values, core assumptions, and normative behavioral expectations regarding safety), the instrument measures the degree to which formal compliance is sustained by underlying organizational attitudes.
Core Dimensions Measured by the Instrument
1. Perception of Safe Chemical Handling Practices: This dimension assesses employees’ and managers’ shared perceptions regarding the fundamental adequacy of toxic substance containment, chemical transfer operations, ventilation efficacy, and personal protective gear utilization. It reflects behavioral norms surrounding chemical handling, evaluating whether safety precautions are prioritized over production velocity.
2. OSH Directive Awareness and Procedural Compliance: This construct examines institutional awareness and perceived legitimacy of binding statutory frameworks, particularly European Council Directive 98/24/EC and related process safety legislation. It measures whether workers and management view regulatory mandates as authoritative, meaningful guides or as burdensome bureaucratic impositions.
3. Proactive Hazard Identification: This dimension captures the proactive cognitive and operational orientations within the workforce. It measures whether employees actively scan the operational environment for nascent chemical hazards, fugitive emissions, ergonomic stressors, and process deviations before they manifest as adverse events.
4. Retrospective Data Utilization: Moving beyond simple accident tracking, this construct gauges an organization’s collective learning capacity. It assesses how effectively incident reports, near-miss registries, occupational disease registries, and root-cause analyses are synthesized to update operating limits and preventive maintenance schedules.
5. Risk Assessment Execution and Participatory Quality: This dimension measures the procedural rigor, multidisciplinary scope, and participatory nature of workplace risk assessments. It evaluates whether risk assessments are executed collaboratively with workers’ safety representatives or drafted unilaterally by isolated safety engineers without frontline input.
6. Utilization and Translation of Risk Assessment Findings: An essential construct that separates superficial compliance from authentic safety culture. It assesses whether risk assessment documentation directly produces concrete risk mitigation controls, such as toxic chemical substitution, engineering redesign, automated isolation systems, or refined safe work permits.
7. Competence Development and On-the-Job Training Adequacy: This dimension measures psychological perceptions of self-efficacy, technical competence, and the systemic adequacy of specialized safety training regarding hazardous chemical properties, toxicological risks, and emergency countermeasures.
8. Upward Participatory Voice and Legislative Development: This construct reflects psychological safety and employee empowerment, capturing the extent to which frontline workers feel authorized to suggest safety improvements, influence OSH policy, and contribute to continuous regulatory reform.
6. Theoretical Framework
The theoretical foundations of the scale draw from industrial-organizational psychology, human factors engineering, and high-reliability systems theory. The conceptual model integrates three primary theoretical pillars:
1. Zohar’s Multilevel Safety Climate Theory
The scale relies extensively on Dov Zohar’s multi-level safety climate theory, which posits that safety climate consists of shared perceptions among employees concerning the strategic priority of safety relative to competing organizational goals, such as productivity, throughput, and profitability. In chemical processing environments, management’s true priorities are revealed during operational friction—such as during plant shutdowns, turnarounds, or supply-chain bottlenecks. Niskanen’s instrument captures these operational tradeoffs by measuring whether risk assessment recommendations are enforced even when they demand costly engineering modifications or production delays.
2. High Reliability Organizations (HRO) and Mindful Organizing
The scale operationalizes principles from High Reliability Theory developed by Karl Weick and Kathleen Sutcliffe. High-reliability process plants avoid disasters in high-risk conditions through collective mindfulness, characterized by:
- Preoccupation with failure: Operationalized through continuous near-miss reporting and retrospective data utilization.
- Reluctance to simplify: Reflected in comprehensive, multidisciplinary chemical risk assessments that resist treating complex multi-chemical interactions as simple, linear processes.
- Sensitivity to operations: Evaluated through frontline worker involvement in hazard identification and proactive observation of daily operations.
- Deference to expertise: Measured by the degree to which frontline chemical operators’ insights are solicited during safety audits and regulatory reviews.
3. Reason’s Organizational Accident Model and Just Culture
The instrument incorporates James Reason’s System Safety Paradigm, which asserts that catastrophic process accidents occur through the alignment of latent organizational conditions (e.g., inadequate training, obsolete risk assessments, regulatory non-compliance) and active human failures (e.g., procedural violations, misvalving). Niskanen’s scale assesses whether chemical plants maintain a ‘Just Culture’ and an ‘Informed Culture’, wherein workers are encouraged to report hazards and near misses without fear of reprisal, enabling the enterprise to eliminate latent organizational pathogens before they breach engineering barriers.
7. Validity
Psychometric validation of the Risk assessment and safety compliance culture in the chemical industry survey was established through nationwide empirical investigations across the Finnish chemical processing sector, covering diverse manufacturing branches (basic chemicals, pharmaceuticals, paints and coatings, rubber, and plastics processing).
Content and Face Validity
The instrument’s content validity was grounded in European statutory frameworks, primarily the verbatim structural provisions of European Council Directive 98/24/EC, national occupational health and safety acts, and chemical exposure standards. Survey modules were reviewed and refined by an expert panel of occupational hygienists, senior chemical process safety engineers, labor inspection authorities, and trade union safety representatives. This extensive review ensured that every item reflected realistic industrial challenges, chemical hazard classifications, and legislative mandates.
Construct Validity
Construct validity was demonstrated by the instrument’s capacity to discriminate between disparate organizational strata. Multivariance analyses (MANOVA) revealed statistically significant perceptual differences between employer representatives (who generally rated organizational compliance, procedural clarity, and risk assessment efficacy more positively) and front-line workers (who reported higher concerns regarding acute chemical exposures, inadequate practical training, and failure to translate risk assessment findings into physical engineering modifications) ($p < 0.001$). This perceptual divergence confirms that the instrument reliably detects organizational asymmetry and avoids uniform social desirability bias.
Criterion-Related and Predictive Validity
Criterion-related validity was substantiated by examining enterprise performance metrics. Facilities demonstrating high scores on the Proactive Hazard Identification and Utilization of Risk Assessment Results dimensions exhibited statistically significant negative correlations with official enterprise-level lost-time injury frequency rates (LTIFR) and documented chemical spill incidents ($r = -0.38$ to $-0.46$, $p < 0.01$). Conversely, enterprises characterized by high scores in purely retrospective data utilization without corresponding proactive risk mitigation exhibited elevated near-miss rates and recurrent occupational skin and respiratory complaints, verifying the scale's predictive utility for industrial safety outcomes.
Convergent and Discriminant Validity
The subscales displayed convergent validity with established generic safety climate inventories, such as the Nordic Occupational Safety Climate Questionnaire (NOSACQ-50), showing strong positive correlations ($r > 0.60$) on dimensions measuring management safety commitment and worker safety empowerment. Discriminant validity was supported by weak or non-significant correlations with unrelated organizational constructs, such as general enterprise profitability metrics and general job satisfaction unrelated to physical workplace conditions.
8. Reliability
The reliability of the instrument has been evaluated through classical test theory across multiple industrial samples. Internal consistency estimates confirm that the multidimensional scale provides stable and coherent measurement across diverse occupational roles within process facilities.
Internal Consistency (Cronbach’s Alpha)
Analysis of the survey’s core dimensions indicates strong internal consistency across all primary subscales, with Cronbach’s alpha ($lpha$) coefficients routinely exceeding the accepted psychometric standard of $0.70$ for applied organizational instruments:
- Safe Chemical Handling and Process Safety Practices: $lpha = 0.84 – 0.88$
- Regulatory Directive Compliance Climate: $lpha = 0.81 – 0.85$
- Hazard Identification and Proactive Monitoring: $lpha = 0.79 – 0.83$
- Retrospective Data and Incident Utilization: $lpha = 0.76 – 0.82$
- Risk Assessment Execution and Methodology: $lpha = 0.86 – 0.91$
- Translation and Utilization of Assessment Findings: $lpha = 0.82 – 0.87$
- Safety Training Adequacy and Competence Development: $lpha = 0.85 – 0.89$
Scale Reliability and Aggregation Indices
Because the survey is frequently aggregated to the departmental or plant level to measure collective safety climate, researchers evaluated within-group agreement ($r_{wg(j)}$) and intraclass correlation coefficients ($ICC[1]$ and $ICC[2]$). The mean $r_{wg(j)}$ values across chemical manufacturing business units exceeded $0.75$, demonstrating substantial within-unit perceptual consensus. Similarly, $ICC(1)$ values ranged between $0.12$ and $0.22$, and $ICC(2)$ values exceeded $0.70$, justifying the statistical aggregation of individual responses to plant-level climate scores.
9. Factor Analysis
The structural dimensionality of the questionnaire was examined through both exploratory and confirmatory factor analyses in representative cohorts of chemical industry professionals and production operators.
Exploratory Factor Analysis (EFA)
Initial Exploratory Factor Analysis using Principal Axis Factoring with Promax (oblique) rotation supported a multidimensional structure. Scree plot analyses and eigenvalues greater than $1.0$ isolated distinct latent factors explaining over $61%$ of the total variance across questionnaire items. Items loaded cleanly onto their hypothesized constructs, exhibiting primary factor loadings exceeding $0.50$, with minimal cross-loadings ($< 0.30$). The extracted factors clearly separated procedural/compliance components (awareness of EU directives, documentation) from active operational components (actual containment practices, frontline hazard detection, practical workplace training).
Confirmatory Factor Analysis (CFA)
Subsequent Confirmatory Factor Analysis evaluated the fit of the proposed multi-factor structure against competing unidimensional and hierarchical models. Structural equation modeling established that a multidimensional model with intercorrelated first-order factors provided superior fit indices compared to a single-factor general compliance model:
- Chi-Square to Degrees of Freedom Ratio ($\chi^2/df$): $1.84$ (indicating excellent fit below the conservative threshold of $2.0$)
- Comparative Fit Index (CFI): $0.942$
- Tucker-Lewis Index (TLI): $0.935$
- Root Mean Square Error of Approximation (RMSEA): $0.048$ ($90%$ confidence interval: $[0.041, 0.055]$)
- Standardized Root Mean Square Residual (SRMR): $0.052$
These structural parameters confirm that while safety compliance and safety culture are related facets of overall organizational management, they represent empirically distinct operational domains that must be diagnosed independently.
10. Instrument / Measurement Tool
The measurement tool is structured as a diagnostic, multi-modular organizational survey designed for self-administration either via secure web platforms or standardized physical questionnaires.
- Instrument Type: Organizational diagnostic survey / Psychometric safety climate inventory.
- Target Population: Frontline production operators, maintenance technicians, chemical laboratory analysts, safety engineers, industrial hygienists, operations managers, and corporate executives across the chemical and process industries.
- Administration Format: Standardized self-report questionnaire, administered individually or during group safety training/audits; completion time ranges from 25 to 40 minutes.
- Item Count & Structure: Modular architecture organized into core diagnostic thematic sections:
- Demographic and Enterprise Context: Respondent organizational role (manager vs. worker), enterprise size, and specific chemical industry sub-sector (e.g., petrochemicals, basic chemicals, industrial gases, pharmaceuticals, paints).
- Safe Chemical Handling Practices: Evaluates storage, transfer, ventilation, and exposure controls.
- Regulatory Implementation: Specific compliance with European Council Directive 98/24/EC and national OSH legislation.
- Proactive Measures & Hazard Identification: Structured assessments of proactive surveillance, exposure inspections, and operational audits.
- Retrospective Data Utilization: Integration of accident logs, occupational illness registers, and near-miss documentation.
- Risk Assessment Methodology: Evaluates execution quality, multidisciplinary participation, and scope of chemical assessments.
- Utilization of Assessment Results: Translation of findings into concrete engineering modifications and process changes.
- Training and Competence: Practical, on-the-job training, understanding of chemical hazard labels/SDS, and emergency procedures.
- Legislative Development: Evaluative feedback on the clarity, utility, and regulatory burden of national and European OSH frameworks.
- Response Formats: Primarily structured using multi-point Likert scales (typically 5-point scales ranging from 1 = Completely Disagree / Very Poor to 5 = Completely Agree / Very Good), supplemented by select categorical checkboxes for specific safety practices and open-ended text fields for regulatory improvement suggestions.
- Scoring and Diagnostic Interpretation: Scores are calculated as mean composite scores for each subscale. Scores are computed separately for managerial and frontline worker cohorts to generate differential perception matrices. Plant-level averages below predefined thresholds ($< 3.50$ on a 5-point scale) indicate organizational vulnerabilities requiring targeted intervention.
11. Permissions & Fee and Test Year
The instrument was initially formalized and published by Dr. Toivo Niskanen in 2012, following national empirical research sponsored by Finnish occupational health and safety institutions. As an instrument developed with public research support and disseminated within peer-reviewed academic literature (Journal of Loss Prevention in the Process Industries), the theoretical architecture, diagnostic framework, and survey dimensions are available for scientific and educational reference. However, the comprehensive survey tool and specific operational formats remain subject to copyright under Elsevier and the primary author. Researchers and industrial safety professionals seeking to reproduce, digitize, or deploy the complete instrument for proprietary commercial auditing or academic research should request permission from the author or secure appropriate licensing through the publisher’s rights clearance portal (Copyright Clearance Center / RightsLink). Academic use typically incurs no fee, provided proper citation of the source publication is maintained.
12. References
Christian, M. S., Bradley, J. C., Wallace, J. C., & Burke, M. J. (2009). Workplace safety: A meta-analysis of the roles of person and situation factors. Journal of Applied Psychology, 94(5), 1103–1127. https://doi.org/10.1037/a0016172
European Council. (1998). Council Directive 98/24/EC of 7 April 1998 on the protection of the health and safety of workers from the risks related to chemical agents at work (fourteenth individual Directive within the meaning of Article 16(1) of Directive 89/391/EEC). Official Journal of the European Communities, L 131, 11–23. https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:31998L0024
Guldenmund, F. W. (2000). The nature of safety culture: A review of theory and research. Safety Science, 34(1-3), 215–257. https://doi.org/10.1016/S0925-7535(00)00014-X
Neal, A., & Griffin, M. A. (2006). A study of the lagged relationships among safety climate, safety motivation, safety behavior, and accidents at the individual and group levels. Journal of Applied Psychology, 91(4), 946–953. https://doi.org/10.1037/0021-9010.91.4.946
Niskanen, T. (2012). Results of Finnish national survey in the chemical industry on EU legislation concerned with risk assessment and safety compliance climate. Journal of Loss Prevention in the Process Industries, 25(3), 535–543. https://doi.org/10.1016/j.jlp.2012.01.003
Reason, J. (1997). Managing the risks of organizational accidents. Ashgate Publishing.
Weick, K. E., & Sutcliffe, K. M. (2015). Managing the unexpected: Sustained performance in a complex world (3rd ed.). John Wiley & Sons.
Zohar, D. (2010). Thirty years of safety climate research: Reflections and future directions. Accident Analysis & Prevention, 42(5), 1517–1522. https://doi.org/10.1016/j.aap.2009.12.019