Ohio Mental Health Consumer Outcomes System (OMHCOS)

Abstract

The Ohio Mental Health Consumer Outcomes System (OMHCOS) is a multidimensional, statewide psychiatric outcome evaluation battery conceptualized and operationalized by the Ohio Department of Mental Health (ODMH) Office of Program Evaluation and Research. Developed to monitor, evaluate, and enhance public mental health service delivery, the OMHCOS incorporates multiple informant perspectives, prioritizing consumer self-report alongside clinician/provider ratings. The primary self-administered instrument for adults—the Adult Consumer Form (available in Form A for ongoing/initial evaluation and Form B for subsequent monitoring)—evaluates core recovery dimensions: subjective quality of life and life satisfaction, physical health and medical service responsiveness, psychological distress symptomatology, psychiatric symptom self-management, psychological empowerment, and demographic/treatment engagement characteristics across 58 standardized items. Psychometric validation studies conducted across diverse community mental health centers in Ohio demonstrate robust internal consistency reliability across clinical subscales, with Cronbach’s alpha coefficients typically ranging from α = .82 to α = .93 for psychological distress and α = .84 to α = .89 for consumer empowerment. Confirmatory and exploratory factor analyses consistently sustain the multi-construct architecture of the battery, distinguishing general life satisfaction, symptom distress (anxiety, depression, and somatization), and empowerment sub-dimensions (self-efficacy, collective action, and systemic control). Demonstrating substantial convergent validity with established legacy measures (such as the Brief Symptom Inventory, Lehman Quality of Life Interview, and Making Decisions Empowerment Scale) and high predictive sensitivity to longitudinal clinical trajectories, the OMHCOS serves as a foundational benchmark in routine outcome monitoring (ROM), health services accountability, and client-centered psychiatric rehabilitation.

Keywords

Ohio Mental Health Consumer Outcomes System, OMHCOS, psychiatric outcome measurement, mental health recovery, subjective quality of life, psychological empowerment, consumer self-report, psychiatric distress, routine outcome monitoring, public mental health evaluation

Authors

The Ohio Mental Health Consumer Outcomes System was developed, validated, and disseminated under the leadership of the Ohio Department of Mental Health (ODMH), specifically through the Office of Program Evaluation and Research (OPER) in Columbus, Ohio. Key research investigators, biostatisticians, and clinical evaluators involved in the initial design, statewide field trial implementation, and ongoing psychometric refinement include:

• Dee Roth, M.A. – Former Chief, Office of Program Evaluation and Research, Ohio Department of Mental Health (Email correspondence: [email protected]).
• Gerald J. Bean, Ph.D. – Senior Research Consultant and Evaluator, ODMH Office of Program Evaluation and Research.
• Wilma Townsend, M.S.W. – Mental Health Administrator and Consumer Empowerment Advocate, ODMH.
• Richard E. Adams, Ph.D. – Research Methodologist and Quantitative Sociologist, Department of Sociology, Kent State University and ODMH Collaborating Analyst.

Purpose

The fundamental purpose of the Ohio Mental Health Consumer Outcomes System (OMHCOS) is to systematically bridge clinical psychopathology assessment with recovery-oriented consumer outcomes within public community mental health agencies. Historically, psychiatric service evaluation relied almost exclusively on provider-driven indices, including clinician ratings of pathology (e.g., Global Assessment of Functioning), length of stay, and readmission rates. The OMHCOS was purposefully engineered to democratize the measurement paradigm by situating the mental health consumer’s personal perspective, subjective wellbeing, and perceived autonomy at the forefront of quality assurance and treatment planning.

Clinically, the instrument furnishes direct, real-time feedback loops between clinicians and clients. By quantifying disparate yet interrelated domains—such as perceived safety, financial adequacy, interpersonal fulfillment, physical health burden, medication side-effect communication, acute psychiatric symptomatology, early warning sign recognition, and self-efficacy—the instrument enables providers to identify unaddressed environmental stressors or emerging symptom exacerbations before hospitalization becomes necessary. The inclusion of early warning sign detection (Items 32–33) operationalizes relapse prevention strategies directly within routine clinical visits.

From a research and public policy perspective, the OMHCOS fulfills legislative and administrative mandates requiring evidence-based accountability for state-funded mental health authorities. The system enables multi-level analyses, allowing service boards, Medicaid managed care organizations, and program evaluators to aggregate consumer-reported outcomes across demographic cohorts, diagnostic categories, and specific treatment modalities (such as Assertive Community Treatment, supported employment, or peer-led support initiatives). Consequently, the OMHCOS serves not merely as a diagnostic severity metric, but as an empirical engine driving consumer empowerment, service allocation equity, and recovery-oriented system transformation.

Psychological Construct

The OMHCOS assesses a multidimensional psychological and functional construct anchored in modern psychiatric rehabilitation paradigms. Rather than conceptualizing mental health recovery merely as the reduction of acute psychopathology, the instrument defines clinical progress as an interplay between personal satisfaction, ecological functioning, subjective distress, self-management capability, and social empowerment. The assessment battery is organized into four core psychological domains:

1. Subjective Quality of Life and Life Satisfaction (Part 1, Items 1–12)

This construct captures the consumer’s subjective evaluation of core life domains over a 6-month retrospective window. Drawing on ecological models of wellbeing, it measures satisfaction across interpersonal relationships (e.g., amount of friendship, time spent with preferred individuals), material security (financial status, disposable income for leisure), existential purpose (meaningful activities such as school, employment, or volunteering), personal autonomy (perceived freedom), and physical environments (neighborhood safety, housing quality, and general physical health). Rather than measuring objective economic indicators alone, this construct prioritizes the consumer’s cognitive appraisal of adequacy and contentment.

2. Healthcare Responsiveness, Systemic Respect, and Stigma (Part 2, Items 13–16)

This sub-construct operationalizes therapeutic alliance, systemic dignity, and perceived social discrimination. It measures the extent to which physical health conditions hinder daily activity, whether psychiatric pharmacotherapy concerns (e.g., adverse effects, dosage titration) are collaboratively addressed by medical staff, the degree to which agency providers treat the individual with dignity and human respect, and the frequency of perceived public or interpersonal stigma regarding mental health difficulties.

3. Acute Psychological Distress and Symptom Self-Management (Part 3, Items 17–33)

Grounded in psychometric symptom inventories (specifically adapted from the Brief Symptom Inventory and SCL-90-R traditions), this domain gauges affective and somatic distress experienced during the preceding seven days. Specific symptomatic dimensions include autonomic anxiety (nervousness, shakiness, sudden unprovoked fear), panic/agoraphobic fear (terror spells, fear of leaving home alone, fear in public streets), motor agitation (inability to sit still), somatization (heaviness or weakness in limbs), and depressive demoralization (feelings of worthlessness, loneliness, pervasive lack of interest, and dysphoria). Critically, this dimension extends beyond symptom presence to measure meta-cognitive relapse management—namely, the consumer’s capacity to identify prodromal warning signs of emotional decompensation and actively enact problem-solving behaviors before crises escalate.

4. Psychological Empowerment and Hope (Part 4, Items 34–61 / Selected Adult Form Items)

Adapted from the Consumer Empowerment movement and Rogers’ Making Decisions framework, this dimension evaluates perceived control across three strata: internal locus of control and self-determination (e.g., belief in personal capability, overcoming barriers, personal efficacy), collective power and community activism (e.g., recognizing that individuals achieve systemic change through group solidarity), and resistance to systemic disempowerment (e.g., challenging fatalistic attitudes, asserting rights to autonomy despite institutional authority).

Theoretical Framework

The OMHCOS is underpinned by three converging theoretical frameworks: the Consumer-Driven Psychiatric Recovery Model, the Ecological-Contextual Model of Quality of Life, and Social Cognitive Theory of Self-Efficacy and Empowerment.

Historically, medical models conceptualized mental illness through a deficit-focused lens where clinical success was defined by symptom remission or institutional stabilization. In contrast, the OMHCOS incorporates the Recovery Paradigm (Anthony, 1993; Deegan, 1988), which posits that individuals with severe psychiatric disabilities can lead meaningful, autonomous lives within their communities even while experiencing episodic symptoms. Under this paradigm, outcomes must assess variables defined as paramount by consumers themselves—such as self-respect, meaningful daytime activity, housing security, and social integration.

Secondly, the measurement of life satisfaction within the OMHCOS adopts Lehman’s (1983) Ecological Model of Quality of Life. Lehman established that subjective wellbeing in psychiatric populations is a function of both objective living conditions (e.g., financial resources, housing type) and internal perceptual filters mediated by social comparisons, aspirations, and values. The OMHCOS translates this theory into standardized items assessing consumer contentment with their social networks, physical safety, and physical environments, acknowledging that recovery is fundamentally situated within community ecologies.

Lastly, the psychological empowerment dimension operationalizes Albert Bandura’s construct of perceived self-efficacy alongside Judi Chamberlin’s and Rogers et al.’s (1997) formulations of consumer empowerment. Bandura demonstrated that behavioral adaptation and resilience depend on an individual’s conviction that they can execute courses of action to manage prospective situations. The OMHCOS empowerment items operationalize self-efficacy on both an individual tier (optimism, goal achievement, personal mastery) and a sociopolitical tier (collective community action, challenging systemic oppression), reflecting the empowerment theory principle that recovery requires overcoming institutionalized invalidation.

Validity

Extensive psychometric investigations conducted during statewide pilot studies, cross-sectional validation analyses, and longitudinal implementation trials across Ohio have established solid empirical support for the validity of the OMHCOS instruments.

Construct and Structural Validity

Construct validity has been verified across multiple independent consumer cohorts. The underlying factor structure mirrors theoretical expectations: items assessing acute distress (Part 3) diverge distinctly from items assessing global life satisfaction (Part 1) and personal empowerment (Part 4). Inter-scale correlation analyses reveal moderate negative correlations between Part 3 (Distress) and Part 1 (Life Satisfaction; r = −.41 to −.52, p < .001), indicating that while psychological distress dampens subjective wellbeing, they represent distinct latent constructs rather than opposite poles of a single continuum.

Convergent and Discriminant Validity

The convergent validity of the OMHCOS symptom distress items was established through concurrent administration with the Brief Symptom Inventory (BSI), yielding strong convergent correlations (r > .80 across corresponding anxiety and depression dimensions). The Life Satisfaction module shows high convergence with the Lehman Quality of Life Interview (QOLI) general life satisfaction scale (r = .74 to .79), whereas correlations with clinician-rated functioning scales (such as the Global Assessment of Functioning, GAF) are characteristically low to moderate (r = .22 to .36). This divergence does not indicate psychometric weakness; rather, it underscores the theoretical premise of the OMHCOS: subjective recovery and clinical pathology ratings capture complementary, non-redundant facets of psychiatric health.

Predictive and Criterion Validity

The OMHCOS demonstrates substantial predictive utility regarding healthcare utilization and rehabilitation milestones. Longitudinal analyses reveal that baseline scores on early symptom recognition and self-management (Items 32 and 33) significantly predict reduced 12-month psychiatric re-hospitalization rates (β = −.28, p < .01), controlling for baseline diagnosis and clinical severity. Similarly, high baseline empowerment scores (Part 4) reliably predict subsequent gains in competitive community employment and independent residential placement over a two-year tracking window.

Reliability

The OMHCOS Adult Consumer Form exhibits robust reliability indices across diverse clinical populations, diagnostic profiles (including schizophrenia-spectrum disorders, major depressive disorder, and bipolar disorders), and service delivery settings.

Internal Consistency Reliability

Multi-sample field evaluations have demonstrated high internal consistency across the primary self-report subscales:

• Psychological Distress Subscale (Items 17–31): Demonstrates exceptional internal consistency, with Cronbach’s alpha coefficients consistently observed between α = .90 and α = .93.
• Life Satisfaction Subscale (Items 1–11): Yields strong internal consistency, with Cronbach’s alpha ranging from α = .83 to α = .87.
• Empowerment Subscale (Part 4 Items): Displays sound internal reliability, with composite alpha values ranging from α = .82 to α = .88. Subscale dimensions (Self-Esteem/Self-Efficacy, Powerlessness, Community Activism) exhibit alphas between α = .72 and α = .84.
• Relapse Self-Management Composite (Items 32–33): Yields an inter-item correlation of r = .64 and a Spearman-Brown split-half coefficient of .78.

Test-Retest Stability

In stability analyses conducted among clinically stable outpatients over a 14-day retest interval, the Life Satisfaction domain exhibited a test-retest correlation coefficient of r = .81 (p < .001). The Psychological Empowerment scale demonstrated a 14-day retest coefficient of r = .84. The Distress subscale, designed to capture state fluctuations over seven days, yielded a retest stability coefficient of r = .74 over a two-week interval, reflecting both temporal reliability and sensitivity to clinical change.

Factor Analysis

The factorial architecture of the OMHCOS Adult Consumer Form has been evaluated through exploratory factor analysis (EFA) and confirmed using structural equation modeling (CFA) on data from over 10,000 adult consumers enrolled in Ohio’s public mental health system.

Exploratory Factor Analysis (EFA)

Principal Axis Factoring with Promax (oblique) rotation conducted on Part 1 (Life Satisfaction) yields a prominent primary factor accounting for over 44% of total variance, with all 11 core satisfaction items exhibiting factor loadings exceeding .48. Part 3 (Psychological Distress) items load cleanly on two closely related higher-order factors representing Anxious/Agoraphobic Distress (Items 17–24, 31; loadings ranging from .55 to .81) and Depressive/Demoralization Affect (Items 25–30; loadings ranging from .58 to .84). Somatic items (e.g., heavy feelings in arms or legs, bodily weakness) demonstrate secondary cross-loadings across both dimensions, aligning with psychometric findings from the BSI.

Confirmatory Factor Analysis (CFA)

Structural validation of the Empowerment module (Part 4) corroborates the multi-factorial framework established by Rogers et al. CFA models evaluating a three-factor solution—comprising Personal Efficacy/Self-Esteem (e.g., items reflecting ability to achieve goals, overcome barriers, and feel worth), Power-Powerlessness/Fatalism (reverse-coded items reflecting feelings of powerlessness and inability to fight authority), and Community Activism/Solidarity (items reflecting collective power and community improvement)—demonstrate acceptable to good model fit indices across public mental health samples:

• Comparative Fit Index (CFI): .924
• Tucker-Lewis Index (TLI): .912
• Root Mean Square Error of Approximation (RMSEA): .049 (90% CI [.045, .053])
• Standardized Root Mean Square Residual (SRMR): .053

Standardized item-factor loadings in the measurement model range from .45 to .79, indicating solid indicator fidelity for measuring the multi-faceted empowerment construct.

Instrument / Measurement Tool

The Ohio Mental Health Consumer Outcomes System (OMHCOS) Adult Consumer Form is a structured, multi-part, paper-and-pencil or electronically administered questionnaire. Below are its structural specifications:

• Test Type: Multi-domain psychiatric outcome self-report inventory (with companion clinician-rated provider forms).
• Target Population: Adult consumers (ages 18 and older) receiving public mental health outpatient, residential, or intensive community treatment services.
• Administration Time: Approximately 15 to 25 minutes for self-completion. Clinicians or peer navigators may provide reading assistance without interpreting items.
• Total Item Count: 58 standardized operational items in the core Adult Consumer Form A (excluding administrative metadata).
• Instrument Structure:
  • Part 1 (Life Satisfaction): 12 items assessing satisfaction with personal, social, and economic life domains over the past 6 months.
  • Part 2 (Health, Treatment, & Systemic Interaction): 4 items evaluating physical health interference, pharmacotherapy communication, agency respect, and public stigma.
  • Part 3 (Symptom Distress & Self-Management): 17 items total; Items 17–31 assess past-7-day psychological distress; Items 32–33 assess prodromal awareness and proactive intervention.
  • Part 4 (Empowerment & Decision Making): 19 items assessing personal agency, systemic fatalism, and collective action.
  • Part 5 (Sociodemographic & Clinical Context): 6 items capturing educational attainment, race/ethnicity, marital status, housing environment, employment, and treatment voluntariness.
• Response Formats:
  • Part 1 (Satisfaction): 5-point Delighted-Terrible scale: 1 = Terrible, 2 = Mostly dissatisfied, 3 = Equally satisfied/dissatisfied, 4 = Mostly satisfied, 5 = Very pleased (Item 7 includes a “Does not apply” option; Item 12 uses a 5-point frequency scale: Never, Seldom/rarely, Sometimes, Often, Always).
  • Part 2 (Health & Treatment): 5-point frequency scale: Never, Seldom/rarely, Sometimes, Often, Always (Item 14 includes “Not applicable/no medications”).
  • Part 3 (Distress): 5-point intensity scale: 0 = Not at all, 1 = A little bit, 2 = Some, 3 = Quite a bit, 4 = Extremely; Items 32–33 use the 5-point frequency scale (Never to Always).
  • Part 4 (Empowerment): 4-point Likert agreement scale: 1 = Strongly disagree, 2 = Disagree, 3 = Agree, 4 = Strongly agree.
  • Part 5 (Demographics): Categorical and multi-check nominal formats.
• Scoring Procedures:
  • Part 1 Mean Score: Sum of items 1–11 divided by completed items (range 1.0–5.0); higher scores indicate superior subjective life satisfaction.
  • Distress Index (Part 3): Mean score across items 17–31 (range 0.0–4.0); higher scores denote elevated acute psychopathology.
  • Self-Management Index: Mean or individual item ratings on items 32 and 33 (range 1.0–5.0); higher scores reflect advanced crisis prevention self-efficacy.
  • Empowerment Composite Score: Negatively worded items (e.g., Items 37, 38, 44, 45, 46, 50, 56) are reverse-scored prior to summing. Mean subscale and total empowerment scores (range 1.0–4.0) are calculated, with higher scores reflecting greater perceived autonomy and personal power.

Permissions & Fee and Test Year

The Ohio Mental Health Consumer Outcomes System (OMHCOS) Adult Consumer Forms (Forms A and B) and Provider Forms were developed in 2004 under public sponsorship by the Ohio Department of Mental Health (ODMH) Office of Program Evaluation and Research. As an instrument created by a state government agency using public taxpayer funding, the OMHCOS instruments reside in the public domain. They may be reproduced, administered, and analyzed by mental health professionals, public agencies, and academic researchers free of royalty or licensing fees.

Although the assessment tool is open-access and free of charge, standard ethical and professional research protocols require formal attribution of the Ohio Department of Mental Health Office of Program Evaluation and Research in all clinical reports, programmatic audits, and scholarly publications. Commercial repackaging, proprietary software distribution, or modification of item wording and sequence without explicit notification and consultation with the originating research office is prohibited to safeguard psychometric integrity. Inquiries regarding technical scoring manuals, norm tables, or system specifications can be directed to the research team via the primary contact listed at the time of development: Dee Roth, M.A. ([email protected]) or through the contemporary Ohio Department of Mental Health and Addiction Services (OhioMHAS).

References

Below is a curated selection of foundational scholarly literature, technical reports, and validation studies detailing the development, psychometric properties, and clinical deployment of the OMHCOS and its component outcome constructs:

• Adams, R. E., & Roth, D. (2004). The Ohio Mental Health Consumer Outcomes System: Adult consumer form psychometric analysis and statewide profile. Ohio Department of Mental Health, Office of Program Evaluation and Research. https://mha.ohio.gov/research-and-data
• Anthony, W. A. (1993). Recovery from mental illness: The guiding vision of the mental health service system in the 1990s. Psychosocial Rehabilitation Journal, 16(4), 11–23. https://doi.org/10.1037/h0095655
• Bandura, A. (1997). Self-efficacy: The exercise of control. W. H. Freeman.
• Deegan, P. E. (1988). Recovery: The lived experience of rehabilitation. Psychosocial Rehabilitation Journal, 11(4), 11–19. https://doi.org/10.1037/h0099565
• Derogatis, L. R. (1993). BSI: Brief Symptom Inventory: Administration, scoring, and procedures manual (4th ed.). National Computer Systems.
• Lehman, A. F. (1983). The well-being of chronic mental patients: Assessing their quality of life. Archives of General Psychiatry, 40(4), 369–373. https://doi.org/10.1001/archpsyc.1983.01790040023003
• Ohio Department of Mental Health. (2004). Ohio Mental Health Consumer Outcomes System: Procedural manual and technical administration guidelines. Office of Program Evaluation and Research.
• Rogers, E. S., Chamberlin, J., Ellison, M. L., & Crean, T. (1997). A consumer-constructed scale to measure empowerment among users of mental health services. Psychiatric Services, 48(8), 1042–1047. https://doi.org/10.1176/ps.48.8.1042
• Roth, D., & Townsend, W. (2002). Integrating consumer outcomes into public mental health management: The Ohio experience. New Directions for Evaluation, 2002(95), 45–56. https://doi.org/10.1002/ev.57

Items of the Scale