Distress Thermometer and Problem List

Abstract

The Distress Thermometer (DT) and accompanying Problem List (PL) represent one of the most widely implemented, psychometrically validated screening protocols in contemporary psycho-oncology. Originally established by the National Comprehensive Cancer Network (NCCN) Distress Management Panel, this ultra-brief instrument was developed to identify, quantify, and categorize multifactorial distress in oncology patients across routine clinical settings. The tool comprises a single-item, 11-point visual analog scale (ranging from 0 = “No distress” to 10 = “Extreme distress”) styled analogously to an upright mercury thermometer, alongside an accompanying standardized 39-item checklist known as the Problem List. The Problem List evaluates the underlying sources of reported distress across five critical biopsychosocial domains: Practical problems, Family problems, Emotional problems, Spiritual/religious concerns, and Physical problems, utilizing a dichotomous (Yes/No) endorsement structure. In the Dutch adaptation and validation—frequently operationalized as the Lastmeter—extensive psychometric investigations have affirmed the utility of an optimal clinical cut-off score of ≥5 (in contrast to the international baseline cut-off of ≥4), which demonstrates superior diagnostic sensitivity (ranging from 0.82 to 0.89) and specificity (ranging from 0.74 to 0.84) against validated gold-standard criteria such as the Hospital Anxiety and Depression Scale (HADS) and the Brief Symptom Inventory (BSI-18). Receiver operating characteristic (ROC) curves consistently establish areas under the curve (AUC) between 0.80 and 0.90 across heterogeneous oncology cohorts. By serving as an efficient “sixth vital sign” triage mechanism, the DT and PL bridge the gap between biomedical disease monitoring and holistic psychosocial intervention, facilitating targeted stepped-care referrals, optimizing interdisciplinary communication, and mitigating the long-documented underrecognition of psychological morbidity in chronic and life-threatening medical conditions.

Keywords

Distress Thermometer, Problem List, Lastmeter, psycho-oncology, cancer-related distress, screening, psychometric validation, HADS, ROC analysis, biopsychosocial assessment

Authors

The Distress Thermometer was originally designed under the leadership of Dr. Allison J. Roth and Dr. Jimmie C. Holland (1928–2017), internationally recognized as the founding pioneer of modern psycho-oncology, at the Department of Psychiatry and Behavioral Sciences, Memorial Sloan Kettering Cancer Center (MSKCC), New York, NY, USA, in conjunction with the National Comprehensive Cancer Network (NCCN) Distress Management Clinical Practice Guidelines Panel.

The primary clinical translation and Dutch healthcare adaptation (termed the Lastmeter) was initiated by M. Bannink and colleagues in 2004 within the Department of Medical Oncology and Palliative Care at the Erasmus MC Cancer Institute, Rotterdam, The Netherlands.

Comprehensive empirical validation and psychometric standardization of the Dutch version were conducted by Dr. Marrit A. Tuinman, Dr. Johan F. Gazendam, and Dr. Harald J. Hoekstra (2008) at the Department of Health Sciences and Surgical Oncology, University Medical Center Groningen (UMCG), University of Groningen, The Netherlands, establishing established normative baselines and receiver operating characteristic benchmarks for Dutch clinical oncology practice.

Purpose

The overarching clinical and scientific purpose of the Distress Thermometer (DT) and Problem List (PL) is to operationalize rapid, barrier-free identification of clinically significant psychological, social, and functional morbidity in patients undergoing cancer diagnosis, treatment, and survivorship. Historically, up to 40% to 50% of individuals diagnosed with cancer exhibit clinically elevated levels of emotional, depressive, or anxiety-related symptomatology. However, within conventional oncological workflows, less than 10% of these patients were routinely identified and referred to psychosocial professionals (such as clinical psychologists, psychiatrists, medical social workers, and palliative chaplains). The primary barrier was the absence of a standardized, non-stigmatizing, and time-efficient assessment framework that could be administered quickly without burdening overburdened clinical teams.

Methodologically, the DT functions as a visual, single-item screening instrument analogous to the standard 0–10 numeric rating scale used worldwide for physical pain assessment. By establishing emotional distress as the “sixth vital sign” (alongside temperature, respiration, pulse, blood pressure, and pain), the instrument de-pathologizes psychological reactions to illness. The term distress was deliberately chosen by Holland and the NCCN panel over terms such as psychopathology, psychiatric disorder, or depression because it carries minimal social stigma, encapsulates normal adjustment reactions while recognizing abnormal distress states, and is intuitively accepted by patients and medical staff alike.

Concurrently, the Problem List transforms a solitary scalar rating into an actionable clinical diagnostic map. A high score on the thermometer indicates severity but does not indicate etiology; a score of 7 could signify severe clinical depression, excruciating physical bone pain, catastrophic financial insolvency, or existential terror regarding end-of-life care. The PL delineates these underlying sources across practical, familial, emotional, spiritual, and physical axes. In empirical research and clinical stepped-care pathways, the DT/PL protocol serves as a triage mechanism: patients scoring below the validated threshold receive routine supportive care, whereas patients scoring at or above the cut-off undergo an automated review of their Problem List endorsements, directing targeted, individualized referrals to specialized supportive disciplines.

Psychological Construct

The construct assessed by the DT and PL is formally defined by the NCCN as distress: “a multifactorial unpleasant emotional experience of a psychological (cognitive, behavioral, emotional), social, and/or spiritual nature that may interfere with the ability to cope effectively with cancer, its physical symptoms, and its treatment.” Rather than presuming an underlying categorical psychiatric disorder (such as major depressive disorder or generalized anxiety disorder), distress is conceptualized as an overarching continuum extending from common, expectable feelings of vulnerability, sadness, and fear, to disabling conditions such as clinical depression, panic, existential despair, and severe relational disruption.

Core Dimensions and Subscales

The instrument operationalizes this multidimensional construct across two distinct operational layers: an overarching dimensional intensity rating (the Distress Thermometer) and five qualitative etiologic domains (the Problem List).

• Global Emotional Distress (Distress Thermometer): A continuous visual-analog evaluation reflecting the subjective total load of psychological strain, negative affect, and adaptive disruption experienced over the preceding seven-day interval, anchored from 0 (“No distress”) to 10 (“Extreme distress”).
• Practical Problems Domain: Encompasses structural, logistical, and socio-economic impediments that drain cognitive and behavioral coping resources. Items assess tangible life complications induced or exacerbated by illness, including childcare logistics, housing instability, insurance/financial toxicities, medical transportation barriers, academic or workplace interruptions, and cognitive paralysis surrounding complex medical treatment decisions.
• Family and Social Problems Domain: Targets interpersonal, systemic, and relational stressors. This includes parent-child relational strain, partner/marital conflict, fears regarding infertility or lost reproductive capacity following cytotoxic therapies, and broader family health or caregiver burdens.
• Emotional Problems Domain: Evaluates classical affective and cognitive symptoms of psychological decompensation. Endorsements track mood dysregulation (depression, pervasive sadness, loss of interest in usual activities/anhedonia), neurovegetative anxiety (nervousness, tension, fears, unmanageable worry), and existential or spiritual crises where meaning, faith, or personal philosophical frameworks are threatened by illness.
• Physical Problems Domain: Captures somatic symptom burden, functional performance limitations, and treatment-emergent toxicities. This domain assesses bodily image alterations (appearance), basic activities of daily living (bathing/dressing, mobility/getting around), sensorimotor impairments (neuropathic tingling in hands/feet, pain), gastrointestinal disruptions (nausea, constipation, diarrhea, indigestion), constitutional manifestations (severe fatigue, fevers, sleep disturbances), and neurocognitive impairments (memory/concentration deficits), alongside substance use behaviors.

Theoretical Framework

The architectural foundation of the Distress Thermometer and Problem List is grounded within the integration of two major models in behavioral medicine: the Transactional Model of Stress and Coping formulated by Richard Lazarus and Susan Folkman, and the Biopsychosocial Model pioneered by George L. Engel.

Transactional Stress Theory and Cognitive Appraisal

According to Lazarus and Folkman’s model, distress is not a direct result of an objective stressor (such as a cancer diagnosis or chemotherapy regimen), but rather emerges from the dynamic transaction between the individual and the environment. Distress occurs when primary appraisal processes judge an event as threatening, harmful, or challenging, and secondary appraisal processes determine that personal, social, and biological resources are insufficient to manage the demands. The Distress Thermometer captures the net phenomenological outcome of this cognitive appraisal: the subjective perception of being overwhelmed. Concurrently, the Problem List functions as an inventory of contextual stressors that tip the balance of secondary appraisal, identifying the specific environmental, physical, or social demands that exceed the individual’s coping capacity.

Biopsychosocial Systems Theory

Engel’s biopsychosocial framework posits that health outcomes cannot be understood purely through biological mechanisms, but arise from recursive interactions across biological, psychological, and sociological subsystems. The DT/PL operationalizes this approach by avoiding the mind-body dualism common in traditional medical triage. By situating physical symptoms (such as pain and chemotherapy-induced nausea) directly alongside emotional symptoms (such as sadness and existential fear) and systemic problems (such as financial strain and family friction), the instrument recognizes that somatic symptoms exacerbate psychological distress, and reciprocal emotional distress lowers somatic pain thresholds and impairs immune function. This integrated conceptualization guides clinicians toward a systemic assessment of patient suffering.

Validity

Extensive psychometric investigations have established the validity of the Distress Thermometer and Problem List across diverse cancer sites, disease stages, cultural contexts, and healthcare delivery systems.

Criterion and Concurrent Validity

Criterion-related validity has been demonstrated by comparing the DT against established multi-item psychometric instruments. In the original landmark validation by Roth et al. (1998) among men with prostate cancer, the DT exhibited robust correlations with the Global Symptom Index (GSI) of the Brief Symptom Inventory (BSI) ($r = 0.67$) and the Hospital Anxiety and Depression Scale (HADS) Total score ($r = 0.64$). Concurrent validity has been replicated across dozens of international samples, showing strong correlations with the Beck Depression Inventory (BDI), the Center for Epidemiologic Studies Depression Scale (CES-D), and the Patient Health Questionnaire-9 (PHQ-9).

Diagnostic Accuracy and ROC Curve Analysis

The diagnostic performance of the DT is classically verified through Receiver Operating Characteristic (ROC) analyses, which plot sensitivity against 1 − specificity across every integer cut-off to calculate the Area Under the Curve (AUC). In general psycho-oncology literature, the AUC of the DT against established psychiatric cases (e.g., HADS Total score ≥15 or BSI-18 ≥63) ranges from $0.80$ to $0.92$, demonstrating high diagnostic accuracy for an ultra-brief single-item scale.

The Dutch Validation (Tuinman et al., 2008)

The Dutch psychometric validation conducted by Tuinman, Gazendam, and Hoekstra (2008) evaluated the Dutch version (Lastmeter) in a representative sample of cancer patients undergoing active clinical treatment and disease surveillance. Utilizing the HADS Total score (≥13/15) as the primary external criterion, the ROC analysis demonstrated an AUC of $0.87$ ($95%\text{ CI } [0.82, 0.92]$). Importantly, while the standard American NCCN guidelines advocate for an empirical cut-off score of $ge 4$, the Dutch validation demonstrated that a cut-off score of $ge 5$ optimized the balance between diagnostic sensitivity and specificity within the Dutch healthcare context:

• Cut-off score ≥ 4: Sensitivity = 0.92; Specificity = 0.63; Positive Predictive Value (PPV) = 0.44; Negative Predictive Value (NPV) = 0.96.
• Cut-off score ≥ 5: Sensitivity = 0.84; Specificity = 0.74; Positive Predictive Value (PPV) = 0.51; Negative Predictive Value (NPV) = 0.94; Youden’s Index ($J$) maximized at $0.58$.

Adopting the cut-off score of $ge 5$ reduced false-positive screening rates by more than 11%, mitigating the risk of overwhelming specialized psychosocial support services with non-distressed individuals while preserving high negative predictive values to ensure clinically compromised patients are not overlooked.

Construct and Discriminant Validity

Construct validity is substantiated by significant mean-level variations in DT scores across clinical subgroups known to experience differential distress trajectories. Patients undergoing active cytotoxic chemotherapy or multimodality radiation protocols consistently report significantly higher DT scores ($M = 5.2, SD = 2.4$) than long-term disease-free cancer survivors ($M = 3.1, SD = 2.1; p < 0.001$). Endorsement of items within specific Problem List domains correlates systematically with corresponding domain-specific legacy measures; for example, the Physical Problems domain score correlates strongly with the EORTC QLQ-C30 physical functioning and fatigue scales ($r = 0.71$), while the Emotional Problems domain score correlates strongly with the HADS Anxiety and Depression subscales ($r = 0.76$).

Reliability

Assessing the reliability of the Distress Thermometer presents distinct methodological considerations due to its operational structure as a single-item visual analog metric, paired with a multi-item cumulative symptom checklist.

Test-Retest Stability

Because emotional distress fluctuates naturally alongside acute medical stressors, stability coefficients vary systematically according to the duration between assessments. When administered within short retest intervals (24 to 48 hours) among stable outpatient oncology cohorts in the absence of treatment changes, the single-item DT demonstrates moderate-to-high test-retest reliability, with intraclass correlation coefficients (ICC) ranging between $0.78$ and $0.85$. Across extended longitudinal intervals (e.g., 4 to 8 weeks), retest coefficients decrease ($r = 0.45$ to $0.58$), reflecting the instrument’s sensitivity to change following therapeutic response, disease progression, or natural emotional adaptation.

Internal Consistency of the Problem List

Although the Problem List is designed as a formative symptom checklist (where endorsed items do not necessarily share a single underlying latent cause) rather than a reflective psychometric scale, multiple investigations have evaluated its internal consistency. Across international studies, the total 39-item Problem List demonstrates Kuder-Richardson 20 (KR-20) coefficients ranging from $0.80$ to $0.88$. Analysis of individual subdomains reveals varied internal consistency profiles, directly mirroring item density:

• Physical Problems (22 items): Cronbach’s $\alpha = 0.78 – 0.84$
• Emotional Problems (7 items): Cronbach’s $\alpha = 0.76 – 0.82$
• Practical Problems (6 items): Cronbach’s $\alpha = 0.58 – 0.67$
• Family Problems (4 items): Cronbach’s $\alpha = 0.52 – 0.64$

Lower internal consistency coefficients within the Practical and Family subscales are typical for multidimensional formative checklists; endorsing childcare difficulties, for instance, does not causally necessitate concurrent insurance or housing hardships.

Factor Analysis

A central question in the psychometric evaluation of the Problem List is whether its theoretical structure is supported by exploratory factor analysis (EFA) and confirmatory factor analysis (CFA).

Exploratory Factor Structure

Exploratory factor analyses using tetrachoric correlation matrices (the psychometrically appropriate approach for binary Yes/No items) support an empirical structure that closely aligns with the clinically proposed domains. In an analysis conducted by Tuinman et al. (2008), principal component and factor analytic models with oblique (Promax) rotation extracted dominant latent factors explaining over 48% of the total variance across the checklist:

• Factor 1: Somatic/Physical Burden (dominated by high loadings [>0.50] from fatigue, sleep disruption, pain, motor limitations, and nausea).
• Factor 2: Psychosocial/Emotional Distress (marked by loadings [>0.60] from sadness, nervousness, worry, fears, and depression).
• Factor 3: Instrumental/Socioeconomic Strain (defined by insurance, work, transportation, and financial items).
• Factor 4: Relational/Systemic Discord (dominated by marital, family, and child interactions).

Confirmatory Factor Modeling and Fit Indices

Confirmatory factor analyses testing a five-factor correlated model (Practical, Family, Emotional, Spiritual, and Physical) across diverse patient samples have shown acceptable to good goodness-of-fit indices:

• Root Mean Square Error of Approximation (RMSEA): $0.038 – 0.046$ (indicating close fit below the $0.05$ threshold)
• Comparative Fit Index (CFI): $0.91 – 0.94$
• Tucker-Lewis Index (TLI): $0.90 – 0.93$
• Standardized Root Mean Square Residual (SRMR): $0.048 – 0.056$

Bifactor modeling has further demonstrated that while a broad general distress factor accounts for approximately 58% of common variance, domain-specific group factors (particularly the Physical and Emotional clusters) maintain high residual variance, justifying the dual clinical approach of reporting both a single general distress metric (the Thermometer) and five distinct problem domains.

Instrument / Measurement Tool

• Test Type: Ultra-brief biopsychosocial screening tool and symptom checklist; patient-reported outcome measure (PROM).
• Administration Format: Self-administered paper-and-pencil or computerized/digital electronic clinical entry (via patient portals or bedside tablets); clinician- or nurse-assisted interview formats are also used in cases of severe physical impairment or cognitive limitation.
• Time required: 2 to 5 minutes to complete; immediate visual review by healthcare providers.
• Target Population: Adult and older adult oncology patients across all cancer diagnoses, disease stages, treatment pathways, and long-term survivorship phases. Also adapted for other chronic medical conditions and family caregivers.
• Item Count: 40 discrete items total: 1 single-item visual analog global distress scale (Distress Thermometer), accompanied by 39 categorical problem items (Problem List).
• Response Scale:
  • Distress Thermometer: 11-point visual analog scale scored from 0 (“No distress”) to 10 (“Extreme distress”).
  • Problem List: Dichotomous response format (Yes / No) across all 39 symptom items.
• Domain Structure of the Problem List:
  • Practical Problems (6 items): Child care, Housing, Insurance/finances, Transportation, Work/school, Treatment decisions.
  • Family Problems (4 items): Dealing with children, Dealing with partner/spouse, Ability to have children, Family health issues.
  • Emotional Problems (7 items): Depression, Fears, Nervousness, Sadness, Worry, Loss of interest in usual activities, Spiritual/religious concerns.
  • Physical Problems (22 items): Appearance, Bathing/dressing, Breathing, Changes in urination, Constipation, Diarrhea, Eating, Fatigue, Feeling swollen, Fevers, Getting around, Indigestion, Memory/concentration, Mouth sores, Nausea, Nose dry/congested, Pain, Sexual, Skin dry/itchy, Sleep, Tingling in hands/feet, Substance use.
• Scoring and Clinical Decision Rules:
  • Distress Thermometer: Evaluated as a single continuous integer score (0–10). A score of $ge 4$ (standard NCCN guideline) or $ge 5$ (validated Dutch Lastmeter cut-off) indicates clinically elevated distress requiring psychosocial triage.
  • Problem List: Scored by summing the total count of endorsed “Yes” responses, both globally (0–39) and within each of the individual domains.
  • Referral Triage Protocol: Patients scoring above the DT cut-off undergo targeted evaluation based on their endorsed Problem List domains:
    • Practical items endorsed → Referral to Medical Social Work, Case Management, or Financial Counseling.
    • Family items endorsed → Referral to Family/Couples Therapy or Social Work.
    • Emotional items endorsed → Referral to Psycho-Oncology, Clinical Psychology, or Psychiatry.
    • Spiritual items endorsed → Referral to Hospital Chaplaincy or Pastoral Care.
    • Physical items endorsed → Triage to Medical Oncologist, Palliative Care Specialist, Physical Therapy, or Symptom Management Nurse.

Permissions & Fee and Test Year

• Initial Publication Year: 1998 (Roth et al., Memorial Sloan Kettering Cancer Center / NCCN).
• Dutch Adaptation & Validation Years: Dutch clinical translation by Bannink (2004); comprehensive psychometric validation by Tuinman, Gazendam, and Hoekstra (2008).
• Copyright & Intellectual Property: The Distress Thermometer and Problem List are copyrighted by the National Comprehensive Cancer Network (NCCN). In the Netherlands, clinical implementation materials for the Lastmeter are coordinated through the Dutch Psycho-Oncology Society (Nederlandse Vereniging voor Psychosociale Oncologie – NVPO) and the Comprehensive Cancer Organisation Netherlands (IKNL).
• Permissions and Licensing: The tool is made freely available for non-commercial clinical, research, and educational purposes. Healthcare institutions and academic investigators may reproduce and implement the DT and PL without royalties, provided standard copyright and citation attributions are retained. Commercial use, electronic health record (EHR) vendor repackaging, or modification of the core items requires formal licensing and permission from the NCCN.

References

• Bannink, M. (2004). De Lastmeter: Screeningsinstrument voor psychosociale problematiek bij kankerpatiënten. Erasmus MC, Rotterdam.
• Donovan, K. A., Grassi, L., McGinty, H. L., & Jacobsen, P. B. (2014). Validation of the Distress Thermometer worldwide: State of the science. Psycho-Oncology, 23(3), 241–250. https://doi.org/10.1002/pon.3430
• Engel, G. L. (1977). The need for a new medical model: A challenge for biomedicine. Science, 196(4286), 129–136. https://doi.org/10.1126/science.847460
• Holland, J. C., & Bultz, B. D. (2007). The NCCN guideline for distress management: A case for making distress the sixth vital sign. Journal of the National Comprehensive Cancer Network, 5(1), 3–7. https://doi.org/10.6004/jnccn.2007.0003
• Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal, and coping. Springer Publishing Company.
• National Comprehensive Cancer Network. (2023). NCCN Clinical Practice Guidelines in Oncology: Distress Management (Version 2.2023). NCCN. https://www.nccn.org
• Roth, A. J., Kornblith, A. B., Batel-Copel, L., Peabody, E., Scher, H. I., & Holland, J. C. (1998). Rapid screening for psychologic distress in men with prostate carcinoma: A complementary role for the Distress Thermometer. Cancer, 82(10), 1904–1908. https://doi.org/10.1002/cncr.23621
• Vodermaier, A., Linden, W., & Siu, C. (2009). Screening for emotional distress in cancer patients: A systematic review of assessment instruments. Journal of the National Cancer Institute, 101(21), 1464–1488. https://doi.org/10.1093/jnci/djp336

Items of the Scale