Abstract
The Adult Toolbox Social Relationship Scale constitutes a core measurement battery developed within the National Institutes of Health (NIH) Toolbox for Assessment of Neurological and Behavioral Function. Commissioned to standardize biomedical, behavioral, and clinical neuroscience research, the instrument provides an empirically rigorous, psychometrically sophisticated assessment of adult social functioning across three overarching domains: social support, social companionship, and social distress. The battery comprises six calibrated unidimensional subscales: Emotional Support (8 items), Instrumental Support (8 items), Friendship (8 items), Loneliness (5 items), Perceived Rejection (8 items), and Perceived Hostility (8 items), totaling 45 items in its comprehensive fixed-length format, with validated Computerized Adaptive Testing (CAT) and brief static short-form options. Each item is scored on a 5-point Likert scale ranging from 1 (“Never”) to 5 (“Always”), referencing the respondent’s experiences over the past month. Grounded in item response theory (IRT) and graded response modeling (GRM), the instrument yields standardized T-scores normed against the United States general population (mean = 50, standard deviation = 10). Psychometric validation across diverse national normative cohorts demonstrated exceptional internal consistency reliability, with Cronbach’s alpha coefficients ranging from .932 to .969 across subscales, and strong test-retest stability. Confirmatory factor analyses have repeatedly corroborated the six-factor structural architecture while sustaining low to moderate inter-correlations that differentiate constructive social assets from chronic interpersonal stressors. The scale serves as an indispensable resource for epidemiology, psychoneuroimmunology, geriatric psychiatry, and clinical trials seeking to quantify interpersonal determinants of morbidity, cognitive decline, and health-related quality of life.
Keywords
NIH Toolbox, social relationships, emotional support, instrumental support, loneliness, perceived hostility, perceived rejection, friendship, social health, psychometrics, item response theory
Authors
The NIH Toolbox Adult Social Relationship Scales were developed and psychometrically validated by a multidisciplinary team of behavioral scientists, clinical psychologists, and psychometricians under the auspices of the NIH Blueprint for Neuroscience Research:
- Jill M. Cyranowski, Ph.D. — Department of Psychiatry and Psychology, University of Pittsburgh School of Medicine; Department of Psychology, Chatham University, Pittsburgh, Pennsylvania, United States.
- Nicholas Zill, Ph.D. — Westat, Inc., Rockville, Maryland, United States.
- Rita Bode, Ph.D. — Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, United States.
- Zeeshan Butt, Ph.D. — Departments of Medical Social Sciences, Surgery, and Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, United States.
- Michael A. R. Kelly, B.S. — Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, United States.
- Paul A. Pilkonis, Ph.D. — Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, United States.
- Joshua M. Salsman, Ph.D. — Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, United States; Center for Behavioral Health in Oncology, Wake Forest University School of Medicine.
- David Cella, Ph.D. — Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, United States.
Purpose
Interpersonal ties, perceived social connections, and relational strain are among the most robust social determinants of mental and physical health. Historically, epidemiologists, neuroscientists, and behavioral clinicians utilized an array of fragmented, unstandardized questionnaires to measure interpersonal dynamics—such as the Interpersonal Support Evaluation List (ISEL), the UCLA Loneliness Scale, and the Multidimensional Scale of Perceived Social Support (MSPSS). Although these classic instruments provided critical foundational insights, their disparate factor structures, varying recall periods, heterogeneous response scales, and lack of unified calibration hindered cross-study harmonization and systematic longitudinal pooling.
The NIH Toolbox initiative was launched to remediate these psychometric discrepancies by delivering standardized, modular, and brief assessment batteries capable of monitoring neurological and behavioral function across the lifespan. The specific purpose of the Adult Toolbox Social Relationship Scale is to provide a common metric that assesses both positive (protective) and negative (pathogenic) aspects of social health. By operationalizing interpersonal life into discrete, item-response-calibrated subscales, the instrument allows researchers to dissect whether health outcomes are mediated by the presence of affirmative social assets (such as tangible assistance and emotional validation) or driven by the destructive physiological toll of interpersonal rejection, loneliness, and hostility.
In clinical practice and biomedical research, the battery is engineered for broad implementation in:
- Large-scale epidemiological studies: Tracking life-course epidemiology and identifying systemic vulnerability factors underlying cardiovascular morbidity, metabolic syndrome, autoimmune dysregulation, and neurodegenerative diseases.
- Clinical trials and behavioral interventions: Quantifying whether psychotherapy, community interventions, or social prescribing paradigms meaningfully attenuate feelings of ostracism and perceived hostility or enhance perceived emotional availability.
- Neuroscience and brain-behavior mapping: Examining functional neurocircuitry (e.g., frontolimbic connectivity, amygdala reactivity, and default mode network dynamics) associated with the perception of social safety versus social threat.
- Gerontology and palliative care: Detecting hidden social isolation, caregiver burnout, and physical dependency risks in aging adult populations.
Psychological Construct
The Adult Toolbox Social Relationship battery treats social health as a multifaceted, higher-order construct composed of distinct, non-interchangeable experiential facets. Rather than reducing an individual’s interpersonal existence to an aggregate singular score, the instrument isolates six well-defined constructs categorized into three primary domains:
1. Domain: Social Support
Social support captures the perceived availability of resources provided by one’s social network during times of normative functioning as well as heightened stress.
- Emotional Support: Refers to the subjective perception that one has access to confidants who provide empathy, acceptance, caring, and understanding. Individuals high in emotional support feel validated and know that when psychological stressors emerge, trustworthy individuals are available to listen, process difficult emotions, and offer constructive guidance (e.g., having someone to talk with when having a bad day or experiencing complex dilemmas).
- Instrumental Support: Assesses the perceived availability of tangible, pragmatic assistance with concrete daily activities or medical necessities. This includes having individuals accessible to provide transportation to medical visits, assist with domestic maintenance, prepare meals during debilitating illness, or run essential errands. This dimension is especially critical in chronically ill, disabled, or geriatric populations.
2. Domain: Social Companionship
Companionship captures the extent to which an individual participates in shared social experiences and feels integrated within an enjoyable social collective, balanced against the psychological agony of social isolation.
- Friendship: Evaluates the perceived availability of peer relationships for leisure, recreational socialization, mutual enjoyment, and shared activities. It measures affiliation, ease of social connection, and the sense of belonging to an active peer network with whom one can spontaneously unwind, share meals, and enjoy recreational pursuits.
- Loneliness: Measures the painful, distressing affective response that arises from a perceived discrepancy between one’s desired and actual interpersonal contacts. It reflects qualitative feelings of alienation, being disconnected from the social fabric, being forgotten, and lacking profound emotional intimacy, irrespective of objective social network size.
3. Domain: Social Distress
Interpersonal interactions are not exclusively salutary; negative interactions exert profound down-regulatory effects on psychological resilience and induce neuroendocrine and inflammatory cascades.
- Perceived Rejection: Reflects the perception that others are actively unresponsive, dismissive, unsupportive, or avoidant. This construct captures experiences where family members, friends, or associates minimize one’s problems, fail to show up in times of need, withhold assistance, or signal that one is an undesirable burden.
- Perceived Hostility: Evaluates the frequency with which an individual experiences their social milieu as argumentative, aggressive, contemptuous, blaming, or punitive. It encompasses overt interpersonal conflicts, verbal aggression, unfair criticism, and hostile invalidation from others.
Theoretical Framework
The conceptual architecture of the Adult Toolbox Social Relationship battery synthesizes decades of interpersonal psychology, behavioral medicine, and evolutionary biology. Several foundational theoretical frameworks ground the design of this instrument:
The Stress-Buffering Model and Main Effect Hypothesis
Formulated prominently by Sheldon Cohen and Thomas Wills (1985), social support theory posits two major mechanisms through which interpersonal relations safeguard somatic health. The main effect hypothesis asserts that social integration and companionship (captured by the Friendship subscale) provide continuous positive affect, predictability in life roles, and motivation to adhere to healthy behaviors, thereby reducing baseline allostatic load. Conversely, the stress-buffering model posits that resources such as Emotional Support and Instrumental Support act as psychological dampers that mitigate the deleterious neuroendocrine responses to acute and chronic environmental threats, preventing sustained autonomic hyperarousal and prolonged cortisol excretion.
Social Baseline Theory
Developed by James Coan and colleagues, Social Baseline Theory proposes that the human brain evolved to assume proximity to trustworthy conspecifics as the default, baseline biological state. When proximity to dependable social partners is preserved (indicated by high Emotional Support and low Loneliness), the human brain conserves cognitive and metabolic resources by “outsourcing” vigilance, risk regulation, and physical tasks across the social collective. When relational proximity is degraded, or when the social environment is perceived as predatory or hostile (reflected in Perceived Rejection and Perceived Hostility), the central nervous system must continuously remain in high-energy vigilance states, activating the hypothalamic-pituitary-adrenal (HPA) axis and triggering pro-inflammatory cytokine expression (e.g., IL-6, TNF-alpha).
Interpersonal Acceptance-Rejection Theory (IPARTheory)
Ronald Rohner’s Interpersonal Acceptance-Rejection Theory details the universal psychological sequelae of relational invalidation. The human need for positive social evaluation makes social pain neurobiologically analogous to physical pain. Chronic experiences of interpersonal rejection and hostility disrupt psychological attachment systems, fostering emotional blunting, rejection sensitivity, and depressive vulnerability. The NIH Toolbox explicitly incorporated the Social Distress domain to measure these toxic interpersonal dimensions rather than assuming they represent merely the low end of a social support continuum.
Validity
The psychometric validation of the Adult Toolbox Social Relationship Scales was executed through a rigorous empirical pipeline involving qualitative cognitive debriefing, exploratory item banks, and massive nationwide population sampling overseen by the NIH Toolbox team (Cyranowski et al., 2013).
Construct and Factorial Validity
Confirmatory factor analyses (CFA) demonstrated that a six-factor model—delineating Emotional Support, Instrumental Support, Friendship, Loneliness, Perceived Rejection, and Perceived Hostility—provided a significantly superior fit over unidimensional, two-factor (positive vs. negative), or three-factor models. Root mean square error of approximation (RMSEA) values remained consistently low (≤ .05), and Comparative Fit Index (CFI) values exceeded .95, confirming that these interpersonal experiences, while intercorrelated, represent conceptually distinct constructs requiring discrete quantification.
Convergent and Discriminant Validity
Convergent validity was verified by evaluating the NIH Toolbox subscales against legacy gold-standard measurement instruments:
- Emotional and Instrumental Support: Displayed robust positive correlations (r = .70 to .82) with the Interpersonal Support Evaluation List (ISEL) subscales and the Medical Outcomes Study (MOS) Social Support Survey.
- Friendship: Correlated strongly with the Friendship subscales of the Inventory of Parent and Peer Attachment (IPPA) and the MOS positive social interaction dimension (r > .75).
- Loneliness: Exhibited pronounced convergent alignment with the UCLA Loneliness Scale (version 3), demonstrating correlation coefficients exceeding r = .80.
- Perceived Rejection and Hostility: Correlated significantly with the Test of Negative Social Exchange (TENSE) and the social strain indices of the Midlife in the United States (MIDUS) study (r = .65 to .78).
Discriminant validity was verified through structural modeling demonstrating that positive support scales shared less than 25% common variance with hostility and rejection scales, corroborating the principle that the absence of overt hostility does not automatically denote the presence of constructive emotional or instrumental support.
Criterion and Clinical Validity
In community and clinical cohorts, elevated scores on Loneliness, Perceived Rejection, and Perceived Hostility independently predicted elevated depressive symptomatology on the PROMIS Depression scale, elevated anxiety indices, perceived systemic stress, and compromised self-reported physical health on the Short Form Health Survey (SF-36). Furthermore, higher Emotional and Instrumental Support scores served as substantial protective buffers against functional decline in adults managing chronic physical illness and cognitive impairments.
Reliability
The NIH Toolbox Adult Social Relationship battery exhibits superlative internal consistency and temporal stability across diverse demographic strata, including variations across sex, age, race, and educational attainment.
Internal Consistency
In the primary psychometric validation study conducted by Cyranowski et al. (2013) involving large, nationally representative adult samples (N > 1,000), classical test theory (CTT) metrics confirmed extraordinary internal consistency reliability for each subscale:
- Emotional Support (8 items): Cronbach’s α = .969
- Instrumental Support (8 items): Cronbach’s α = .947
- Friendship (8 items): Cronbach’s α = .945
- Loneliness (5 items): Cronbach’s α = .939
- Perceived Rejection (8 items): Cronbach’s α = .932
- Perceived Hostility (8 items): Cronbach’s α = .941
IRT-based marginal reliability estimates mirrored these classical metrics, with test information functions confirming that each scale provides exceptionally low standard errors of measurement across a broad range of the latent continuum (θ values from -2.5 to +2.5 standard deviations).
Test-Retest Reliability
Temporal stability evaluated across 7- to 21-day test-retest intervals revealed excellent consistency. Intraclass correlation coefficients (ICCs) ranged from .78 to .88 across subscales, verifying that while the questions reference experiences over the past month, they measure stable interpersonal environmental patterns rather than fleeting momentary mood states.
Factor Analysis
The development of the NIH Toolbox Adult Social Relationship Scales adhered to a rigorous modern psychometric paradigm integrating both Classical Test Theory and Item Response Theory:
Item Calibration via Graded Response Model (GRM)
Because the items utilize a 5-point polytomous response scale (Never to Always), Samejima’s Graded Response Model (GRM) was fitted to each candidate item pool. The IRT discrimination parameters (a-parameters) for retained items were universally high, frequently exceeding 2.0 (with several items in the Emotional Support pool exceeding 3.0), indicating that the items possess extraordinary discriminatory precision in classifying individuals along the interpersonal trait spectrum.
Category boundary threshold parameters (b-parameters) demonstrated broad, monotonic coverage across the latent trait distribution (θ), ensuring that the instruments do not suffer from severe ceiling or floor artifacts in general normative populations.
Confirmatory Factor Analysis (CFA) Architecture
Extensive CFA modeling on the validation data confirmed the following structural indices for the calibrated 6-factor model:
- Comparative Fit Index (CFI): > .96
- Tucker-Lewis Index (TLI): > .96
- Root Mean Square Error of Approximation (RMSEA): < .048 (90% CI: .044 – .052)
- Standardized Root Mean Square Residual (SRMR): < .042
Standardized factor loadings for all individual items within their designated subscales exceeded .75, with the vast majority ranging between .82 and .94. Inter-factor correlations revealed that while Emotional Support and Instrumental Support share a strong positive association (r ≈ .68), and Friendship correlates inversely with Loneliness (r ≈ -.64), the distress constructs (Hostility and Rejection) form an independent correlated cluster (r ≈ .72) that correlates only modestly and inversely with the support constructs (r ≈ -.25 to -.38). This structural architecture firmly refutes the assumption that interpersonal distress is simply the opposite pole of social support.
Instrument / Measurement Tool
The Adult Toolbox Social Relationship Scales are operationalized with standardized administration and scoring guidelines:
- Instrument Type: Standardized multi-scale self-report questionnaire, available in both fixed-form format and dynamic Computerized Adaptive Testing (CAT) via the NIH Toolbox iPad app or web delivery engines.
- Target Population: Adults aged 18 years and older (a complementary pediatric version is available for children and adolescents).
- Administration Time: Approximately 5 to 8 minutes for the complete 45-item fixed battery; under 2 minutes per domain when administered via CAT algorithms.
- Recall Period: Past month (“In the past month, please rate how often . . .”).
- Subscales & Item Counts (45 items total):
- Emotional Support: 8 items
- Instrumental Support: 8 items
- Friendship: 8 items
- Loneliness: 5 items
- Perceived Rejection: 8 items
- Perceived Hostility: 8 items
- Response Scale: 5-point Likert scale:
- 1 = Never
- 2 = Rarely
- 3 = Sometimes
- 4 = Usually
- 5 = Always
- Scoring Methodology:
- Raw scores for each subscale can be calculated by summing the item response values (minimum score = number of items × 1; maximum score = number of items × 5).
- Items within each subscale are unidirectionally keyed; no reverse-scoring is required within an individual subscale.
- In professional research and clinical assessment, raw scores or CAT response patterns are converted into standard T-scores (mean = 50, standard deviation = 10), standardized against the 2010 U.S. Census normative demographics.
- Interpretation: For Emotional Support, Instrumental Support, and Friendship, higher T-scores reflect greater interpersonal assets and protective social connection. For Loneliness, Perceived Rejection, and Perceived Hostility, higher T-scores indicate heightened social distress, alienation, and interpersonal dysfunction.
Permissions & Fee and Test Year
The NIH Toolbox Adult Social Relationship Scales were formally introduced and published in 2013 as part of the overarching NIH Toolbox for Assessment of Neurological and Behavioral Function initiative (Cyranowski et al., 2013). The developmental work was funded by the National Institutes of Health through the NIH Blueprint for Neuroscience Research and the NIH Office of Behavioral and Social Sciences Research (OBSSR).
The battery is part of the HealthMeasures repository. The individual item stems and fixed forms are in the public domain and available free of charge for non-commercial academic research, public health tracking, and clinical evaluation. Researchers may administer paper-and-pencil versions or integrate the verbatim items into electronic data capture platforms (such as REDCap or Qualtrics) without royalty fees. Commercial software platforms, proprietary health systems, or administration via the official NIH Toolbox iPad application may require nominal annual application subscription fees, hardware licensing, or software maintenance costs managed through HealthMeasures and its administrative partners.
References
- Cella, D., Riley, W., Stone, A., Wallston, K., Johnson, P., & Hays, R. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. https://doi.org/10.1016/j.jclinepi.2010.04.011
- Coan, J. A., & Sbarra, D. A. (2015). Social baseline theory: The social regulation of risk and effort. Current Opinion in Psychology, 1, 87–91. https://doi.org/10.1016/j.copsyc.2014.12.021
- Cohen, S., & Wills, T. A. (1985). Stress, social support, and the buffering hypothesis. Psychological Bulletin, 98(2), 310–357. https://doi.org/10.1037/0033-2909.98.2.310
- Cyranowski, J. M., Zill, N., Bode, R., Butt, Z., Kelly, M. A. R., Pilkonis, P. A., Salsman, J. M., & Cella, D. (2013). Assessing social support, companionship, and distress: National Institute of Health (NIH) toolbox adult social relationship scales. Health Psychology, 32(3), 293–301. https://doi.org/10.1037/a0028586
- Gershon, R. C., Wagster, M. V., Hendrie, H. C., Fox, N. A., Cook, K. F., & Cella, D. (2013). NIH Toolbox for Assessment of Neurological and Behavioral Function. Neurology, 80(11 Suppl 3), S2–S6. https://doi.org/10.1212/WNL.0b013e3182872e5f
- Hawkley, L. C., & Cacioppo, J. T. (2010). Loneliness matters: A theoretical and empirical review of consequences and mechanisms. Annals of Behavioral Medicine, 40(2), 218–227. https://doi.org/10.1007/s12160-010-9210-8
- Rohner, R. P. (2004). The parental “acceptance-rejection syndrome”: Universal correlates of perceived rejection. American Psychologist, 59(8), 830–840. https://doi.org/10.1037/0003-066X.59.8.830
- Salsman, J. M., Butt, Z., Pilkonis, P. A., Cyranowski, J. M., Zill, N., Hendrie, H. C., Kupst, M. J., & Cella, D. (2014). Emotion assessment using the NIH Toolbox. Neurology, 80(11 Suppl 3), S76–S86. https://doi.org/10.1212/WNL.0b013e3182872e13