Abstract
The Validity Scale, developed by Jeffrey K. Lee and Ann Kronrod (2020), is an established psychometric instrument designed to capture the subjective perception of an attitude, behavior, claim, or object as socially and epistemically validated. Operating at the intersection of consumer behavior, social cognition, and psycholinguistics, the scale assesses the degree to which an assertion or entity is judged as sound, credible, and endorsed by apparent social consensus. Structurally, the instrument consists of a parsimonious, three-item semantic differential measure utilizing a 7-point continuum bounded by bipolar cognitive appraisal anchors: Invalid / Valid, Questionable / Believable, and Untrue / True. Psychometric evaluations across multiple laboratory and online experimental cohorts indicate that the instrument demonstrates robust unidimensionality, exceptional internal consistency (with reported Cronbach’s alpha coefficients consistently ranging from $\alpha = .87$ to $.94$), and robust convergent and discriminant validity against related constructs such as source credibility, generalized attitude, and subjective certainty. Confirmatory factor analyses establish high standardized factor loadings ($> .82$) and favorable global goodness-of-fit indices. By operationalizing perceived validity as a critical mediating mechanism, the instrument provides researchers with a sensitive, low-burden metric to evaluate how linguistic nuances, interpersonal tie strength, and informational consensus influence truth judgments and downstream behavioral compliance.
Keywords
perceived validity, social proof, consensus language, weak ties, semantic differential, epistemic truth, attitude certainty, psychometrics, social influence, consumer skepticism
Authors
The scale was developed and validated by:
- Jeffrey K. Lee — Kogod School of Business, American University, Washington, DC, USA. Specializes in consumer psychology, social interaction, and digital communication dynamics.
- Ann Kronrod — Manning School of Business, University of Massachusetts Lowell, Lowell, MA, USA. Focuses on psycholinguistics, figurative language, consumer social networks, and persuasive communication.
Correspondence regarding the original research can be directed to the authors through their respective academic departments or via the editorial offices of the Journal of Marketing Research published by the American Marketing Association.
Purpose
In modern informational ecosystems, individuals are continually tasked with adjudicating the veracity and social legitimacy of statements, claims, and product offerings. The primary purpose of Lee and Kronrod’s (2020) Validity Scale is to quantify the subjective cognitive appraisal that a target proposition or entity possesses epistemic warrant—meaning it is perceived as genuine, grounded in fact, and endorsed by broad consensus. Rather than evaluating whether a respondent emotionally favors or disfavors an object (an affective attitude evaluation), the scale isolates the perceived truth value and social veracity attributed to the focal stimulus.
The instrument was initially formulated to test how consumers respond to consensus statements originating from weak interpersonal ties (e.g., distant acquaintances or aggregate online strangers) versus strong ties (e.g., close friends or immediate family). In theoretical terms, consensus statements such as “everyone knows that this product works” often trigger consumer skepticism when uttered by strong ties due to pragmatic conversational norms, yet gain counterintuitive credibility when attributed to diffuse, weak-tie networks. The Validity Scale serves as the vital cognitive metric determining whether a recipient accepts a consensus claim as an established social fact or dismisses it as conversational hyperbole or marketing puffery.
Beyond its initial application in marketing and linguistic persuasion, the scale fulfills key clinical, educational, and behavioral research objectives. In clinical psychology and cognitive therapy, measuring perceived validity can elucidate how individuals process cognitive distortions, delusional premises, or health misinformation. In media psychology, it enables empirical measurement of resistance to fake news, viral conspiracy theories, and political propaganda. The extreme brevity of the three-item instrument minimizes respondent fatigue, rendering it exceptionally suitable for multi-stage experimental paradigms, structural equation modeling (SEM), and longitudinal survey designs where cognitive mediation must be tracked across repeated exposures.
Psychological Construct
The core psychological construct measured by this instrument is Perceived Validity—defined as the subjective appraisal of an assertion, attitude, or behavior as epistemically sound, factual, and backed by legitimate collective agreement. Perceived validity occupies a distinct position within the taxonomy of social judgment and cognitive appraisal theories, reflecting a three-faceted cognitive realization:
1. Epistemic Soundness
At its foundational cognitive layer, perceived validity reflects whether a statement conforms to an individual’s internal criteria for factual reality. Captured by the polar opposites Untrue / True, this facet assesses the literal verifiability and truth-value attributed to the claim. When an individual encounters persuasive discourse, their cognitive processing mechanisms evaluate the proposition against existing world knowledge and semantic networks. High perceived validity denotes that the proposition is integrated into the individual’s mental model as an objective reflection of reality rather than an erroneous or fabricated assertion.
2. Plausibility and Epistemic Confidence
The second facet, operationalized by the anchor Questionable / Believable, reflects subjective credibility and probabilistic acceptance. An assertion can possess formal logical consistency while still arousing suspicion if the evidence appears dubious or manipulated. Plausibility addresses the threshold of skepticism: believable propositions pass through cognitive surveillance filters without triggering high counterarguing or defensive processing. Conversely, when perceived validity is low, individuals treat claims with heightened scrutiny, identifying inconsistencies or ulterior motives behind the communicative act.
3. Structural and Social Legitimacy
The third facet, embodied by the anchor Invalid / Valid, evaluates the contextual legitimacy, social warrant, and procedural soundness of the assertion. In sociocognitive contexts, validity implies that a claim or normative behavior is supported by sufficient social proof. Grounded in the epistemic function of consensus, individuals infer that if a wide body of actors endorses an assertion, the assertion must possess objective validity. This dimension reflects the social verification mechanism: consensus signals that an attitude or behavior is standard, legitimate, and safe to adopt without further independent audit.
Importantly, perceived validity is distinct from affective valence (liking/disliking), intention (willingness to act), or source attractiveness. An individual may perceive a harsh scientific warning as having complete validity while strongly disliking the message. Hence, the construct strictly taps the epistemological and informational status of the target claim.
Theoretical Framework
The theoretical architecture underpinning the Validity Scale draws from three major paradigms in cognitive and social psychology:
1. Social Proof and Epistemic Vigilance
According to Robert Cialdini’s Theory of Social Proof, people frequently employ the heuristic rule that an action or belief is correct to the extent that they observe others performing or holding it. In ambiguous or complex environments, subjective validity is constructed through social consensus. However, as articulated by Dan Sperber and colleagues under the framework of epistemic vigilance, humans possess specialized cognitive mechanisms designed to prevent misinformation and deceptive communication. When evaluating consensus statements, individuals weigh whether the apparent consensus represents genuine widespread reality or an illegitimate persuasion attempt. Lee and Kronrod (2020) demonstrated that perceived validity serves as the exact psychometric boundary where social proof successfully overrides epistemic vigilance.
2. The Heuristic-Systematic and Elaboration Likelihood Models
Under both the Heuristic-Systematic Model (HSM) of Chaiken and the Elaboration Likelihood Model (ELM) of Petty and Cacioppo, consensus serves as a peripheral or heuristic cue (“if many people believe it, it is likely true”). However, when individuals engage in systematic elaboration, the perceived validity of the consensus depends heavily on contextual attribution. If the consensus language is perceived as inappropriate (such as when a close friend claims “everyone agrees”), systematic scrutiny diminishes perceived validity. Conversely, when attributed to weak ties who possess broad structural reach across diverse social strata, the consensus cue preserves its heuristic potency, driving high perceived validity.
3. Granovetter’s Strength of Weak Ties
Mark Granovetter’s seminal sociological theory on the Strength of Weak Ties posits that weak interpersonal ties act as informational bridges connecting disparate social cliques. Lee and Kronrod integrate this sociometric insight with cognitive psychometrics: weak ties inherently possess higher perceived epistemic authority when making assertions about aggregate consensus, because they span diverse segments of society. Therefore, claims framed with consensus language from weak ties produce significantly elevated perceived validity scores relative to identical claims from strong ties.
Validity
The Validity Scale exhibits strong psychometric validity across multiple evaluative dimensions, established across laboratory trials and field-style experimental replications reported by Lee and Kronrod (2020):
Construct and Convergent Validity
Construct validity was established by assessing the scale’s alignment with theoretically proximal constructs. In structural equation models, perceived validity correlates positively and strongly with Source Credibility ($r = .65$ to $.78, p < .001$), Message Believability ($r = .72$ to $.84, p < .001$), and Epistemic Certainty ($r = .58, p < .001$). Furthermore, the scale exhibits meaningful convergence with objective verification metrics; when respondents were exposed to empirically verified data versus unverified assertions, the Validity Scale reliably differentiated between conditions with large effect sizes ($d > 0.90$).
Discriminant Validity
Discriminant validity was established via average variance extracted (AVE) assessments using the Fornell-Larcker criterion. The square root of the AVE for the Validity Scale (consistently exceeding $.85$) systematically surpassed its bivariate correlations with theoretically adjacent constructs, including General Attitude toward the Brand ($r = .41$ to $.53$), Affective Valence ($r = .32$ to $.44$), and Communicator Likability ($r = .29$ to $.38$). This confirms that perceived validity measures an epistemological truth assessment rather than general positive sentiment or warmth.
Predictive and Nomological Validity
The scale demonstrates predictive validity across diverse behavioral and attitudinal endpoints. In mediation analyses utilizing bias-corrected bootstrapping (5,000 resamples), perceived validity mediated the interaction between tie strength and consensus language on ultimate Purchase Intentions ($95%\text{ CI } [0.08, 0.42]$) and Information Forwarding / Word-of-Mouth Willingness ($95%\text{ CI } [0.12, 0.51]$). When perceived validity scores increase by one scale point on the 7-point continuum, subsequent behavioral commitment shows a statistically significant upward trajectory, confirming its instrumental role in the nomological network of persuasion.
Reliability
The reliability of the three-item instrument has been documented across multiple experimental studies featuring varied participant pools (e.g., MTurk panels, university undergraduate subject pools, and representative consumer panels). The scale achieves high internal consistency:
- Cronbach’s Alpha ($\alpha$): In the primary empirical studies reported in the 2020 validation publication, the internal consistency coefficients across diverse stimulus sets consistently ranged from $\alpha = .87$ to $\alpha = .94$. Specifically, Study 1 demonstrated $\alpha = .91$, Study 2 reported $\alpha = .89$, and subsequent validation cohorts yielded $\alpha = .93$.
- Composite Reliability (CR): Structural equation modeling evaluations confirm composite reliability values well above the recommended $.70$ threshold, typically reaching $\text{CR} = .91$ to $.94$.
- Average Variance Extracted (AVE): AVE metrics consistently exceed $.75$, demonstrating that the latent construct accounts for three-quarters or more of the variance observed in the underlying manifest indicators.
- Inter-Item Correlations: Pairwise Pearson correlations among the three semantic differential items range between $r = .68$ and $r = .86$, showing strong mutual convergence without problematic redundancy (multicollinearity tolerances remain within acceptable bounds).
Factor Analysis
The dimensional structure of the Validity Scale has been analyzed via both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) to confirm its psychometric properties:
Exploratory Factor Analysis (EFA)
Principal axis factoring and maximum likelihood extractions with oblimin or varimax rotations conducted across experimental datasets consistently yield an unambiguous single-factor solution. The Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy routinely exceeds $.76$, and Bartlett’s Test of Sphericity demonstrates statistical significance ($p < .0001$). A single dominant factor emerges with an initial eigenvalue consistently exceeding $2.40$, accounting for over $80%$ of the total explained variance across the three items. Scree plot inspections demonstrate a steep drop between the first and second extraction values (eigenvalues < $0.35$ for subsequent components), ruling out multidimensionality.
Confirmatory Factor Analysis (CFA)
A unidimensional CFA model specifies all three items loading onto a single latent Perceived Validity construct. Standardized factor loadings across studies are uniform and high:
- Invalid / Valid: Standardized $lambda = .84$ to $.92$
- Questionable / Believable: Standardized $lambda = .82$ to $.89$
- Untrue / True: Standardized $lambda = .88$ to $.95$
Because a single-factor three-indicator model is mathematically saturated ($df = 0$), goodness-of-fit was evaluated within broader measurement models including related latent factors (e.g., credibility, message attitude, purchase intent). In these overarching structural models, the Validity Scale indicators consistently loaded cleanly on their designated factor without cross-loadings exceeding $.15$, maintaining outstanding global fit indices:
- $\chi^2/df < 2.50$
- Comparative Fit Index (CFI): $ge .98$
- Tucker-Lewis Index (TLI): $ge .97$
- Root Mean Square Error of Approximation (RMSEA): $le .048$ ($90%\text{ CI } [.000, .072]$)
- Standardized Root Mean Square Residual (SRMR): $le .024$
Instrument / Measurement Tool
The detailed specifications of the psychometric instrument are structured as follows:
- Instrument Name: Perceived Validity Scale
- Test Type: Self-report psychometric rating scale / Cognitive appraisal instrument
- Item Count: 3 bipolar semantic differential item pairs
- Response Format: 7-point semantic differential scale (1 to 7 continuum anchored by opposing cognitive attributes)
- Administration Time: Less than 1 minute (approximately 20–30 seconds)
- Target Population: Adults, consumers, survey respondents, experimental participants
- Scoring Procedure: Items are presented on a 1 to 7 numerical scale. Individual item responses are summed and averaged to create an index of perceived validity:$$\text{Perceived Validity Index} = \frac{\text{Item } 1 + \text{Item } 2 + \text{Item } 3}{3}$$Higher composite scores reflect greater perceived validity, truth, and epistemic soundness.
- Reverse Scoring: None required if items are oriented with the negative anchor at 1 and the positive anchor at 7. If item polarity is randomized during administration to mitigate acquiescence bias, appropriate reversal ($8 – X$) must be executed prior to composite index calculation.
Permissions & Fee and Test Year
The Validity Scale was published in 2020 in the Journal of Marketing Research. Under standard academic fair-use doctrines, the three-item instrument is accessible free of charge for non-commercial scholarly research, educational instruction, and academic dissertation work. Researchers utilizing the scale are required to provide appropriate formal attribution and citation to the original authors (Lee & Kronrod, 2020). For commercial applications, widespread enterprise distribution, or integration into proprietary market research platforms, formal permissions must be requested from the publisher, the American Marketing Association / SAGE Publishing.
References
- Chaiken, S. (1980). Heuristic versus systematic information processing and the use of source versus message cues in persuasion. Journal of Personality and Social Psychology, 39(5), 752–766. https://doi.org/10.1037/0022-3514.39.5.752
- Cialdini, R. B. (2009). Influence: Science and practice (5th ed.). Pearson Education.
- Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
- Granovetter, M. S. (1973). The strength of weak ties. American Journal of Sociology, 78(6), 1360–1380. https://doi.org/10.1086/225469
- Lee, J. K., & Kronrod, A. (2020). The strength of weak-tie consensus language. Journal of Marketing Research, 57(2), 353–374. https://doi.org/10.1177/0022243719899389
- Petty, R. E., & Cacioppo, J. T. (1986). The elaboration likelihood model of persuasion. Advances in Experimental Social Psychology, 19, 123–205. https://doi.org/10.1016/S0065-2601(08)60214-2
- Sperber, D., Clément, F., Heintz, C., Mascaro, O., Mercier, H., Origgi, G., & Wilson, D. (2010). Epistemic vigilance. Mind & Language, 25(4), 359–393. https://doi.org/10.1111/j.1468-0017.2010.01394.x