Perceived Political Campaign Argument Strength

Abstract

The Perceived Political Campaign Argument Strength scale is a four-item psychometric instrument designed to evaluate voters’ subjective appraisals of the cogency, persuasiveness, and motivational efficacy of advocacy communications within public policy and electoral contexts. Originally adapted by Seiders, Godfrey Flynn, and Nenkov (2022) from the foundational argument-strength battery established by Zhao et al. (2011), this self-report measure assesses the degree to which an argumentative appeal provides compelling, credible, and actionable reasons to support a specific ballot measure or policy proposition. Evaluated using a 7-point Likert scale ranging from 1 (“Strongly disagree”) to 7 (“Strongly agree”), the instrument yields a single composite score reflecting perceived argument strength (PAS).

Psychometric evaluations demonstrate that the scale exhibits robust psychometric properties across diverse demographic samples and contested electoral topics. Confirmatory factor analyses support a unidimensional factor structure characterized by substantial item loadings (λ ≥ .85) and optimal model fit indices. The scale displays high internal consistency reliability, with Cronbach’s alpha coefficients typically exceeding .90. Furthermore, the scale demonstrates rigorous convergent validity through strong associations with post-exposure policy attitudes and voting intentions, discriminant validity against source credibility and emotional framing, and predictive validity regarding ballot choice. The measure serves as an indispensable tool for political psychologists, consumer behaviorists, public policy researchers, and campaign communication strategists seeking to isolate the cognitive mechanisms driving voter decision-making in direct democracy referenda.

Keywords

Perceived argument strength, political persuasion, ballot measures, direct democracy, message persuasiveness, voting behavior, cognitive elaboration, Elaboration Likelihood Model, public policy marketing, psychometrics

Authors

The four-item adaptation of the Perceived Political Campaign Argument Strength scale was developed and validated by:

• Kathleen Seiders — Professor of Marketing, Carroll School of Management, Boston College, Chestnut Hill, Massachusetts, United States.
• Andrea Godfrey Flynn — Associate Professor of Marketing, Knauss School of Business, University of San Diego, San Diego, California, United States.
• Gergana Y. Nenkov — Professor of Marketing, Carroll School of Management, Boston College, Chestnut Hill, Massachusetts, United States.

The scale adapts the operational framework established by Xiaoquan Zhao (Department of Communication, George Mason University) and colleagues (2011), contextualizing general message-processing metrics specifically for public ballot initiatives, industry advocacy campaigns, and policy voting outcomes.

Purpose

The primary purpose of the Perceived Political Campaign Argument Strength scale is to quantify an individual’s subjective perception of the logical validity, compelling nature, and motivational power of an advocacy message designed to influence voting behavior on legislative and policy issues. In direct democracy environments—such as statewide referendum votes, municipal ballot initiatives, and constitutional amendments—voters are frequently subjected to intense persuasive communication from corporate stakeholders, trade organizations, and public interest coalitions. Understanding the cognitive impact of these persuasive appeals necessitates a psychometrically sound, brief, and targeted instrument.

Historically, research on persuasion has distinguished between objective argument quality (manipulated experimentally via normative standards of logic or empirical evidence) and perceived argument strength (the subjective reception and evaluation of the message by target receivers). As noted in behavioral decision research, normative assessments of argument quality often fail to predict public response because lay audiences interpret information through cognitive heuristics, motivated reasoning, and subjective relevance. The Perceived Political Campaign Argument Strength scale bridges this operational divide by capturing how convincing, believable, and actionable messages are perceived to be by actual constituents facing real voting decisions.

In empirical research, this tool enables scholars to:

• Isolate the mediating mechanisms that translate exposure to campaign advertisements into voting intention and actual electoral choices.
• Investigate asymmetries in persuasion, such as differences in how voters process messages disseminated by commercial industry coalitions versus public interest groups.
• Control for perceived message quality when examining source effects, regulatory focus, prior political ideology, or cognitive load.
• Optimize direct-to-public communication strategies regarding complex legislative policies, environmental regulations, public health mandates, and fiscal initiatives.

Psychological Construct

The construct captured by this instrument is Perceived Argument Strength (PAS), localized within political discourse. In psychometric literature, PAS represents a secondary cognitive appraisal: the conscious evaluation of an argument’s capacity to justify a particular conclusion or behavioral recommendation. Rather than reflecting an emotional reaction (e.g., threat, hope) or a generalized affective reaction toward the topic, PAS measures the perceived evidentiary and logical merits of the claim.

The four items in this instrument tap into complementary facets of a unified cognitive construct:

• Logical Convincingness: Assessed by the item examining whether the message was “convincing.” This facet reflects the cognitive endorsement of the message’s primary thesis, evaluating whether the argumentative chain establishes coherence and rational plausibility.
• Action-Oriented Reason Provision: Assessed by the item evaluating whether the message provided a clear “reason to vote for the ballot measure.” Unlike generic evaluations of informational texts, political arguments must generate behavioral motivation. This facet measures the functional utility of the message in informing the respondent’s electoral agency.
• Epistemic Cogency (Strength): Assessed by whether the argument was evaluated as “strong.” Strength captures the perceived resilience of the claim against counter-arguments, rhetorical robustness, and structural substance.
• Veracity and Believability: Assessed through the item judging the argument as “believable.” This reflects subjective truth value, factual credibility, and the absence of perceived hyperbole or deception within the claims presented.

Together, these facets form a parsimonious, unidimensional continuum ranging from completely unconvincing and implausible rhetoric to highly compelling, reliable, and actionable justification for civic behavior.

Theoretical Framework

The conceptual foundation of the Perceived Political Campaign Argument Strength scale is grounded in contemporary dual-process theories of persuasion, most notably the Elaboration Likelihood Model (ELM) articulated by Petty and Cacioppo (1986) and the Heuristic-Systematic Model (HSM) formulated by Chaiken (1980). According to dual-process paradigms, when message recipients possess both the motivation and ability to scrutinize issue-relevant information, processing proceeds via the systematic or central route. Under central route conditions, attitude formation and subsequent behavioral intentions are largely determined by the cognitive elaboration of argument quality.

However, classical persuasion research encountered a persistent methodological challenge: defining “argument quality” independently of its persuasive outcome without relying on circular logic. Zhao et al. (2011) resolved this dilemma by conceptualizing perceived argument strength as an empirical psychological construct that can be measured directly through validated psychometric indicators. By capturing subjective evaluations of argument strength, researchers can verify whether high-elaboration participants systematically recognize and respond to substantive claims.

Within the political marketing framework proposed by Seiders, Godfrey Flynn, and Nenkov (2022), this theoretical paradigm is extended to industry-sponsored policy conflicts. When commercial industries engage in direct-to-public persuasion (e.g., opposing taxes on sugar-sweetened beverages or challenging labor regulations), voters are confronted with competing ideological frames. The ELM posits that perceived argument strength serves as the primary cognitive mediator through which campaign messages influence voting intentions, particularly when issues are high in personal relevance or fiscal consequence. The four-item scale captures this central cognitive processing milestone, distinguishing reasoned cognitive endorsement from peripheral heuristics such as source credibility, corporate brand familiarity, or superficial campaign aesthetics.

Validity

The validity of the four-item Perceived Political Campaign Argument Strength scale has been substantiated across multiple empirical studies employing experimental and quasi-experimental designs involving thousands of voting-age participants.

Construct and Convergent Validity

Construct validity is evidenced by the scale’s strong, theoretically aligned associations with downstream cognitive and intentional outcomes. In the validation studies conducted by Seiders et al. (2022), perceived argument strength correlated positively and significantly with post-message attitudes toward the focal ballot measure (r values typically ranging from .62 to .78, p < .001). Furthermore, the scale correlates substantially with measures of cognitive thought favorability derived from open-ended thought-listing protocols, confirming that high scores on the scale reflect genuine pro-argument cognitive elaboration.

Discriminant Validity

Discriminant validity has been confirmed through average variance extracted (AVE) versus shared variance assessments (Fornell-Larcker criterion) and exploratory factor analyses incorporating related but distinct constructs. Specifically, perceived argument strength successfully discriminates from:

• Source Credibility: The correlation between perceived argument strength and corporate source trustworthiness typically remains moderate (r ≈ .35 to .48), demonstrating that voters differentiate between the perceived veracity of the sponsor and the analytical merits of the argument itself.
• Affective Arousal: Emotional responses to campaign materials (e.g., anger, fear, enthusiasm) show distinct factor loadings and divergent predictive pathways, confirming that the scale captures cognitive appraisal rather than general emotional resonance.
• Prior Political Ideology: While political conservatism or liberalism may bias processing, baseline ideology explains less than 15% of the variance in argument strength ratings, demonstrating that the scale measures message-specific appraisal.

Predictive and Criterion Validity

In electoral and policy marketing experiments, the scale demonstrates robust predictive validity. Mediation analyses using structural equation modeling (SEM) indicate that perceived argument strength significantly mediates the indirect effect of message exposure on actual binary ballot voting choices and continuous voting intentions (indirect effect β ranging from .24 to .41, 95% bootstrap confidence intervals excluding zero). When campaigns present stronger arguments, respondents exhibit a quantifiable increase in their willingness to vote in alignment with the message’s strategic intent.

Reliability

The scale consistently exhibits exceptional internal consistency across varied operational environments, sample populations, and public policy topics (e.g., soda taxes, environmental sustainability initiatives, municipal zoning, and healthcare regulations).

• Cronbach’s Alpha (α): Across the empirical investigations reported by Seiders et al. (2022), the four-item scale demonstrated reliability coefficients consistently ranging between .91 and .95. These values comfortably exceed the conventional psychometric threshold of .70 for research instruments and .90 for high-stakes evaluative measures.
• Composite Reliability (CR): Structural equation modeling confirms composite reliability values exceeding .92, indicating that the four items reliably capture the underlying latent construct with minimal measurement error.
• Average Variance Extracted (AVE): The AVE for the single latent factor consistently exceeds .75, well above the .50 benchmark, confirming that the variance explained by the latent variable is substantially greater than the variance attributable to measurement error.

Given the situational, message-dependent nature of persuasive evaluations, traditional long-term test-retest reliability is typically replaced in experimental literature by split-half assessments and cross-sample stability tests. In these analyses, item-total correlations across all four items remain high (typically r > .80), indicating high homogeneity among the indicators.

Factor Analysis

Psychometric evaluation of the four-item instrument via both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) supports a clean, unidimensional measurement model.

Confirmatory Factor Analysis (CFA)

When evaluated within structural equation modeling frameworks across large voter samples (e.g., N > 500), the single-factor specification yields exemplary model fit metrics:

• Comparative Fit Index (CFI): ≥ .99
• Tucker-Lewis Index (TLI): ≥ .98
• Root Mean Square Error of Approximation (RMSEA): ≤ .048 (90% CI [.021, .076])
• Standardized Root Mean Square Residual (SRMR): ≤ .018

Factor Loadings

All four items exhibit strong, statistically significant standardized factor loadings (λ) on the single latent “Perceived Argument Strength” construct. Representative standardized loadings observed across experimental validations include:

• “The argument in the message was convincing”: λ = .91 (p < .001)
• “The argument in the message gave me a reason to vote for the ballot measure”: λ = .86 (p < .001)
• “The argument in the message was strong”: λ = .93 (p < .001)
• “The argument in the message was believable”: λ = .87 (p < .001)

These empirical findings demonstrate that no item introduces construct contamination or multidimensional cross-loadings, justifying the computation of a unified arithmetic mean score.

Instrument / Measurement Tool

• Instrument Name: Perceived Political Campaign Argument Strength Scale
• Scale Type: Self-administered psychometric questionnaire / stimulus-evaluation scale
• Construct Measured: Perceived strength, convincingness, and motivational utility of political/ballot campaign messages
• Target Population: Registered voters, adult citizens, consumer panels, and experimental research participants
• Administration Format: Paper-and-pencil, computerized lab experiments, or online surveys
• Administration Time: Approximately 1 to 2 minutes
• Item Count: 4 items
• Response Scale: 7-point Likert scale (1 = Strongly disagree to 7 = Strongly agree)
• Scoring Protocol: All items are keyed in the positive direction (no reverse-scored items). The composite index is calculated by computing the arithmetic mean across all four items:

Perceived Argument Strength = (Item 1 + Item 2 + Item 3 + Item 4) / 4

• Interpretation: Composite scores range from 1.00 to 7.00. Higher numerical values reflect greater perceived argument strength, characterized by higher perceived credibility, cogency, and behavioral justification for the proposed ballot initiative.

Permissions & Fee and Test Year

The four-item adaptation of the Perceived Political Campaign Argument Strength scale was published in 2022 by Kathleen Seiders, Andrea Godfrey Flynn, and Gergana Y. Nenkov in the Journal of Marketing. The scale represents an adaptation of the foundational perceived-argument-strength framework validated by Xiaoquan Zhao and colleagues in 2011 in Communication Monographs.

Licensing and Academic Use: The scale items are published within academic peer-reviewed literature. In accordance with standard fair use doctrines in scientific scholarship, the scale may be utilized by independent scholars, university researchers, and students for academic, non-commercial research without payment of royalty fees. Commercial entities, professional polling organizations, or corporate consulting firms intending to incorporate the instrument into proprietary commercial audits should consult the copyright holders (American Marketing Association / Taylor & Francis) and the original authors for appropriate licensing permissions.

References

• Chaiken, S. (1980). Heuristic versus systematic information processing and the use of source versus message cues in persuasion. Journal of Personality and Social Psychology, 39(5), 752–766. https://doi.org/10.1037/0022-3514.39.5.752
• Fishbein, M., & Ajzen, I. (2010). Predicting and changing behavior: The reasoned action approach. Psychology Press. https://doi.org/10.4324/9780203838020
• Petty, R. E., & Cacioppo, J. T. (1986). The Elaboration Likelihood Model of persuasion. In Communication and persuasion: Central and peripheral routes to attitude change (pp. 1–24). Springer, New York, NY. https://doi.org/10.1007/978-1-4612-4964-1_1
• Seiders, K., Flynn, A. G., & Nenkov, G. Y. (2022). How industries use direct-to-public persuasion in policy conflicts: Asymmetries in public voting responses. Journal of Marketing, 86(2), 126–146. https://doi.org/10.1177/00222429211045648
• Zhao, X., Strasser, A., Cappella, J. N., Lerman, C., & Fishbein, M. (2011). A measure of perceived argument strength: Reliability and validity. Communication Monographs, 78(1), 50–75. https://doi.org/10.1080/03637751.2011.564812

Items of the Scale