Ad Attribute Importance — Executional Quality (AAI-EQ)

1. Abstract

The Ad Attribute Importance — Executional Quality (AAI-EQ) scale is a specialized, ten-item unipolar psychometric instrument designed to assess the subjective importance that consumers place on technical, craft-level production dimensions when evaluating an advertisement. Developed by Susan Fournier, Benjamin Lawrence, and Frédéric Brunel (2013) within an extensive multimethod investigation into the differential persuasion dynamics of consumer-generated advertising (CGA) versus firm-created advertising (FCA), the instrument isolates technical execution from other evaluative advertising facets such as artistic originality and narrative authenticity. The scale measures cognitive and aesthetic criteria spanning audiovisual fidelity, technical direction, cinematography, staging, and performance quality. Administered using a 7-point response scale ranging from 1 (Not at all important) to 7 (Extremely important), the AAI-EQ yields an overall composite index via either summing or averaging item responses. Initial psychometric evaluation among 200 adult respondents recruited through Amazon Mechanical Turk established high internal consistency, robust structural integrity across both orthogonal (Varimax) and oblique (Oblimin) rotations in exploratory factor analysis (EFA), and strong discriminant validity against conceptually related constructs of ad authenticity and artistic novelty. This paper provides an exhaustive academic overview of the scale’s theoretical foundation, construct specification, validity evidence, psychometric reliability, dimensional structure, administration procedures, and research applications within marketing communication, media psychology, and consumer behavior.

2. Keywords

Executional Quality, Ad Attribute Importance, Advertising Effectiveness, Consumer-Generated Advertising, Production Value, Persuasion Knowledge Model, Signaling Theory, Psychometrics, Factor Analysis, Aesthetic Appraisal

3. Authors

The Ad Attribute Importance — Executional Quality scale was constructed and validated by a team of prominent consumer behavior and marketing scholars:

• Benjamin Lawrence, Ph.D. — Professor of Franchise Management and Marketing, Department of Marketing, J. Mack Robinson College of Business, Georgia State University, Atlanta, GA, USA. (Formerly at Babson College). Research specializations include marketing strategy, service ecosystems, retail networks, and consumer-brand relationships.
• Susan Fournier, Ph.D. — Allen Questrom Professor and Dean, Questrom School of Business, Boston University, Boston, MA, USA. An internationally recognized pioneer in brand relationship theory, consumer-brand engagement dynamics, brand risk management, and qualitative-quantitative multimethod psychometric modeling.
• Frédéric F. Brunel, Ph.D. — Professor of Marketing and Dean of Undergraduate Programs, Questrom School of Business, Boston University, Boston, MA, USA. Research focuses on consumer aesthetic evaluation, sensory marketing, product design evaluation, and the socio-cultural meanings embedded in digital and visual media.

4. Purpose

The primary purpose of the Ad Attribute Importance — Executional Quality (AAI-EQ) scale is to quantify individual differences in the evaluative weighting assigned to technical and formal production elements when consumers formulate attitudes toward an advertisement (Aad) and the featured brand (Ab). For decades, advertising research operated on the implicit assumption that professional, high-fidelity production values were uniformly advantageous. However, the emergence of decentralized digital media ecosystems, user-generated content (UGC), and consumer-generated advertising (CGA) challenged this paradigm by demonstrating that raw, unpolished, low-budget creative communications often outperform multi-million-dollar studio productions in driving engagement, viral dissemination, and trust.

To systematically investigate why and when low-fidelity advertising succeeds or fails relative to firm-created advertising, researchers required a psychometrically validated diagnostic instrument capable of capturing the subjective value consumers attach to formal production craft. The AAI-EQ decouples the technical execution of an ad from its conceptual brilliance or emotional sincerity. By measuring the salience of craft attributes, the instrument enables scholars and practitioners to:

• Identify consumer segments that rely heavily on executional quality heuristics as proxies for firm competence, product quality, and corporate legitimacy.
• Examine the moderating role of executional expectations across diverse media channels (e.g., polished Super Bowl television broadcasts versus organic TikTok or YouTube environments).
• Investigate how attributional mechanisms shift when consumers are informed that an advertisement was generated by a peer consumer versus a commercial enterprise.
• Prevent confounds in experimental marketing research by calibrating participant sensitivity to technical flaws, lighting disparities, and acoustic variations before exposing them to experimental ad stimuli.

5. Psychological Construct

The construct captured by the AAI-EQ is Executional Quality Attribute Importance, conceptualized as an evaluative cognitive schema governing the extent to which an individual views technical mastery and production resources as essential criteria for determining an advertisement’s overall quality and merit. Rather than measuring a respondent’s perception of a specific ad’s technical quality directly, the AAI-EQ captures the latent personal standard or decision weight allocated to technical craft in advertising appraisal.

The construct encompasses ten interrelated production dimensions, detailed below:

• Lighting: The deliberate orchestration of natural and artificial illumination, contrast ratios, and color temperature to establish mood, direct visual attention, and provide clear spatial delineation.
• Sound Quality: Acoustic clarity, dynamic range, and the absence of extraneous background noise, clipping, or harsh resonance in the recorded audio track.
• Camera Work / Cinematography: The technical execution of framing, focal depth, camera mobility (e.g., steadicam, dolly, crane movement), composition, and visual narrative pacing.
• Editing: The temporal syntax, shot continuity, pacing, montage coherence, and visual transitions that weave disparate takes into a cohesive audiovisual narrative.
• Quality of the Acting: The credibility, emotional resonance, nonverbal nuance, and dialogue delivery exhibited by the performers on screen.
• Special Effects: The integration of physical, visual, optical, or computer-generated imagery (CGI) that enhances narrative suspension of disbelief.
• Visual Clarity / High-Definition Quality: Image resolution, sharpness, texture rendering, and pixel density indicative of contemporary professional camera sensors and digital master copies.
• Voiceover Quality: The vocal modulation, timbre, diction, and emotional congruence of the off-screen narrator delivering persuasive copy.
• Music / Soundtrack Production: The arrangement, harmonic layering, mastering quality, and contextual synchronization of musical themes supporting the visual narrative.
• Set Design / Staging: The environmental architecture, spatial decoration, prop placement, and scenic backdrop that anchor the ad in a credible physical or metaphorical world.

Within cognitive psychology and sensory marketing, these attributes represent the formal sensory vehicle through which semantic meaning is delivered. Consumers high in this trait exhibit greater cognitive sensitivity to production errors (e.g., poor microphone placement, blown-out highlights, jarring cuts), viewing them as negative cues reflecting poorly on the communicator’s credibility or resource allocation.

6. Theoretical Framework

The conceptual foundation of the AAI-EQ is anchored in three major theoretical frameworks within social psychology, communication theory, and microeconomics:

1. The Persuasion Knowledge Model (PKM)

Proposed by Marian Friestad and Peter Wright (1994), the PKM posits that over time, consumers develop intuitive theories and structural knowledge regarding persuasion tactics used by marketers. Consumers utilize “agent knowledge” (beliefs about the traits and competencies of the message creator) and “tactic knowledge” (beliefs about why certain executional devices are deployed). In the context of the AAI-EQ, technical execution functions as an explicit persuasion tactic. Consumers who value executional quality interpret professional lighting, polished audio, and seamless editing as signals of an agent’s organizational capability and commitment to persuasion. Conversely, when consumers evaluate consumer-generated ads, their persuasion knowledge shifts; executional flaws may be reinterpreted not as incompetence, but as markers of non-commercial honesty and authentic self-expression.

2. Signaling Theory

Originating in information economics (Spence, 1973; Kirmani & Rao, 2000), signaling theory addresses communication under conditions of information asymmetry. Consumers cannot readily observe the true quality of a product prior to consumption. Consequently, high-expenditure advertising acts as a “costly signal” or bond guaranteeing the firm’s confidence in its offerings. Elaborate set design, cinematic camera work, and high-definition post-production communicate high financial investment that an unviable firm could not afford to replicate. The AAI-EQ measures the subjective psychological resonance of this costly signal: individuals scoring high on the scale rely extensively on high-cost production cues as diagnostic heuristics of product dependability.

3. The Elaboration Likelihood Model (ELM)

Formulated by Richard Petty and John Cacioppo (1986), the ELM details two distinct routes to persuasion: central and peripheral. Technical production cues (e.g., musical mastering, lighting polish) typically operate as peripheral cues under conditions of low elaboration, generating positive affective reactions through sensory gratification. However, under high elaboration conditions—or among individuals with high aesthetic or production expertise—executional quality is evaluated systematically as an argument for the brand’s aesthetic standards and engineering precision. The AAI-EQ captures the cognitive relevance of these cues across processing conditions.

7. Validity

The psychometric validity of the AAI-EQ was rigorously examined by Lawrence, Fournier, and Brunel (2013) across multiple empirical stages:

Construct and Content Validity

Content validity was established through an exhaustive qualitative and quantitative item generation protocol. The initial attribute pool comprised 17 candidate items derived from classic advertising characteristics literature (e.g., Stewart & Furse, 1986; Wells et al., 1971). Expert panels in marketing and visual communication screened the items to ensure balanced coverage of auditory, visual, spatial, and dramatic production disciplines. Ambiguous phrasing was eliminated, resulting in clear, standardized attribute labels.

Discriminant Validity

Discriminant validity was established via exploratory factor analysis. When the 17-item attribute importance battery was analyzed, items measuring technical execution loaded cleanly onto a primary factor separate from items measuring Artistic Originality (e.g., novelty, uniqueness, creative vision) and Authenticity (e.g., real-life resonance, genuine emotion, unscripted sincerity). Inter-factor correlations between Executional Quality and Authenticity were moderate to low ($r < .35$), confirming that consumers maintain distinct cognitive schemas for technical craft versus narrative truth.

Predictive and Criterion Validity

Predictive validity was confirmed through moderation analyses of consumer evaluations of real-world advertisements. In the Lawrence et al. (2013) investigation, the AAI-EQ successfully moderated the relationship between ad source condition (consumer-generated vs. company-created) and overall ad attitude ($A_{ad}$). Specifically, when participants placed high importance on executional quality, the persuasion advantage typically enjoyed by consumer-generated ads diminished if the UGC displayed noticeable technical deficits. Conversely, among consumers who assigned low importance to executional quality, the presence of raw, imperfect production values did not penalize ad attitudes, and in several instances enhanced perceived source trustworthiness.

8. Reliability

The AAI-EQ demonstrates high internal consistency and measurement precision across empirical investigations:

• Internal Consistency: In the validation sample of 200 U.S. adults recruited through Amazon Mechanical Turk, the 10-item scale demonstrated high internal consistency, with a Cronbach’s alpha ($lpha$) exceeding .90 ($lpha = .92$). This indicates that the ten attributes reliably tap a shared latent construct of technical production importance.
• Item-Total Correlations: Corrected item-total correlations for all ten items surpassed the standard psychometric threshold of .50, with values ranging from .61 to .81, confirming that no single item introduced excessive error variance or structural distortion.
• Split-Half and Composite Reliability: Subsequent investigations utilizing structural equation modeling (SEM) frameworks have reported composite reliability (Raykov’s $
  ho$ / McDonald’s $\omega$) values ranging between .91 and .94, confirming strong latent construct reliability and minimal attenuation due to random measurement error.
• Test-Retest Stability: While conceived as an evaluative trait susceptible to context effects across product categories, short-term test-retest assessments (over a two-week interval) have yielded stability coefficients ($r_{tt}$) above .82, indicating stable individual baseline orientations toward advertising craft.

9. Factor Analysis

The dimensional structure of the AAI-EQ was derived through exploratory factor analysis (EFA) conducted on a 17-item candidate pool measuring ad attribute importance:

Extraction and Rotation Procedures

Prior to extraction, sampling adequacy and data factorability were verified. The Kaiser-Meyer-Olkin (KMO) measure exceeded .88, and Bartlett’s Test of Sphericity reached statistical significance ($p < .001$), confirming substantial shared variance among items. Principal Axis Factoring (PAF) and Maximum Likelihood (ML) extractions were conducted, applying both orthogonal (Varimax) and oblique (Promax / Direct Oblimin) rotations to accommodate potential correlations among underlying advertising dimensions.

Factor Solution and Loadings

The EFA yielded a three-factor solution based on the Kaiser criterion (eigenvalues > 1.0) and visual inspection of Cattell’s scree plot, which showed a clear inflection point after the third factor:

1. Factor 1: Executional Quality (AAI-EQ): Accounted for the largest share of common variance (over 42%). All ten focal items exhibited primary factor loadings exceeding .60, with negligible cross-loadings (< .28) on remaining factors. High-loading items included visual clarity, camera work, lighting, and sound quality.
2. Factor 2: Artistic Originality: Captured items related to unconventional creative angles, avant-garde storytelling, and stylistic unpredictability.
3. Factor 3: Authenticity: Captured items related to relatable characters, emotional vulnerability, realism, and spontaneous unscripted engagement.

Subsequent confirmatory factor analyses (CFA) across replication datasets have supported a unidimensional model for the 10-item executional quality subscale, yielding acceptable global fit indices ($\chi^2/df < 2.5$, Comparative Fit Index $[ ext{CFI}] ge .95$, Tucker-Lewis Index $[ ext{TLI}] ge .94$, Root Mean Square Error of Approximation $[ ext{RMSEA}] le .06$, and Standardized Root Mean Square Residual $[ ext{SRMR}] le .04$).

10. Instrument / Measurement Tool

• Instrument Name: Ad Attribute Importance — Executional Quality (AAI-EQ)
• Construct Measured: Consumer evaluative weighting of craft-level technical production attributes in advertising appraisal
• Authors: Benjamin Lawrence, Susan Fournier, and Frédéric Brunel
• Publication Year: 2013
• Target Population: General adult consumers, media audiences, market research panels
• Administration Format: Self-administered paper-and-pencil or computerized questionnaire (web-based surveys, Qualtrics, MTurk, Prolific)
• Time Required: Approximately 2 to 3 minutes
• Item Count: 10 items
• Response Scale: 7-point unipolar response scale:
  • 1 = Not at all important
  • 2 = Low importance
  • 3 = Slightly important
  • 4 = Neutral / Moderately important
  • 5 = Important
  • 6 = Very important
  • 7 = Extremely important
• Scoring Protocol: All items are positively keyed (unipolar). An overall composite score is computed by calculating the arithmetic mean across all 10 items (ranging from 1.0 to 7.0) or by calculating the sum score (ranging from 10 to 70). Higher scores reflect greater reliance on formal technical production values when judging advertising quality.

11. Permissions & Fee and Test Year

The Ad Attribute Importance — Executional Quality scale was published in 2013 in the Journal of Advertising (Volume 42, Issue 4). The instrument is copyrighted by the American Academy of Advertising and Taylor & Francis Group. The scale items and scoring methodology are accessible within the published academic article for non-commercial educational, scientific, and psychometric research purposes under standard academic fair use provisions. Researchers wishing to deploy the scale within commercial advertising pre-testing platforms, syndicated brand trackers, or proprietary market research software should contact the lead authors and the publisher to determine appropriate licensing terms.

12. References

• Friestad, M., & Wright, P. (1994). The Persuasion Knowledge Model: How people cope with persuasion attempts. Journal of Consumer Research, 21(1), 1–31. https://doi.org/10.1086/209380
• Kirmani, A., & Rao, A. R. (2000). No pain, no gain: A critical review of the literature on signaling unobservable product quality. Journal of Marketing, 64(2), 66–79. https://doi.org/10.1509/jmkg.64.2.66.18000
• Lawrence, B., Fournier, S., & Brunel, F. (2013). When companies don’t make the ad: A multimethod inquiry into the differential effectiveness of consumer-generated advertising. Journal of Advertising, 42(4), 292–307. https://doi.org/10.1080/00913367.2013.795120
• Petty, R. E., & Cacioppo, J. T. (1986). The Elaboration Likelihood Model of persuasion. Advances in Experimental Social Psychology, 19, 123–205. https://doi.org/10.1016/S0065-2601(08)60214-2
• Spence, M. (1973). Job market signaling. The Quarterly Journal of Economics, 87(3), 355–374. https://doi.org/10.2307/1882010
• Stewart, D. W., & Furse, D. H. (1986). Effective television advertising: A study of 1000 commercials. Lexington Books.
• Wells, W. D., Leavitt, C., & McConville, M. (1971). A reaction profile for TV commercials. Journal of Advertising Research, 11(6), 11–17.

13. Items of the Scale