intermediate
Featured

Ad Creative Testing

Test ad creatives and measure performance metrics

10 min readUpdated January 20, 2026

Ad Creative Testing

Test advertising creatives before launch to optimize performance and avoid costly mistakes. Quali-Fi's ad testing tools help you measure viewer reactions, recall, and purchase intent.

What is Ad Testing?

Ad testing evaluates creative content before or during campaigns:

  • Pre-launch Testing - Test concepts before spending
  • In-flight Optimization - Improve running campaigns
  • Competitive Analysis - Compare against competitors
  • Creative Iteration - Refine based on feedback

Test Types

Test TypePurposeDuration
Quick ReactionImmediate impressions5 min
Detailed EvaluationIn-depth feedback15-20 min
A/B ComparisonHead-to-head testing10 min
Recall StudyMemory and recognition10 min

Creating an Ad Test

1

Start the Test Builder

Go to Ad Testing → Create Test or add from a project.

2

Upload Creative Assets

Add the ads you want to test:

Supported Formats:

  • Images (JPG, PNG, GIF)
  • Videos (MP4, MOV up to 2 min)
  • Audio (MP3 for radio ads)
  • Documents (PDF for print ads)
3

Configure Exposure Settings

Set how participants view ads:

  • Exposure Time - How long they see each ad
  • Forced View - Must watch full duration
  • Multiple Exposures - Repeat viewing
  • Context - Where ad would appear (social, TV, etc.)
4

Select Metrics

Choose what to measure:

  • Recall and recognition
  • Emotional response
  • Purchase intent
  • Brand perception
  • Message comprehension
5

Define Audience

Target specific demographics:

  • Age ranges
  • Gender
  • Location
  • Category users
  • Brand awareness levels
6

Launch Test

  1. Preview the test flow
  2. Set sample size
  3. Launch to panel

Key Metrics

Recall Metrics

MetricDescription
Unaided RecallCan name brand without prompting
Aided RecallRecognizes brand from list
Message RecallRemembers key message
Visual RecallRemembers visual elements

Emotional Response

Measure how viewers feel:

Emotions Tracked:

  • Joy/happiness
  • Surprise
  • Trust
  • Interest
  • Confusion
  • Skepticism

Purchase Intent

QuestionScale
"How likely to purchase?"1-10
"How likely to consider?"1-10
"Would you recommend?"1-10

Brand Lift

Measure impact on brand perception:

  • Awareness change
  • Favorability shift
  • Consideration increase
  • Preference movement

A/B Testing

Setting Up Comparisons

Test multiple versions:

1

Upload Version A and Version B

2

Choose comparison method:

  • Sequential - See one, then the other
  • Side-by-side - View simultaneously
  • Monadic - Each person sees only one
3

Set randomization to eliminate order bias

4

Compare results with statistical significance

Best Practices

Do:

  • Test one variable at a time
  • Ensure sufficient sample size (n≥100 per cell)
  • Use randomization
  • Consider context effects

Don't:

  • Test too many variants at once
  • Draw conclusions from small samples
  • Ignore statistical significance
  • Forget to test control groups

Question Types

Standard Questions

Pre-built questions for ad testing:

First Impressions:

  • "What is your first impression of this ad?"
  • "How does this ad make you feel?"

Brand Connection:

  • "Which brand is this ad for?"
  • "How well does this fit the brand?"

Message:

  • "What is the main message?"
  • "How believable is this ad?"

Action:

  • "What would you do after seeing this?"
  • "How likely are you to..."

Custom Questions

Add your own questions:

  • Open-ended for qualitative feedback
  • Rating scales for quantitative data
  • Multiple choice for specific options

Tip

Include at least one open-ended question to capture unexpected insights that structured questions might miss.

Analyzing Results

Results Dashboard

Key Views:

  • Overall scores
  • Metric breakdowns
  • Segment comparisons
  • Open-ended themes

Comparative Analysis

Compare across:

  • Different creatives
  • Audience segments
  • Historical tests
  • Industry benchmarks

Statistical Significance

Quali-Fi calculates significance:

Ad A: 65% recall (n=150)
Ad B: 58% recall (n=148)
Difference: 7 points
Confidence: 95%
Significant: Yes

Note

Wait for sufficient responses before drawing conclusions. Statistical significance requires adequate sample sizes.

Reporting

Automated Reports

Generate reports including:

  • Executive summary
  • Metric scorecards
  • Creative comparisons
  • Verbatim highlights
  • Recommendations

Export Options

FormatContents
PDFFull formatted report
PowerPointPresentation slides
ExcelRaw data and charts
Video ClipsReaction recordings

Best Practices

Sample Size Guidelines

Test TypeMinimumRecommended
Quick reaction50100
Detailed evaluation100200
A/B comparison100/cell200/cell
Segment analysis50/segment100/segment

Testing Timeline

Allow enough time:

  • Recruitment: 1-2 days for panel
  • Fieldwork: 2-5 days
  • Analysis: 1-2 days
  • Total: Plan for 1-2 weeks

Iteration

Use results to improve:

  1. Test initial concepts
  2. Identify weaknesses
  3. Revise creative
  4. Re-test refined versions
  5. Launch winning creative

Next Steps

Was this article helpful?