Ad Creative Testing
Test advertising creatives before launch to optimize performance and avoid costly mistakes. Quali-Fi's ad testing tools help you measure viewer reactions, recall, and purchase intent.
What is Ad Testing?
Ad testing evaluates creative content before or during campaigns:
- Pre-launch Testing - Test concepts before spending
- In-flight Optimization - Improve running campaigns
- Competitive Analysis - Compare against competitors
- Creative Iteration - Refine based on feedback
Test Types
| Test Type | Purpose | Duration |
|---|---|---|
| Quick Reaction | Immediate impressions | 5 min |
| Detailed Evaluation | In-depth feedback | 15-20 min |
| A/B Comparison | Head-to-head testing | 10 min |
| Recall Study | Memory and recognition | 10 min |
Creating an Ad Test
Start the Test Builder
Go to Ad Testing → Create Test or add from a project.
Upload Creative Assets
Add the ads you want to test:
Supported Formats:
- Images (JPG, PNG, GIF)
- Videos (MP4, MOV up to 2 min)
- Audio (MP3 for radio ads)
- Documents (PDF for print ads)
Configure Exposure Settings
Set how participants view ads:
- Exposure Time - How long they see each ad
- Forced View - Must watch full duration
- Multiple Exposures - Repeat viewing
- Context - Where ad would appear (social, TV, etc.)
Select Metrics
Choose what to measure:
- Recall and recognition
- Emotional response
- Purchase intent
- Brand perception
- Message comprehension
Define Audience
Target specific demographics:
- Age ranges
- Gender
- Location
- Category users
- Brand awareness levels
Launch Test
- Preview the test flow
- Set sample size
- Launch to panel
Key Metrics
Recall Metrics
| Metric | Description |
|---|---|
| Unaided Recall | Can name brand without prompting |
| Aided Recall | Recognizes brand from list |
| Message Recall | Remembers key message |
| Visual Recall | Remembers visual elements |
Emotional Response
Measure how viewers feel:
Emotions Tracked:
- Joy/happiness
- Surprise
- Trust
- Interest
- Confusion
- Skepticism
Purchase Intent
| Question | Scale |
|---|---|
| "How likely to purchase?" | 1-10 |
| "How likely to consider?" | 1-10 |
| "Would you recommend?" | 1-10 |
Brand Lift
Measure impact on brand perception:
- Awareness change
- Favorability shift
- Consideration increase
- Preference movement
A/B Testing
Setting Up Comparisons
Test multiple versions:
Upload Version A and Version B
Choose comparison method:
- Sequential - See one, then the other
- Side-by-side - View simultaneously
- Monadic - Each person sees only one
Set randomization to eliminate order bias
Compare results with statistical significance
Best Practices
Do:
- Test one variable at a time
- Ensure sufficient sample size (n≥100 per cell)
- Use randomization
- Consider context effects
Don't:
- Test too many variants at once
- Draw conclusions from small samples
- Ignore statistical significance
- Forget to test control groups
Question Types
Standard Questions
Pre-built questions for ad testing:
First Impressions:
- "What is your first impression of this ad?"
- "How does this ad make you feel?"
Brand Connection:
- "Which brand is this ad for?"
- "How well does this fit the brand?"
Message:
- "What is the main message?"
- "How believable is this ad?"
Action:
- "What would you do after seeing this?"
- "How likely are you to..."
Custom Questions
Add your own questions:
- Open-ended for qualitative feedback
- Rating scales for quantitative data
- Multiple choice for specific options
Tip
Include at least one open-ended question to capture unexpected insights that structured questions might miss.
Analyzing Results
Results Dashboard
Key Views:
- Overall scores
- Metric breakdowns
- Segment comparisons
- Open-ended themes
Comparative Analysis
Compare across:
- Different creatives
- Audience segments
- Historical tests
- Industry benchmarks
Statistical Significance
Quali-Fi calculates significance:
Ad A: 65% recall (n=150)
Ad B: 58% recall (n=148)
Difference: 7 points
Confidence: 95%
Significant: YesNote
Wait for sufficient responses before drawing conclusions. Statistical significance requires adequate sample sizes.
Reporting
Automated Reports
Generate reports including:
- Executive summary
- Metric scorecards
- Creative comparisons
- Verbatim highlights
- Recommendations
Export Options
| Format | Contents |
|---|---|
| Full formatted report | |
| PowerPoint | Presentation slides |
| Excel | Raw data and charts |
| Video Clips | Reaction recordings |
Best Practices
Sample Size Guidelines
| Test Type | Minimum | Recommended |
|---|---|---|
| Quick reaction | 50 | 100 |
| Detailed evaluation | 100 | 200 |
| A/B comparison | 100/cell | 200/cell |
| Segment analysis | 50/segment | 100/segment |
Testing Timeline
Allow enough time:
- Recruitment: 1-2 days for panel
- Fieldwork: 2-5 days
- Analysis: 1-2 days
- Total: Plan for 1-2 weeks
Iteration
Use results to improve:
- Test initial concepts
- Identify weaknesses
- Revise creative
- Re-test refined versions
- Launch winning creative
Next Steps
- Ad Testing Guide - Metrics and competitive comparisons
- Activity Translations - Translate activity content for multi-language experiences