How should we test creative on TikTok?
Our answer
Test new concepts, not small edits. Keep 3 to 5 clearly different videos in each live ad group, and judge them on cost per purchase at about 10 conversions a day. Save TikTok's built-in A/B test for one big question.
- Confidence
- Medium
- Strongest proof
- 5 TikTok rules
- 6 practitioners, 4 opinions or claims
- Sources
- 10 sources
- 15 statements
- T
New here? Take the 1-minute tour
Why this is the answer
3 reasons and our judgmentVery different creatives make better tests. TikTok says so, and tells you to add new ones to an existing ad group when refreshing. Smart+ delivers the best combinations itself and reports results by creative (TikTok).
Judge each test on cost per conversion, as RocketShip HQ, a mobile app user acquisition agency, does, ideally at 10 conversions a day. Savannah Sanchez, a UGC creative agency founder, tests two written and two visual hooks per concept, with different creators.
TikTok's built-in A/B test suits one clean question at a time. It needs at least 7 days and a budget giving 80% power (TikTok).
Our judgment
Lean toward testing inside the campaigns already running rather than in a separate testing campaign. That follows TikTok's refresh advice, Smart+'s automatic delivery of the best combinations, AdManage.ai and Segwise handing creative testing to Smart+, and the same answer for Meta (Where to test new creative). Judge a test on cost per purchase once it has enough conversions, going by RocketShip HQ's conversion rule, and use hook rate and click-through rate only to diagnose. AdRate warns that click-through rate alone rewards curiosity. Use organic and Spark Ads results as a cheap first screen before paid testing.
Our judgment, built from TikTok, AdManage.ai, Segwise, RocketShip HQ, AdRate, Jetfuel Agency and Eva: our reading of these sources, not a finding from any one of them.
What the sources say
15 statements from 10 sourcesRocketShip HQ, which sells app user acquisition, says to test distinct creative ideas with several versions each, judge winners on results rather than hook rate or CTR, and keep testing and scaling campaigns apart.
“One file per idea tells you about that file, not the idea.”
Shamanth Rao of RocketShip HQ says TikTok's creative counts per ad group are starting points, not rules. What matters is enough conversions a day, ideally 10 per creative test.
“Those are capacity limits, not recommended test sizes.”
AdManage.ai, which sells ad launching software, says TikTok's Smart+ raises the need for creative volume because it uses up assets faster, calling 20 variations a week a reasonable pace. No data.
“Adopting Smart+ increases your need for creative volume rather than decreasing it.”
TikTok's upgraded Smart+ builds ads from combinations of your videos and texts and delivers the best automatically; each ad has its own URL, product set and up to 50 assets, with creative-level reporting.
“each ad functions like an asset group, with its own destination URL, product set, and up to 50 creative assets.”
Eva, a TikTok Shop agency, suggests testing 6 to 10 organic posts as Spark Ads over 14 days, mixing demos, objection handling, social proof and offers, then scaling the best 2 or 3. No data.
“Start with a portfolio of posts instead of one creative.”
zeroto1, which sells TikTok Shop services, recruits creators into the shop, picks winners by GMV per video and licenses them for ads. One client's top creator was a welder with 17,600 followers.
“Nobody picks a welder off a media kit, either.”
Stackmatix, which manages TikTok ads, recommends one campaign per objective, 3 to 5 ad groups split by audience and 3 to 5 creatives in each, and never mixing prospecting and retargeting. It shows no results.
“never mix prospecting and retargeting in a single campaign.”
Jetfuel, an agency selling TikTok ad management, tells food and beverage brands to seed micro-creators and boost the best posts as Spark Ads, with 6 to 8 new assets a month. It shows no results.
“The highest-performing creative strategy for most F&B CPG brands on TikTok isn't brand-produced video. It's amplified creator content via Spark Ads.”
AdRate, which sells TikTok ad tools, says GMV Max doesn't give each video equal spend, so don't call under-delivered videos losers, and treat one strong low-spend day as a candidate, not a winner.
“Do not call an under-delivered video a loser.”
Savannah Sanchez says brands spending under $100K a month should test two written and two visual hook variations per concept, plus the same concept with different creators, and avoid repetitive AI scripts.
Segwise, which sells creative analytics, suggests a 7 to 14 day hybrid TikTok Smart+ test with 4 to 6 creatives and no major edits for 7 days, warning that locking too many segments hurts learning. No data.
“Locking too many segments reduces Smart+ learning efficiency, as managers risk overconstraining.”
TikTok's split tests divide the audience into two equal groups that each see only one ad group, and can test targeting, bidding, budget, creative, catalog or Smart+, at 90% confidence.
“Split testing ensures that each audience group will exclusively see one ad group to prevent Group A and B from competing directly for mutual audiences.”
TikTok advises split tests with clearly different settings, at least 7 days (30 at most), a broad audience, a budget giving at least 80% statistical power, and no setting changes once running.
“We recommend testing for a minimum of 7 days to obtain the most reliable results. Split Tests can run for a maximum of 30 days.”
TikTok suggests 3-5 clearly different creatives per ad group and 3-5 ad groups per campaign, and adding new creatives to an existing ad group when refreshing rather than starting a new one.
“When refreshing creatives, add new creatives to an existing ad group instead of creating a new ad group to extend its lifetime.”
TikTok's Smart+ web campaign guide says to add at least six creatives, run at least seven days, and set a daily budget of ideally 30 times historical CPA and no less than 10 times.
“You should ideally set a daily campaign budget of 30 times your historical CPA and no less than 10 times your historical CPA.”
In the full answer
For readers who sign in- What to do this week3 steps
- The numbers behind it3 figures from cited sources
- Where each source standsA chart placing each source on the question
- The strongest disagreementThe best case against the answer, from a cited source
- How sure we areWhat its confidence rests on, and what would change the answer