Book a call

Daniel & Friends / Glossary / A/B test

Media and measurement

A/B test

An A/B test compares two versions, for example two headlines or two forms, by showing each to a different half of the visitors. The result is reliable only if the test runs long enough on a large enough sample.

Daniel Votruba ·


In practice

Test one change at a time and decide in advance how long the test will run. Stopping it when your favourite is ahead is a common mistake.

Read more: Growth & performance marketing

Related terms

  • Conversion and conversion rate: A conversion is the completion of a desired action, such as an order, an enquiry or a sign-up.
  • Incrementality: Incrementality is the extra result that would not have happened without the ad.
  • UTM parameters: UTM parameters are tags added to a link address, such as utm_source, utm_medium and utm_campaign.

More terms in the group Media and measurement

Ad break (commercial break) · A1 poster stand · Adstock (decay effect) · Wear-out (ad wear-out) · Agency commission · Ambient media · TV spot · Attribution · TRP (target rating point) · Audience share · Transit advertising · AVOD (advertising-based video on demand) · Trading desk · Bigboard · SVOD (subscription video on demand) · Billboard · Share of voice (SOV) · Brand lift · Share of search · Burst and drip · RTB (real-time bidding) · BVOD (broadcaster video on demand) · ROAS · CAC and LTV

Full glossary (590 terms)

Terms in practice

Need help putting them to work?

Terms are one thing, putting them to work is another. We go through which of them pay off for you and say so plainly. You get a first opinion for free and we reply within 24 hours.

Book a call

Enjoyed the article? Share it with friends.