Book a call

Daniel & Friends / Glossary / P-value

Research and data

P-value

The p-value is the probability of seeing a result as extreme as the one measured, or more extreme, if the null hypothesis (no real difference) were true. The lower it is, the harder it is to reconcile the data with the null hypothesis.

Daniel Votruba ·


In practice

A common mistake: p = 0.03 does not mean a 97 percent chance that variant B is better. Read it as a measure of how surprising the data are, and weigh the size of the difference too.

Related terms

  • Statistical significance: Statistical significance indicates how likely it is that a difference or relationship in the data arose by chance.
  • Confidence interval: A confidence interval is a range that, with a chosen level of confidence (most often 95 percent), contains the true value of a figure for the whole population.
  • A/B test: An A/B test compares two versions, for example two headlines or two forms, by showing each to a different half of the visitors.

More terms in the group Research and data

Qualitative research · OKR (objectives and key results) · Quantitative research · North Star Metric · Questionnaire (survey) · Neuromarketing · Research panel · Mystery shopping · Respondent · Multivariate test (MVT) · Sample and representativeness · MaxDiff · Marketing research · Zero-party data · Legal basis for processing · Anonymization and pseudonymization · KPI (key performance indicator) · BI and dashboard · In-depth interview (IDI) · Big data · GDPR (General Data Protection Regulation) · CAWI, CATI and CAPI · Focus group · CDP (customer data platform)

Full glossary (590 terms)

Terms in practice

Need help putting them to work?

Terms are one thing, putting them to work is another. We go through which of them pay off for you and say so plainly. You get a first opinion for free and we reply within 24 hours.

Book a call

Enjoyed the article? Share it with friends.