Daniel & Friends / Glossary / P-value
Research and dataP-value
The p-value is the probability of seeing a result as extreme as the one measured, or more extreme, if the null hypothesis (no real difference) were true. The lower it is, the harder it is to reconcile the data with the null hypothesis.
Daniel Votruba ·
In practice
A common mistake: p = 0.03 does not mean a 97 percent chance that variant B is better. Read it as a measure of how surprising the data are, and weigh the size of the difference too.
Related terms
- Statistical significance: Statistical significance indicates how likely it is that a difference or relationship in the data arose by chance.
- Confidence interval: A confidence interval is a range that, with a chosen level of confidence (most often 95 percent), contains the true value of a figure for the whole population.
- A/B test: An A/B test compares two versions, for example two headlines or two forms, by showing each to a different half of the visitors.
More terms in the group Research and data
Qualitative research · OKR (objectives and key results) · Quantitative research · North Star Metric · Questionnaire (survey) · Neuromarketing · Research panel · Mystery shopping · Respondent · Multivariate test (MVT) · Sample and representativeness · MaxDiff · Marketing research · Zero-party data · Legal basis for processing · Anonymization and pseudonymization · KPI (key performance indicator) · BI and dashboard · In-depth interview (IDI) · Big data · GDPR (General Data Protection Regulation) · CAWI, CATI and CAPI · Focus group · CDP (customer data platform)
Terms in practice
Need help putting them to work?
Terms are one thing, putting them to work is another. We go through which of them pay off for you and say so plainly. You get a first opinion for free and we reply within 24 hours.
Book a call