Skip to content

Episode Notes

USMLE purpose: Interpret effect size and drug-ad statistics without getting distracted by abstract formatting.

How to use this page

  1. Identify the outcome and comparator.
  2. Check the point estimate and confidence interval.
  3. Ask whether the CI crosses the no-effect value.
  4. Translate effect size into clinical meaning.
Episode metadata
FieldDetails
EpisodeRandy Neil Biostats 27
TopicEffect size and drug ad information
Runtime9 min
Published2024-02-04
SourceOpen YouTube video

One-liner

Drug-ad questions usually test whether the result is statistically significant, clinically meaningful, and supported by the actual data.

Drug-ad interpretation table

Data shownNo-effect valueSignificance rule
Relative risk / odds ratio / hazard ratio1CI crossing 1 = not significant
Mean difference0CI crossing 0 = not significant
P value0.05p < 0.05 usually significant
NNTLower is usually strongerNNT = 1 / ARR

Board-style decision workflow

  1. Identify the statistic: RR/OR/HR, mean difference, p value, ARR, or NNT.
  2. Check the no-effect value: 1 for ratios, 0 for differences.
  3. Check statistical significance: CI must not cross the no-effect value.
  4. Check clinical meaning: statistically significant does not always mean clinically meaningful.

Anki-style rapid recall

For RR/OR/HR, what CI value means “no difference”?
For a mean difference, what CI value means “no difference”?

Zero.

What is NNT?

Number needed to treat = 1 / absolute risk reduction.

Practice Question

A drug has RR 0.82 with 95% CI 0.60–1.10. What is the best interpretation?

  • A) Significant risk reduction
  • B) Significant risk increase
  • C) Not statistically significant
  • D) NNT is 0.82
Reveal answer & explanation

Answer: C) Not statistically significant

The confidence interval crosses 1, so the result could represent no difference.

Extra practice

A trial reports a mean difference of -2.5 with 95% CI -5.0 to 0.8. Is the result statistically significant?

Reveal answer & explanation

No. For mean differences, the no-effect value is 0. Because the CI crosses 0, the result is not statistically significant.

Quick Reference Summary

StatisticNo-effect valueIf CI crosses it
RR / OR / HR1Not statistically significant
Mean difference0Not statistically significant
NNTCalculated from ARRRequires meaningful absolute risk difference