Stats & Probability
Experimentation
Designing, sizing, and not fooling yourself with A/B tests
A/B testing pitfalls
advancedPeeking, multiple testing, sample ratio mismatch, and novelty effects — the four standard ways a correctly-computed p-value still lies to you, and the checks that catch each one
12 minexperimentationab-testingmultiple-testingsrmCorrelation vs causation
coreWhy observed associations routinely reverse under intervention — confounders, Simpson's paradox with real numbers, and the ladder of methods (randomization first) for earning a causal claim
11 minexperimentationcausalityconfoundingExperiment design and power
corePower, MDE, and the sample-size calculation: per arm — how to size an A/B test before launch instead of explaining an inconclusive one after
12 minexperimentationpowersample-sizeab-testing