TOOL
A-B test sample size sheet
๐ ๏ธ A-B test sample size sheet
๐ก Use Case
My own spreadsheet for one question: how many dispatchers per group before a difference of the size I care about could show up. Made for ๐ Design the triage A-B test, the first test I sized myself, from the approximation in ๐ Sample size for comparing two proportions.
โ๏ธ Pros & Cons
Pros
- four yellow cells (baseline, smallest difference worth having, significance, power) and one answer. Bao Nguyen checked it against his own and they agreed to the unit.
Cons
- the assumptions are spread over three tabs and I changed one without noticing. That is why it became a script two weeks later.
๐ Alternatives
- Bao. He is faster, but then I would not know where the number comes from.