Top all-time · #23687
Lukas Vermeer
Personal blog · lukasvermeer.nl/publicationsdatasciencewriting
Lukas Vermeer's personal blog at lukasvermeer.nl covers data, science and writing. Since 2021, 3 different Hacker News readers have linked it 3 times. It is still writing: the last post was on 2026-09-02, and you can follow it by feed.
Too few sampled comments (1) to say how often HN recommends it.?
Why HN links it
Linked in a thread on A/B test significance with a small traffic budget, covering how to reach statistical significance with limited traffic. A commenter disputes its treatment of multiple comparisons.
Summarised by Claude from a sample of 1 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Helping people run experiments to make better products for their customers. I explain science using historical narratives and teach statistics through storytelling.
What Hacker News says?
You are confusing: a. the Family-Wise Error Rate (FWER what xkcd 882 is about) and the many solutions of Multiple Comparison Correction (MCC: Bonferoni, Homes-Sidak, Benjamini-Hochberg, etc.) with b. Contamination or Interaction: your two variants are not equivalent because one has 52% of its members part of Control from another experiment, while the other variant has 48%. FWER is a common concern among statistician…
Comment linking /publications/2023/04/04/avoiding-interaction-effects-in-online-experimentation.html
on “Getting to Statistical Significance on a Shoestring Traffic Budget”Submitted Gmail Inbox is my to-do-list as a story · 6 points
HN discussionSubmitted So You Think You Can Test? as a story · 1 points
HN discussion