I will continue to post mementos and, at times, short excerpts following the pace of one “Tour” a week, in sync with some book clubs reading *Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars* (SIST or Statinfast 2018, CUP), e.g., Lakens. This puts us at Excursion 2 Tour I, but first, here’s a quick Souvenir (Souvenir C) from Excursion 1 Tour II:

Souvenir C: A Severe Tester’s Translation GuideJust as in ordinary museum shops, our souvenir literature often probes treasures that you didn’t get to visit at all. Here’s an example of that, and you’ll need it going forward. There’s a confusion about what’s being done when the significance tester considers the set of all of the outcomes leading to a d(

) greater than or equal to 1.96, i.e., {xx: d() ≥ 1.96}, or just d(x) ≥ 1.96. This is generally viewed as throwing away the particularx, and lumping all these outcomes together. What’s really happening, according to the severe tester, is quite different. What’s actually being signified is that we are interested in the method, not just the particular outcome. Those who embrace the LP make it very plain that data-dependent selections and stopping rules drop out. To get them to drop in, we signal an interest in what the test procedurexwouldhaveyielded. This is a counterfactual and is altogether essential in expressing the properties of the method, in particular, the probability it would have yielded some nominally significant outcomeorother. Continue reading