Results found: 1

Search results

Search:
in the keywords: pre-analysis plans

Sort By:

Limit search:

The Problem of New Evidence: P-Hacking and Pre-Analysis Plans

100%

Hitzig Z., Stegenga J.

Diametros

2020

vol. 17

issue 66

We provide a novel articulation of the epistemic peril of p-hacking using three resources from philosophy: predictivism, Bayesian confirmation theory, and model selection theory. We defend a nuanced position on p-hacking: p-hacking is sometimes, but not always, epistemically pernicious. Our argument requires a novel understanding of Bayesianism, since a standard criticism of Bayesian confirmation theory is that it cannot represent the influence of biased methods. We then turn to pre-analysis plans, a methodological device used to mitigate p-hacking. Some say that pre-analysis plans are epistemically meritorious while others deny this, and in practice pre-analysis plans are often violated. We resolve this debate with a modest defence of pre-analysis plans. Further, we argue that pre-analysis plans can be epistemically relevant even if the plan is not strictly followed—and suggest that allowing for flexible pre-analysis plans may be the best available policy option.

Refine search results

1 Diametros

1 Hitzig Z.

1 Stegenga J.

1 2020

Search results

The Problem of New Evidence: P-Hacking and Pre-Analysis Plans