a thoughtful web.
Good ideas and conversation. No ads, no tracking.   Login or Take a Tour!
comment by thelittlepea

> 5. Stricter p-value criteria. It is far too easy to massage p-values to get less than 0.05. Also, make meta-analyses look for “p-hacking” by examining the distribution of p-values in the included studies.

> 10. Stricter effect size criteria. It’s easy to get small effect sizes in anything.

I agree with the rest, but the commandment 10. does not seem right. You can (5) require high p-values as high as you want. But if you find even the tiniest of effects that does not go away, that is important. In fact, I would say "It’s easy to get small effect sizes in anything" is a misunderstanding (unless the author is claiming the effect due to chance, in which case, the required p-value should be higher, not the effect size).