Share good ideas and conversation.   Login, Join Us, or Take a Tour!
comment

Just as Dendrophobe said, I only know NHST.

thundara suggested to increase the n-number. What about if someone sees a difference after repeating the test 3 times but did not get a significant result using any test? He then decided to repeat the experiment two more times and surprise surprise, the p value is under 0.05.

Is that considered p-value hacking?

Edit: I just checked the reddit frontpage and found this. A randomized double-blind placebo-controlled study on celiac sensitivity.

The p-value was p=0.034 and the money shot is this figure

Now the reddit hive-mind is going against the results. Funny that the community usually considered mainly skeptic also believes what they want to believe.