Share good ideas and conversation.   Login, Join Us, or Take a Tour!
comment

Null hypotheses aren't inherently bad if n is large and the researchers apply the correct test.

Part of the trouble comes with when they:

- Don't define their tests in advance (We looked at the data and then decided to apply a one-tailed t-test between these groups)

- Test multiple hypotheses testing (Is this subgroup A significantly different from subgroup B? What about A and C? B and C?)

- Use the wrong type of test (i.e. t-test on a population that isn't normally distributed)

Previous to mk's post, I'd have said (1) fix the issues above, (2) report the confidence interval instead, or (3) look at the data for "obvious" changes. Apparently (2) is problematic, too, so others may have a better answer >_>