Hacker News new | past | comments | ask | show | jobs | submit login

Your answer is good and sufficient. For people who aren't yet getting an intuitive feel: if 99% confidence means you're right 99% of the time (it doesn't quite mean that but lets go with it), then you'll still be wrong 1% of the time. If 3000 studies are published each year with that cutoff for significance, you should expect about 30 spurious results accepted as true each year. Ouch.



That reasoning neglects the bias towards papers with interesting results, which leads to a much higher rate of false reports in hot journals.


In human genetics, studies will meta-analyze each of the ~million SNPs tested across each study, rather than just picking the "candidate" SNPs that came to attention because of their association signal in any particular study. So the file drawer problem is still relevant, but the risk is greatly mitigated.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: