Science’s Significant Stats Problem by Tom Siegfried at Nautilus
…in almost all research fields, studies often draw erroneous conclusions. Sometimes the errors arise because statistical tests are misused, misinterpreted, or misunderstood. And sometimes sloppiness, outright incompetence, or possibly fraud is to blame. But even research conducted strictly by the book frequently fails because of faulty statistical methods that have been embedded in the scientific process.
“There is increasing concern that in modern research, false findings may be the majority or even the vast majority of published research claims,” epidemiologist John P.A. Ioannidis declared in a landmark essay published in 2005 in the journal PLoS Medicine.
Even when a claimed effect does turn out to be correct, its magnitude is usually overstated. Columbia University political scientist and statistician Andrew Gelman puts it bluntly: “The scientific method that we love so much is a machine for generating exaggerations.”
Scanning Dead Salmon in fMRI Machine Highlights Risk of Red Herrings by Alexis Madrigal at Wired
The Internet Found the Atlantic Salmon at Prefrontal.org
None of the authors intended for the Salmon to go public in such a big way, especially before the commentary was reviewed and published. We were actually quite content to publish our editorial in a neuroimaging journal and be done with it. We feel that, fundamentally, this is an internal debate within the field of neuroimaging.