Bad research rising: The 7th Olympiad of research on biomedical publication by Hilda Bastian at Scientific American
Why is there so much un-reproducible research? Ioannidis points to the many sources of bias in research. Chavalarias and he trawled through more than 17 million articles in PubMed and found discussion of 235 different kinds of bias. There is so much bias, he said, that it makes one of his dreams – an encyclopedia of bias – a supremely daunting task.
What would help? Ioannidis said we need to go back to considering what science is about: “If it is not just about having an interesting life or publishing papers, if it is about getting closer to the truth, then validation practices have to be at the core of what we do.” He suggested three ways forward: we have to get used to small genuine effects and not expect (and fall for) excessive claims. Secondly, we need to have – and use – research reporting standards. The third major strategy he advocates is registering research: protocols through to datasets.