Editor’s note: guest post from Neuroscience graduate student Erica Landis.
Neuroscience graduate student Erica Landis
Evidence is increasing that lack of reproducibility, whatever the cause, is a systemic problem in biomedical science. While institutions like the NIH and concerned journal editors are making efforts to implement more stringent requirements for rigorous and reproducible research, scientists themselves must make conscious efforts to avoid common pitfalls of scientific research. Here at Emory, several scientists are making greater efforts to push forward to improve scientific research and combat what is being called “the reproducibility crisis.”
In 2012, C. Glenn Begley, then a scientist with the pharmaceutical company Amgen, published a commentary in Nature on his growing concern for the reproducibility of preclinical research. Begley and his colleagues had attempted to replicate 53 published studies they identified as relevant to their own research into potential pharmaceuticals. They found that only 6 of the 53 publications could be replicated; even with help from the original authors. Similar studies have consistently found that greater than 50 percent of published studies could not be replicated. This sparked a period of great concern and questioning for scientists. It seemed to Begley and others that experimenter bias, carelessness, poor understanding of statistics, and the career-dependent scramble to publish contributes to a misuse of the scientific method. These factors contribute to what is now called the reproducibility crisis. In April 2017, Richard Harris published Rigor Mortis, a survey of the problem in preclinical research, which has kept the conversation going and left many wondering what the best solution to these issues could be. To combat the reproducibility crisis, Harris argues that funding agencies, journal editors and reviewers, research institutions, and scientists themselves all have a role to play.