Innogen  ·  Publications  ·  Working papers
Negative results are disappearing

Fanelli, D

September 2011

eloquentscience.com/wp-content/uploads/2012/02/Fanelli12-NegativeResults.pdf

Abstract Concerns that the growing competition for funding and citations might distort
science are frequently discussed, but have not been verified directly. Of the hypothesized
problems, perhaps the most worrying is a worsening of positive-outcome bias. A system
that disfavours negative results not only distorts the scientific literature directly, but might
also discourage high-risk projects and pressure scientists to fabricate and falsify their data.
This study analysed over 4,600 papers published in all disciplines between 1990 and 2007,
measuring the frequency of papers that, having declared to have ‘‘tested’’ a hypothesis,
reported a positive support for it. The overall frequency of positive supports has grown
by over 22% between 1990 and 2007, with significant differences between disciplines
and countries. The increase was stronger in the social and some biomedical disciplines.
The United States had published, over the years, significantly fewer positive results than
Asian countries (and particularly Japan) but more than European countries (and in particular
the United Kingdom). Methodological artefacts cannot explain away these patterns,
which support the hypotheses that research is becoming less pioneering and/or that the
objectivity with which results are produced and published is decreasing.