From Nature: “Australian funding agency turns a blind eye to evidence”
7 March 2017
Nature Picture Library / Alamy Stock Photo
Australia’s main science funder is not taking an evidence-based approach in reforms to its system of funding allocation. Instead it is courting expert opinion, the lowest level of evidence quality, to guide its decision.
The National Health and Medical Research Council (NHMRC) in Australia funds research for the benefit of human health, usually by providing financial resources for scientists to collect data, run experiments and examine the evidence.
But, in trying to find the best way to allocate funds, the NHMRC has so far failed to cite any published experiments on funding. A 64-page consultation paper released last year that proposed three alternative models — funding individuals, teams or ideas — did not include a single citation to published work.
More than 300 expert opinions were summarised and published last week. Not surprisingly, “the feedback provided was diverse with no clear preference for one of the alternative models”.
The review, prompted by rising application numbers, falling success rates and plummeting morale amongst researchers, is welcome. But a summary of the current evidence may have led to a more useful discussion.
Studies have been carried out that could inform an evidence-based discussion of funding policy, and are directly pertinent to the three proposed models. For example, a study of a new funding system in France examining more than €10 billion in research funding over five years, found that funding younger applicants had a much larger impact on research output.
Another study in Canada revealed that it was more effective to divide funding into multiple small grants rather than large grants. Two $1 million dollar grants generally produce more research than one $2 million dollar grant. Other studies have examined the important question of whether current funding systems discourage innovative applications.
There is even evidence from within the NHMRC. Our research group worked with the NHMRC in 2013 to conduct a randomised trial to examine the level of agreement between independent peer reviewers of grant applications and found concurrence was higher when reviewers examined people compared with projects.
This has a clear policy implication, suggesting a strong case for putting more money into people as that money would more reliably go to high-quality research.
Without systematically examining the evidence we are left to rely on expert opinion, which can be wrong. For example, many have predicted that a funding round with no deadlines would create an avalanche of applications. But a recent trial by the National Science Foundation in the United States found a 59% reduction in applications.
The studies of funding mentioned here are the tip of the iceberg. A group in the United Kingdom recently searched for published evidence on the best designs for funding systems and found more than 1,700 references.
Ignoring evidence means we risk changing Australia’s national funding policy to a system that has already been trialled and failed elsewhere. The opinions of the research community are important when making such a big change, but researchers also appreciate seeing published evidence.
See the full article here .
Please help promote STEM in your local schools.
Nature is a weekly international journal publishing the finest peer-reviewed research in all fields of science and technology on the basis of its originality, importance, interdisciplinary interest, timeliness, accessibility, elegance and surprising conclusions. Nature also provides rapid, authoritative, insightful and arresting news and interpretation of topical and coming trends affecting science, scientists and the wider public.