References

Last updated June 25th 2023.

AIASSA, E., HIGGINS, J. P. T., FRAMPTON, G. K., GREINER, M., AFONSO, A., AMZAL, B., DEEKS, J., DORNE, J. L., GLANVILLE, J., LÖVEI, G. L., NIENSTEDT, K., O’CONNOR, A. M., PULLIN, A. S., RAJIĆ, A. & VERLOO, D. 2015. Applicability and feasibility of systematic review for performing evidence-based risk assessment in food and feed safety. Critical Reviews in Food Science and Nutrition 55, 1026-1034.

ALTMAN, D.G. 1991. Measuring agreement. In: Altman D.G. (Ed.), Practical statistics for medical research. London: Chapman and Hall.

ARNQVIST, G. & WOOSTER, D. 1995. Meta-analysis: synthesizing research findings in ecology and evolution. Trends in Ecology & Evolution, 10, 236-240.

AUSTIN, P. C. 2011. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behavioural Research, 3, 399-424.

AVENELL, A., HANDOLL, H. & GRANT, A. 2001. Lessons for search strategies from a systematic review, in The Cochrane Library, of nutritional supplementation trials in patients after hip fracture. American Journal of Clinical Nutrition, 73, 505-510.

BAILEY, B. J. 2002. Duplicate publication in the field of otolaryngology-head and neck surgery. Otolaryngology Head and Neck Surgery, 126, 211-216.

BARDEN, J., EDWARDS, J. E., MCQUAY, H. J. & MOORE, R. A. 2003. Oral valdecoxib and injected parecoxib for acute postoperative pain: a quantitative systematic review. BMC Anesthesiology, 3, 1-1.

BAYLISS, H. R. & BEYER, F. R. 2015. Information retrieval for ecological syntheses. Research Synthesis Methods, 6,136-148.

BAYLISS, H. R., HADDAWAY, N. R., EALES, J., FRAMPTON, G. K. & JAMES, K. L. 2016. Updating and amending systematic reviews and systematic maps in environmental management. Environmental Evidence, 5, 20.

BAYLISS, H. R., SCHINDLER, S., ADAM, M., ESSL, F. & RABITSCH, W. 2017. Environmental Evidence, 6:21 

BERNARD, H.R., 2006. Research Methods in Anthropology: Qualitative and Quantitative Approaches. Altamira Press, Lanham, New York, Toronto, Oxford: Rowman & Littlefield Publishers, Inc.

BERNES, C., CARPENTER, S. R., GÅRDMARK, A., LARSSON, P., PERSSON, L., SKOV, C., SPEED, J. D. M. & VAN DONK, E. 2015. What is the influence of a reduction of planktivorous and benthivorous fish on water quality in temperate eutrophic lakes? A systematic review. Environmental Evidence 4:7

BOOTH, A. 2004. Formulating answerable questions. In: Booth, A. & Brice, A. (Eds.) Evidence-based practice: an information professional’s handbook.London: Facet.

BOOTH, A. 2010. How much searching is enough? Comprehensive versus optimal retrieval for technology assessments. International Journal of Technology Assessment in Health Care. 26(4), 431-435.

BORENSTEIN, M., HEDGES, L. V., HIGGINS, J. P. T. & ROTHSTEIN, H. R. 2009. Introduction to Meta-Analysis, John Wiley and Sons.

BOTTRILL, M., CHENG, S., GARSIDE, R., WONGBUSARAKUM, S., ROE, D., HOLLAND, M. B., EDMOND, J. & TURNER, W. R. 2014. What are the impacts of nature conservation interventions on human well-being: a systematic map protocol. Environmental Evidence 3, 16.

BOWLER, D., BUYUNG-ALI, L., KNIGHT, T., & PULLIN, A .S. 2009. The importance of nature for health: is there a specific benefit of contact with green space? Environmental Evidence: www.environmentalevidence.org/SR40.htm

BOWLER, D., BUYUNG-ALI L., KNIGHT, T. & PULLIN A. S. 2010. How effective is ‘greening’ of urban areas in reducing human exposure to ground level ozone concentrations, UV exposure and the ‘urban heat island effect’? Environmental Evidence: www.environmentalevidence.org/SR41.html

BRAMER, W. M., GIUSTINI, D., KRAMER, B. M. R. & ANDERSON, P. F. 2013. The comparative recall of Google Scholar versus PubMed in identical searches for biomedical systematic review: a review of searches used in systematic reviews. Systematic Reviews 2, 115.

BURFORD, B., LEWIN, S., WELCH, V., REHFUESS, E. & WATERS, E. 2013. Assessing the applicability of findings in systematic reviews of complex interventions can enhance the utility of reviews for decision making. Journal of Clinical Epidemiology, 66 (11), 1251-1261.

CENTRE FOR REVIEWS AND DISSEMINATION (CRD). 2009. Systematic Reviews. CRD’s Guidance for Undertaking Reviews in Health Care. York: CRD, University of York.

CHAN, A., HRÓBJARTSSON, A., HAAHR, M., GØTZSCHE, .P. & ALTMAN, D. 2004. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA;291,2457-65.

CHOI, W. S., SONG, S. W., OCK, S. M., KIM, C. M., LEE, J., CHANG, W. J. & KIM, S. H. 2014. Duplicate publication of articles used in meta-analysis in Korea. SpringerPlus, 3, 182.

COCHRAN, W. G. 1977. Sampling techniques, 3rd ed. New York, Wiley.

CORLETT, R. T. 2011. Trouble with the gray literature. Biotropica, 43, 3-5.

DAVIES, Z. G., TYLER, C., STEWART, G. B. & PULLIN, A. S. 2006. Are current management recommendations for conserving saproxylic invertebrates effective? CEE review 05-011 (SR17). Collaboration for Environmental Evidence: www.environmentalevidence.org/SR17.html.

DEEKS, J. J., HIGGINS, J. P. T. & ALTMAN, D. G. 2005. Analysing and presenting results. In: Higgins, J.P.T & Green, S. (Eds) Cochrane Handbook for Systematic Reviews of Interventions 4.2.5 [updated May 2005]; Section 8. (www.cochrane.org/resources/handbook/hbook.htm).

DEEKS JJ, HIGGINS JPT, ALTMAN DG 2022. Chapter 10: Analysing data and undertaking meta-analyses. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.3 (updated February 2022). Cochrane. Available from www.training.cochrane.org/handbook.

DICKERSIN, K. 2005. Publication bias: recognizing the problem, understanding its origins and scope, and preventing harm. In: Rothstein, H. R., Sutton, A. J. & Borenstein, M. (Eds.) Publication bias in meta-analysis: prevention, assessment, and adjustments. London: Wiley.

DEPARTMENT FOR ENVIRONMENT FOOD AND RURAL AFFAIRS (DEFRA). 2015. Emerging tools and techniques to deliver timely and cost effective evidence reviews. Final Report WT1552. London, DEFRA.

DOERR, E. D., DORROUGH, J., DAVIES, M. J., DOERR, V. A. J. & MCINTYRE, S. 2015. Maximising the value of systematic reviews in ecology when data or resources are limited. Austral Ecology, 40, 1-11.

EFSA (European Food and Safety Authority). 2010. Application of systematic review methodology to food and safety assessments to support decision making. EFSA Journal. 8(6), 1637.

EDWARDS, P., CLARKE, M., DIGUISEPPI, C., PRATAP, S., ROBERTS, I. & WENTZ, R. 2002. Identification of randomized controlled trials in systematic reviews: Accuracy and reliability of screening records. Statistics in Medicine,21, 1635-1640.

EGGER, M., DAVEY-SMITH, G., SCHNEIDER, M., & MINDER, C. 1997. Bias in meta-analysis detected by a simple, graphical test. BMJ, 315, 629-634.

ENGLUND, G., SARNELLE, O. & COOPER, S. D. 1999. The importance of data-selection criteria: meta-analyses of stream predation experiments. Ecology, 80,1132-1141.

FAZEY, I., SAILSBURY, J. G., LINDENMAYER, D. B., MAINDONALD, J. & DOUGLAS, R. 2004. Can methods applied in medicine be used to summarize and disseminate conservation research? Environmental Conservation, 31,190-198.

FELTON, A., KNIGHT, E., WOOD, J., ZAMMIT, C.& LINDENMAYER, D. B. 2010. A meta-analysis of fauna and flora species richness and abundance in plantations and pasture lands. CEE review 09-012 (SR73). Collaboration for Environmental Evidence: www.environmentalevidence.org/SR73.html.

FRAMPTON, G. K., LIVOREIL, B. & PETROKOFSKY, G. 2017. Eligibility screening in evidence synthesis of environmental management topics. Environmental Evidence, 6, 27.

FRAMPTON, G., WHALEY, P., BENNETT, M., BILOTTA, G., DORNE, J.-L. C. M., EALES, J., JAMES, K., KOHL, C., LAND, M., LIVOREIL, B., MAKOWSKI, D., MUCHIRI, E., PETROKOFSKY, G., RANDALL, N. & SCHOFIELD, K. 2022.  Principles and framework for assessing the risk of bias for studies included in comparative quantitative environmental systematic reviews. Environmental Evidence, 11:12, 1-23.

FREEMAN, R. 1984. Stakeholder management: a strategic approach. New York: Pitman.

GATES S. 2002. Review of methodology of quantitative reviews using meta-analysis in ecology. Journal of Animal Ecology, 71, 547-557.

GIBSON, G. & RUSSELL, I. 2006. Flying in Tune: Sexual Recognition in Mosquitoes. Current Biology 16 (13),1311-1316.

GIUSTINI, D. & BOULOS, M. N. K. 2013. Google Scholar is not enough to be used alone for systematic reviews. Online Journal of Public Health Informatics, 5,1-9.

GLANVILLE, J. Searching bibliographic databases. 2019. In: Cooper, H. C., Hedges, L. V. & J. C. Valentine, C. (Eds). The Handbook of Research Synthesis and Meta-Analysis, 3rd edition. New York, NY: Russell Sage Foundation.

GLASS, G. 1976. Primary, secondary, and meta-analysis of research. Educational Researcher; 5, 3-8.

GØTZSCHE, P. C. 1989. Multiple publication of reports of drug trials. European Journal of Clinical Pharmacology 36,429-432.

GØTZSCHE, P. C. & IOANNIDIS, J. P. A. 2012. Content area experts as authors: helpful or harmful for systematic reviews and meta-analyses? BMJ : British Medical Journal, 345, 4 pp.

GOUGH, D., OLIVER, S. & THOMAS, J. 2012. An introduction to systematic reviews, London, Sage Publications Ltd.

GREENLAND, S., PEARL, J. & ROBINS, J. M. 1999. Causal diagrams for epidemiologic research. Epidemiology, 10, 37-48.

GRINDLAY, D. J. C., BRENNAN, M. L. & DEAN, R. S. 2012. Searching the veterinary literature: a comparison of the coverage of veterinary journals by nine bibliographic databases. Journal of Veterinary Medicine Education, 39, 404-412.

GIUSTINI D, & BOULOS M.N.K. Google Scholar is not enough to be used alone for systematic reviews. Online J Public Health Inf. 2013;5(2):1–9.

GUREVITCH, J. & HEDGES, L. V. 1999. Statistical issues in ecological meta-analyses. Ecology, 80, 1142–1149.

GUREVITCH J. & HEDGES L. V. 2001. Meta-analysis Combining the results of independent experiments. In: Scheiner, S. M. & J. Gurevitch, J. (Eds) Design and Analysis of Ecological Experiments. pp. 347-369. Oxford University Press, New York.

HADDAWAY, N. R. 2015. The use of web-scraping software in searching for grey literature. The Grey Journal, 11, 186-190.

HADDAWAY, N. R. & BAYLISS, H. R. 2015. Shades of grey: two forms of grey literature important for reviews in conservation. Biological Conservation, 191,827-829.

HADDAWAY, N. R., COLLINS, A. M., COUGHLIN, D. & KIRK, S. 2015. The role of Google Scholar in evidence reviews and its applicability to grey literature searching. PLoS ONE, 10, e0138237.

HADDAWAY, N. R., COLLINS, A. M., COUGHLIN, D. & KIRK, S. 2017. A rapid method to increase transparency and efficiency in web-based searches. Environmental Evidence, 6, 1.

HADDAWAY, N.R., KOHL, C., REBELO DA SILVA, N.,  SCHIEMANN, J., SPOK, A., STEWART, R. SWEET, J.B.& WILHELM, R. 2017. A framework for stakeholder engagement during systematic reviews and maps in environmental management. Environmental Evidence 6, 11.

HADDAWAY, N.R., STYLES, D & PULLIN, A.S. 2014. Evidence on the environmental impacts of farm land abandonment in high altitude/mountain regions: a systematic map. Environmental Evidence 3, 17.

HÉRNAN, M. A. & ROBINS J. M. 2020. Causal inference: What if. Boca Raton, Chapman & Hall.

HIGGINS, J. P. T., ALTMAN, D., GØTZSCHE. P., JÜNI, P., MOHER, D., OXMAN, A., et al. 2011. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 343,d5928,1-9.

HIGGINS, J.P.T., DEEKS, J.J. 2011. Selecting studies and collecting data. In: Higgins, J. P. T. & Green, S, (Eds). Cochrane Handbook for Systematic Reviews of Interventions. Chichester: Wiley-Blackwell; pp. 151-86.

HIGGINS, J. P. T. & GREEN, S. 2011. Cochrane handbook for systematic reviews of interventions, Chichester, Wiley.

HIGGINS, J P. T., SAVOVIĆ, J., PAGE, M. J., ELBERS, R. G. & STERNE, J. A. C. 2022. Assessing risk of bias in a randomized trial. In: HIGGINS, J. P. T., THOMAS, J., CHANDLER, J., CUMPSTON, M., LI, T., PAGE, M. & WELCH, V. 2022. Cochrane Handbook for Systematic Reviews of Interventions, version 6.3.

HILL, A. B. 1971. Principles of medical statistics.  Lancet 9: 312-20.

HOLMAN, L., HEAD, M., LANFEAR, R. & JENNIONS, M. 2015. Evidence of experimental bias in the life sciences: why we need blind data recording. PLoS Biology. 13(7),e1002190,1-12.

HOLST, R. & FUNK, C. J. 2005. State of the art of expert searching: results of a Medical Library association survey. Journal of the Medical Library Association, 93, 45-52.

HOPEWELL, S., MCDONALD, S., CLARKE, M. J. & EGGER, M. 2007. Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database of Systematic Reviews, Issue 2.

HURLBERT, S. H. 1984. Pseudoreplication and the design of ecological field experiments. Ecological Monographs, 54 (2), 187-211.

IOANNIDIS, J. P. A. 2005. Why Most Published Research Findings Are False. PLoS Med 2(8): e124. https://doi.org/10.1371/journal.pmed.0020124

JAMES, K. L., RANDALL, N. P. & HADDAWAY, N. R. 2016. A methodology for systematic mapping in environmental sciences. Environmental Evidence, 5, 7.

JÜNI, P., HOLENSTEIN, F., STERNE, J., BARTLETT, C. & EGGER, M. 2002. Direction and impact of language bias in meta-analyses of controlled trials: empirical study. International Journal of Epidemiology, 31, 115–123.

KARDISH, M. R., MUELLER, U. G., AMADOR-VARGAS, S., DIETRICH, E. I., MA, R., BARRETT, B. & FANG, C.-C. 2015. Blind trust in unblinded observation in ecology, evolution, and behavior. Frontiers in Ecology and Evolution, 3 (51), 1-4.

KHAN, K. S., KUNZ, R., KLEIJNEN, J. & ANTES, G. 2003. Systematic reviews to support evidence-based medicine: how to apply findings of healthcare research. Royal Society of Medicine Press Ltd, London.

KIRKHAM, J., DWAN, K., ALTMAN, D., GAMBLE, C., DODD, S., SMYTH, R., et al. 2010. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ., 340, c365,1-10.

KONNO, K., PULLIN, AS. 2020. Assessing the risk of bias in choice of search sources for environmental meta-analyses. Research Synthesis Methods, 20, 698-713.

KONNO. K., AKASAKA, M., KOSHIDA, C., KATAYAMA, N., OSADA, N., SPAKE, R. & AMANO, T. 2020. Ignoring non-English language studies may bias ecological meta-analyses. Ecology and Evolution, 10, 6373-6384.

KORICHEVA, J, GUREVITCH, J & MENGERSEN, K. 2013.Handbook of meta-analysis in ecology and evolution. Princeton University Press.

KUGLEY, S., WADE, A., THOMAS, J., MAHOOD, Q., KLINT-JØRGENSEN, A. M., HAMMERSTRØM, K. & SATHE, N. 2016. Searching for studies: a guide to information retrieval for Campbell Systematic Reviews. Version 1.1. Campbell Methods Series. Method Guide 1. Oslo: The Campbell Collaboration.

LAND, M., GRANÉLI, W., GRIMWALL, A., HOFFMANN, C. C., MITSCH, W. J., TONDERSKI, K. S. & VERHOEVEN, J. T. A. 2013. How effective are created or restored freshwater wetlands for nitrogen and phosphorus removal? A systematic review protocol. Environmental Evidence, 2, 16.

LANGER, L., ERASMUS, Y., TANNOUS, N. & STEWART, R. 2017. How stakeholder engagement has led us to reconsider definitions of rigour in systematic reviews. Environmental Evidence, 6, 20.

LAU, J., IOANNIDIS, J. P. A., TERRIN, N, SCHMID, CH, & OLKIN, I. 2006. The case of the misleading funnel plot. BMJ 333: 597–600.

LEIMU, R. & KORICHEVA, J. 2004. Cumulative meta-analysis: a new tool for detection of temporal trends and publication bias in ecology. Proceedings of the Royal Society B: Biological Sciences, 271, 1961-1966.

LEIMU, R. & KORICHEVA, J. 2005. What determines the citation frequency of ecological papers? Trends in Ecology and Evolution, 20, 28-32.

LIBERATI, A., ALTMAN, D. G., TETZLAFF, J., MULROW, C., GØTZSCHE, P. C., IOANNIDIS, J. P. A., CLARKE, M., DEVEREAUX, P. J., KLEIJNEN, J. & MOHER, D. 2009. The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. PLoS Medicine, 6, e1000100.

LIPSEY M. W. & WILSON D. B. 2001. Practical Meta-analysis. Applied Social Research Methods Series. Volume 49. Sage Publications, Thousand Oaks, California.

LIVOREIL, B., GLANVILLE, J., HADDAWAY, N. R., BAYLISS, H., BETHEL, A., DE LACHAPELLE, F. F., ROBALINO, S., SAVILAAKSO, S., ZHOU, W., PETROKOFSKY, G. & FRAMPTON, G. 2017. Systematic searching for environmental evidence using multiple tools and sources. Environmental Evidence, 6, 23.

LORTIE, C. J., AARSSEN, L. W., BUDDEN, A. E., KORICHEVA, J. K., LEIMU, R. & TREGENZA, T. 2007. Publication bias and merit in ecology. Oikos, 116, 1247-1253.

MARGOLUIS, R., STEM, C. SALAFSKY, N. & BROWN, M. 2009. Using conceptual models as a planning and evaluation tool in conservation. Evaluation and Program Planning, 32 (2), 138-147.

MCDONAGH, M., PETERSON, K., RAINA, P., CHANG, S. & SHEKELLE, P. 2013. Avoiding Bias in Selecting Studies. Methods Guide for Effectiveness and Comparative Effectiveness Reviews. Rockville (MD), AHRQ Publication No. 13-EH045-EF. Agency for Healthcare Research and Quality (US)

MANT, R., JONES, D., REYNOLDS, B., ORMEROD, S. & PULLIN A. S. 2011. What is the impact of liming of streams and rivers on the abundance and diversity of fish and invertebrates? CEE review 09-015 (SR76). Collaboration for Environmental Evidence: www.environmentalevidence.org/SR76.html.

MAHOOD, Q., EERD, D. & IRVIN, E. 2014. Searching for grey literature for systematic reviews: challenges and benefits. Research Synthesis Methods, 3, 221-234.

MCKINNON, M. C., CHENG, S. H., DUPRE, S., EDMOND, J., GARSIDE, R., GLEW, L., HOLLAND, M. B., LEVINE, E., MASUDA, Y. J., MILLER, D. C., OLIVEIRA, I., REVENAZ, J., ROE, D., SHAMER, S., WILKIE, D., WONGBUSARAKUM, S. & WOODHOUSE, E. 2016. What are the effects of nature conservation on human well-being? A systematic map of empirical evidence from developing countries. Environmental Evidence, 5, 8.

MULLINS, M. M., DELUCA, J. B., CREPAZ, N. & LYLES, C. M. 2014. Reporting quality of search methods in systematic reviews of HIV behavioural interventions (2000–2010); are the searches clearly explained, systematic and reproducible? Research Synthesis Methods, 5, 116-130.

NAKAGAWA, S., YANG, Y., MACARTNEY, E.L. et al. 2023. Quantitative evidence synthesis: a practical guide on meta-analysis, meta-regression, and publication bias tests for environmental sciences. Environmental Evidence 12, 8.

NHS CENTRE FOR REVIEWS AND DISSEMINATION. 2001. Undertaking systematic review of research on effectiveness. NHS CRD, University of York.

NORTON, S. B. & SCHOFIELD, K. A. 2017. Conceptual model diagrams as evidence scaffolds for environmental assessment and management. Freshwater Science, 36 (1), 231-239.

NOYES, J., POPAY, J., PEARSON, A., HANNES, K. & BOOTH, A. 2011. Chapter 20: Qualitative research and Cochrane reviews. In: Higgins, J. P. T. & Green, S. (Eds), Cochrane Handbook for Systematic Reviews of Interventions Version 5.1. The Cochrane Collaboration. www.handbook.cochrane.org.

OJANEN, M., MILLER, D., ZHOU, W., MSHALE, B., MWANGI, E. & PETROKOFSKY, G. 2014. What are the environmental impacts of property rights regimes in forests, fisheries and rangelands? A systematic review protocol. Environmental Evidence, 3, 19.

OJANEN, M., ZHOU, W., MILLER, D. C., NIETO, S. H., MSHALE, B. & PETROKOFSKY, G. 2017. What are the environmental impacts of property rights regimes in forests, fisheries and rangelands? Environmental Evidence, 6, 12.

O’LEARY, B. C., KVIST, K., BAYLISS, H. R., DERROIRE, G., HEALEY, J. R., HUGHES, K, KLEINSCHROTH, F., SCIBERRAS, M., WOODCOCK, P. & PULLIN, A. S. 2016. The reliability of evidence review methodology in environmental science and conservation. Environmental Science and Policy 64, 75-82.

ORTEGA, J. L. 2014. Academic search engines: a quantitative outlook. Online Information Review, 39, 435-436.

OSENBERG, C. W., SARNELLE, O., COOPER, S. D. & HOLT, R. D. 1999. Resolving ecological questions through meta-analysis: Goals, metrics, and models. Ecology, 80, 1105-1117.

PEARL, J. 1995. Causal diagrams for empirical research. Biometrika, 82(4), 669-710.

PEARL, J. & BAREINBOIM, E. 2014. External Validity: From Do-Calculus to Transportability across Populations. Statistical Science, 29, 579-595.

PETERSEN, K. & ALI, N. B. 2011. Identifying Strategies for Study Selection in Systematic Reviews and Maps. International Symposium on Empirical Software Engineering and Measurement. Banff, AB, Canada

PETTICREW, M. & ROBERTS, H. 2006. Systematic reviews in the social sciences. A practical guide, Oxford, Blackwell.

POPAY, J. 2006. Moving Beyond Effectiveness. Methodological issues in the synthesis of diverse sources of evidence. National Institute for Health and Clinical Evidence, UK.

PULLIN, A. S., BANGPAN, M., DALRYMPLE, S. E., DICKSON, K., HADDAWAY, N. R., HEALEY, J. R., HAUARI, H., HOCKLEY, N., JONES, J. P. G., KNIGHT, T. M., VIGURS, C. & OLIVER, S. 2013. Human Well-Being Impacts of Terrestrial Protected Areas. Environmental Evidence 2:19.

PULLIN, A. S., KNIGHT, T. M. & WATKINSON, A. R. 2009. Linking reductionist science and holistic policy using systematic reviews: unpacking environmental policy questions to construct an evidence-based framework. Journal of Applied Ecology, 46, 970-975.

RADER, T., MANN, M., STANSFIELD, C., COOPER, C. & SAMPSON, M. 2014. Methods for documenting systematic review searches: a discussion of common issues. Research Synthesis Methods, 5, 98-115.

RANDALL, N. P. & JAMES, K. L. 2012. The effectiveness of integrated farm management, organic farming and agri-environment schemes for conserving biodiversity in temperate Europe – A systematic map. Environmental Evidence, 1.

RAVNSKOV, U. 1992. Cholesterol lowering trials in coronary heart disease: frequency of citation and outcome. British Medical Journal, 305, 15.

RATHBONE, J., HOFFMANN, T. & GLASZIOU, P. 2015. Faster title and abstract screening? Evaluating Abstrackr, a semi-automated online screening program for systematic reviewers. Systematic Reviews, 4, 80.

ROBERTS, P. D., STEWART, G. B. & PULLIN, A. S. 2006. Are review articles a reliable source of evidence to support conservation and environmental management? A comparison with medicine. Biological Conservation, 132, 409-423.

RODRÍGUEZ, L., HOGARTH, N. J., ZHOU, W., XIE, C., ZHANG, K. & PUTZEL, L. 2016. China’s conversion of cropland to forest program: a systematic review of the environmental and socioeconomic effects. Environmental Evidence, 5, 21.

ROONEY, A. A., BOYLES, A. L., WOLFE, M. S., BUCHER, J. R. & THAYER, K. A. 2014. Systematic review and evidence integration for literature-based environmental health science assessments. Environmental Health Perspectives,122, 711-8.

ROTHSTEIN, H. R., SUTTON, A. J. & BORENSTEIN, M. 2005. Chapter 1. Publication bias in meta-analysis. In:Rothstein, H. R., Sutton, A. J. & Borenstein, M. (Eds.) Publication bias in meta-analysis—prevention, assessment and adjustments. Chichester, UK : John Wiley & Sons, Ltd.

SAGOO, G. S., LITTLE, J. & HIGGINS, J. P. T. 2009. Systematic Reviews of Genetic Association Studies. PLoS Medicine, 6, e1000028.

SALEH, A. A., RATAJESKI, M. A. & BERTOLET, M. 2014. Grey literature searching for health sciences systematic reviews: a prospective study of time spent and resources utilised. Evidence Based Library and Information Practice, 9,28-50.

SARGEANT, J. M. & O’CONNOR, A. M. 2014. Conducting systematic reviews of intervention questions ii: relevance screening, data extraction, assessing risk of bias, presenting the results and interpreting the findings. Zoonoses and Public Health, 61, 39-51.

SAYERS, A. 2007. Tips and tricks in performing a systematic review. British Journal of General Practice, 57, 759.

SCARGLE, J. D. 2000. Publication Bias: The “File-Drawer” Problem in Scientific Inference. Journal of Scientific Exploration 14: 91–106.

SCHAFER, J. L. 1997. Analysis of incomplete multivariate data. Chapman & Hall/CRC Monographs on Statistics & Applied. CRC Press.

SCHINDLER, S., LIVOREIL, B., PINTO, I. S., ARAUJO, R. M., ZULKA, K. P., PULLIN, A. S., SANTAMARIA, L., KROPIK, M., FERNANDEZ-MENDEZ, P. & WRBKA, T. 2016. The network BiodiversityKnowledge in practice: insights from three trial assessments. Biodiversity Conservation, 25, 1301-1318.

SCHULZ, K., CHALMERS, I., HAYES, R. & ALTMAN, D. 1995. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA, 273, 408-12.

SHARP, S. 1998. Meta-analysis regression: statistics, biostatistics, and epidemiology. Stata Technical Bulletin 42: 16-22.

SMART, J. M. & BURLING, D. 2001. Radiology and the Internet: a systematic review of patient information resources. Clinical Radiology, 56, 867-870.

SMITH, R. K., PULLIN, A. S., STEWART, G. B. & SUTHERLAND, W. J. 2010. Is predator control and effective strategy for enhancing bird populations? CEE review 08-001 (SR38). Collaboration for Environmental Evidence: www.environmentalevidence.org/SR38.html.

SOCIAL SCIENCE RESEARCH UNIT. 2016. Eppi Reviewer 4. London: Social Science Research Unit, Institute of Education, University of London. https://eppi.ioe.ac.uk/cms/Default.aspx?alias=eppi.ioe.ac.uk/cms/er4

SÖDERSTRÖM, B., HEDLUND, K., JACKSON, L. E., KÄTTERER, T., LUGATO, E., THOMSEN, I. K. & JØRGENSEN, H. B. 2014. What are the effects of agricultural management on soil organic carbon (SOC) stocks? Environmental Evidence,3, 2.

SONG, F., PAREKH, S., HOOPER, L., LOKE, Y. K., RYDER, J., SUTTON, A. J., HING, C., KWOK, C. S., PANG, C. & HARVEY, I. 2010. Dissemination and publication of research findings: an updated review of related biases. Health Technology Assessment, 14.

STEENLAND, K., SCHUBAUER-BERIGAN, M. K., VERMEULEN, R., LUNN, R. M., STRAIF, K., ZAHM, S., STEWART, P., ARROYAVE, W. D., MEHTA, S. S. & PEARCE, N. 2020. Risk of bias assessments and evidence syntheses for observational epidemiologic studies of environmental and occupational exposures: Strengths and limitations. Environmental Health Perspectives, 128(9), 095002.

STERNE, J. A. C., HIGGINS, J. P. T., ELBERS, R. G., REEVES, B. C. & ROBINS-I DEVELOPMENT GROUP. 2016. Risk of bias in non-randomized studies of interventions (ROBINS-I): detailed guidance. 

STERNE, J. A. C., SAVOVIĆ, J., PAGE, M. J., ELBERS, R. G., BLENCOWE, N. S., BOUTRON, I., CATES, C. J., CHENG, H.-Y., CORBETT, M. S., ELDRIDGE, S. M., EMBERSON, J. R., HERNÁN, M. A., HOPEWELL, S., HRÓBJARTSSON, A., JUNQUEIRA, D. R., JÜNI, P., KIRKHAM, J. J., LASSERSON, T., LI, T., MCALEENAN, A., REEVES, B. C., SHEPPERD, S., SHRIER, I., STEWART, L. A., TILLING, K., WHITE, I. R., WHITING, P. F. & HIGGINS, J. P. T. 2019. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ, 366 (14898), 1–8.

STEWART, R. & LIABO, K. 2012. Involvement in research without compromising research quality. Journal of Health Services Research and Policy 17, 248-251.

SUTTORP, M. M., SIEGERINK, B., JAGER, K. Z., ZOCCALI, C. & DEKKER, F. W. 2015. Graphical presentation of confounding in directed acyclic graphs. Nephrology, Dialysis, Transplantation, 30 (9), 1418-1423.

THOMPSON, S. G. 1994. Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated. BMJ, 309, 1351.

TRAMÈR, M. R., REYNOLDS, D. J. M., MOORE, R. A. & MCQUAY, H. J. 1997. Impact of covert duplicate publication on meta-analysis: A case study. British Medical Journal, 315, 635-640.

VON ELM, E., POGLIA, G., WALDER, B. & TRAMÈR, M. R. 2004. Different patterns of duplicate publication: An analysis of articles used in systematic reviews. JAMA, 291, 974-980.

VON ELM E., TRAMÈR, M. R, JÜNI, P. & EGGER, M. Does duplicate publication of trials introduce bias in systematic reviews? A systematic review [abstract]. In: 11th Cochrane Colloquium: 2003 Oct 26-31; Barcelona, Spain.

WANG, S., MOSS, J. R. & HILLER, J. E. 2006. Applicability and transferability of interventions in evidence-based public health. Health Promotion International, 21(1), 76-83.

WEISE, A., BÜCHTER, R., PIEPER, D. & MATHES, T. 2020. Assessing context suitability (generalizability, external validity, applicability or transferability) of findings in evidence syntheses in healthcare-An integrative review of methodological guidance. Research Synthesis Methods, 11 (6), 760-779.

WHITING, P. F., WESWOOD, M. E., RUTJES, A. W. S., REITSMA, J. B., BOSSUYT, P. N. M. 2006. Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies. BMC Medical Research Methodology, 6 (9), 1-8.

WHITING, P. F., RUTJES, A. W. S., WESTWOOD, M. E., MALLETT, S., DEEKS, J. J., REITSMA, J. B., LEEFLANG, M. M. G., STERNE, J. A. C., BOSSUYT, P. M. M. & QUADAS-2 GROUP. 2011. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Annals of Internal Medicine, 155 (8), 529-536.

WOOD, L., EGGER, M., GLUUD, L., SCHULZ, K., JÜNI, P., ALTMAN, D., et al. 2008. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ., 336, 601-605.

WORTMAN, P. 1994. Judging research quality. In: Cooper H. & Hedges L. (Eds), The Handbook of Research Synthesis. New York: Russell Sage Foundation. pp. 97-109

ZHANG, L., SAMPSON, M. & MCGOWAN, J. 2006. Reporting the role of expert searcher in Cochrane Reviews. Evidence Based Library and Information Practice, 1, 3-16.