Hubbry Logo
Systematic reviewSystematic reviewMain
Open search
Systematic review
Community hub
Systematic review
logo
8 pages, 0 posts
0 subscribers
Be the first to start a discussion here.
Be the first to start a discussion here.
Systematic review
Systematic review
Systematic review
View on Wikipedia
from Wikipedia

A systematic review is considered the most trusted form of evidence
Part of a series on
Research
A laptop computer next to archival materials
Research design
Research strategy
Philosophical schools
Methodology
Methods
Tools and software
Philosophy portal

A systematic review is a scholarly synthesis of the evidence on a clearly presented topic using critical methods to identify, define and assess research on the topic.[1] A systematic review extracts and interprets data from published studies on the topic (in the scientific literature), then analyzes, describes, critically appraises and summarizes interpretations into a refined evidence-based conclusion.[1][2] For example, a systematic review of randomized controlled trials is a way of summarizing and implementing evidence-based medicine.[3] Systematic reviews, sometimes along with meta-analyses, are generally considered the highest level of evidence in medical research.[4][5]

While a systematic review may be applied in the biomedical or health care context, it may also be used where an assessment of a precisely defined subject can advance understanding in a field of research.[6] A systematic review may examine clinical tests, public health interventions, environmental interventions,[7] social interventions, adverse effects, qualitative evidence syntheses, methodological reviews, policy reviews, and economic evaluations.[8][9]

Systematic reviews are closely related to meta-analyses, and often the same instance will combine both (being published with a subtitle of "a systematic review and meta-analysis"). The distinction between the two is that a meta-analysis uses statistical methods to induce a single number from the pooled data set (such as an effect size), whereas the strict definition of a systematic review excludes that step. However, in practice, when one is mentioned, the other may often be involved, as it takes a systematic review to assemble the information that a meta-analysis analyzes, and people sometimes refer to an instance as a systematic review, even if it includes the meta-analytical component.

An understanding of systematic reviews and how to implement them in practice is common for professionals in health care, public health, and public policy.[1]

Systematic reviews contrast with a type of review often called a narrative review. Systematic reviews and narrative reviews both review the literature (the scientific literature), but the term literature review without further specification refers to a narrative review.

Characteristics

[edit]

A systematic review can be designed to provide a thorough summary of current literature relevant to a research question.[1] A systematic review uses a rigorous and transparent approach for research synthesis, with the aim of assessing and, where possible, minimizing bias in the findings. While many systematic reviews are based on an explicit quantitative meta-analysis of available data, there are also qualitative reviews and other types of mixed-methods reviews that adhere to standards for gathering, analyzing, and reporting evidence.[10]

Systematic reviews of quantitative data or mixed-method reviews sometimes use statistical techniques (meta-analysis) to combine results of eligible studies. Scoring levels are sometimes used to rate the quality of the evidence depending on the methodology used, although this is discouraged by the Cochrane Library.[11] As evidence rating can be subjective, multiple people may be consulted to resolve any scoring differences between how evidence is rated.[12][13][14]

The EPPI-Centre, Cochrane, and the Joanna Briggs Institute have been influential in developing methods for combining both qualitative and quantitative research in systematic reviews.[15][16][17] Several reporting guidelines exist to standardise reporting about how systematic reviews are conducted. Such reporting guidelines are not quality assessment or appraisal tools. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement[18] suggests a standardized way to ensure a transparent and complete reporting of systematic reviews, and is now required for this kind of research by more than 170 medical journals worldwide.[19] The latest version of this commonly used statement corresponds to PRISMA 2020 (the respective article was published in 2021).[20] Several specialized PRISMA guideline extensions have been developed to support particular types of studies or aspects of the review process, including PRISMA-P for review protocols and PRISMA-ScR for scoping reviews.[19] A list of PRISMA guideline extensions is hosted by the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network.[21] However, the PRISMA guidelines have been found to be limited to intervention research and the guidelines have to be changed in order to fit non-intervention research. As a result, Non-Interventional, Reproducible, and Open (NIRO) Systematic Reviews was created to counter this limitation.[22]

For qualitative reviews, reporting guidelines include ENTREQ (Enhancing transparency in reporting the synthesis of qualitative research) for qualitative evidence syntheses; RAMESES (Realist And MEta-narrative Evidence Syntheses: Evolving Standards) for meta-narrative and realist reviews;[23][24] and eMERGe (Improving reporting of Meta-Ethnography) for meta-ethnograph.[15]

Developments in systematic reviews during the 21st century included realist reviews and the meta-narrative approach, both of which addressed problems of variation in methods and heterogeneity existing on some subjects.[25][26]

Types

[edit]

There are over 30 types of systematic review and Table 1 below non-exhaustingly summarises some of these.[19][18] There is not always consensus on the boundaries and distinctions between the approaches described below.

Table 1: A summary of some of the types of systematic review
Review type Summary
Mapping review/systematic map A mapping review maps existing literature and categorizes data. The method characterizes the quantity and quality of literature, including by study design and other features. Mapping reviews can be used to identify the need for primary or secondary research.[19]
Meta-analysis A meta-analysis is a statistical analysis that combines the results of multiple quantitative studies. Using statistical methods, results are combined to provide evidence from multiple studies. The two types of data generally used for meta-analysis in health research are individual participant data and aggregate data (such as odds ratios or relative risks).
Mixed studies review/mixed methods review Refers to any combination of methods where one significant stage is a literature review (often systematic). It can also refer to a combination of review approaches, such as combining quantitative with qualitative research.[19]
Qualitative systematic review/qualitative evidence synthesis This method integrates or compares findings from qualitative studies. The method can include 'coding' the data and looking for 'themes' or 'constructs' across studies. Multiple authors may improve the 'validity' of the data by potentially reducing individual bias.[19]
Rapid review An assessment of what is already known about a policy or practice issue, which uses systematic review methods to search for and critically appraise existing research. Rapid reviews are still a systematic review, however parts of the process may be simplified or omitted in order to increase rapidity.[27] Rapid reviews were used during the COVID-19 pandemic.[28]
Systematic review A systematic search for data using a repeatable method. It includes appraising the data (for example, the quality of the data) and a synthesis of research data.
Systematic search and review Combines methods from a 'critical review' with a comprehensive search process. This review type is usually used to address broad questions to produce the most appropriate evidence synthesis. This method may or may not include quality assessment of data sources.[19]
Systematized review Include elements of the systematic review process, but searching is often not as comprehensive as a systematic review and may not include quality assessments of data sources.

Scoping reviews

[edit]

Scoping reviews are distinct from systematic reviews in several ways. A scoping review is an attempt to search for concepts by mapping the language and data which surrounds those concepts and adjusting the search method iteratively to synthesize evidence and assess the scope of an area of inquiry.[25][26] This can mean that the concept search and method (including data extraction, organisation and analysis) are refined throughout the process, sometimes requiring deviations from any protocol or original research plan.[29][30] A scoping review may often be a preliminary stage before a systematic review, which 'scopes' out an area of inquiry and maps the language and key concepts to determine if a systematic review is possible or appropriate, or to lay the groundwork for a full systematic review. The goal can be to assess how much data or evidence is available regarding a certain area of interest.[29][31] This process is further complicated if it is mapping concepts across multiple languages or cultures.

As a scoping review should be systematically conducted and reported (with a transparent and repeatable method), some academic publishers categorize them as a kind of 'systematic review', which may cause confusion. Scoping reviews are helpful when it is not possible to carry out a systematic synthesis of research findings, for example, when there are no published clinical trials in the area of inquiry. Scoping reviews are helpful when determining if it is possible or appropriate to carry out a systematic review, and are a useful method when an area of inquiry is very broad,[32] for example, exploring how the public are involved in all stages systematic reviews.[33]

There is still a lack of clarity when defining the exact method of a scoping review as it is both an iterative process and is still relatively new.[34] There have been several attempts to improve the standardisation of the method,[30][29][31][35] for example via a Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline extension for scoping reviews (PRISMA-ScR).[36] PROSPERO (the International Prospective Register of Systematic Reviews) does not permit the submission of protocols of scoping reviews,[37] although some journals will publish protocols for scoping reviews.[33]

Stages

[edit]

While there are multiple kinds of systematic review methods, the main stages of a review can be summarised as follows:

Defining the research question

[edit]

Some reported that the 'best practices' involve 'defining an answerable question' and publishing the protocol of the review before initiating it to reduce the risk of unplanned research duplication and to enable transparency and consistency between methodology and protocol.[38][39] Clinical reviews of quantitative data are often structured using the mnemonic PICO, which stands for 'Population or Problem', 'Intervention or Exposure', 'Comparison', and 'Outcome', with other variations existing for other kinds of research. For qualitative reviews, PICo is 'Population or Problem', 'Interest', and 'Context'.

Searching for sources

[edit]

Relevant criteria can include selecting research that is of good quality and answers the defined question.[38] The search strategy should be designed to retrieve literature that matches the protocol's specified inclusion and exclusion criteria. The methodology section of a systematic review should list all of the databases and citation indices that were searched. The titles and abstracts of identified articles can be checked against predetermined criteria for eligibility and relevance. Each included study may be assigned an objective assessment of methodological quality, preferably by using methods conforming to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement,[21] or the standards of Cochrane.[40]

Common information sources used in searches include scholarly databases of peer-reviewed articles such as MEDLINE, Web of Science, Embase, and PubMed, as well as sources of unpublished literature such as clinical trial registries and grey literature collections. Key references can also be yielded through additional methods such as citation searching, reference list checking (related to a search method called 'pearl growing'), manually searching information sources not indexed in the major electronic databases (sometimes called 'hand-searching'),[41] and directly contacting experts in the field.[42]

To be systematic, searchers must use a combination of search skills and tools such as database subject headings, keyword searching, Boolean operators, and proximity searching while attempting to balance sensitivity (systematicity) and precision (accuracy). Inviting and involving an experienced information professional or librarian can improve the quality of systematic review search strategies and reporting.[43][44][45][46][47]

'Extraction' of relevant data

[edit]
A visualisation of data being 'extracted' and 'combined' in a Cochrane intervention effect review where a meta-analysis is possible[48]

Relevant data are 'extracted' from the data sources according to the review method. The data extraction method is specific to the kind of data, and data extracted on 'outcomes' is only relevant to certain types of reviews. For example, a systematic review of clinical trials might extract data about how the research was done (often called the method or 'intervention'), who participated in the research (including how many people), how it was paid for (for example, funding sources) and what happened (the outcomes).[38] Relevant data are being extracted and 'combined' in an intervention effect review, where a meta-analysis is possible.[48]

Assess the eligibility of the data

[edit]

This stage involves assessing the eligibility of data for inclusion in the review by judging it against criteria identified at the first stage.[38] This can include assessing if a data source meets the eligibility criteria and recording why decisions about inclusion or exclusion in the review were made. Software programmes can be used to support the selection process, including text mining tools and machine learning, which can automate aspects of the process.[49] The 'Systematic Review Toolbox' is a community-driven, web-based catalog of tools, to help reviewers chose appropriate tools for reviews.[50]

Analyse and combine the data

[edit]

Analysing and combining data can provide an overall result from all the data. Because this combined result may use qualitative or quantitative data from all eligible sources of data, it is considered more reliable as it provides better evidence, as the more data included in reviews, the more confident we can be of conclusions. When appropriate, some systematic reviews include a meta-analysis, which uses statistical methods to combine data from multiple sources. A review might use quantitative data, or might employ a qualitative meta-synthesis, which synthesises data from qualitative studies. A review may also bring together the findings from quantitative and qualitative studies in a mixed methods or overarching synthesis.[51] The combination of data from a meta-analysis can sometimes be visualised. One method uses a forest plot (also called a blobbogram).[38] In an intervention effect review, the diamond in the 'forest plot' represents the combined results of all the data included.[38] An example of a 'forest plot' is the Cochrane Collaboration logo.[38] The logo is a forest plot of one of the first reviews which showed that corticosteroids given to women who are about to give birth prematurely can save the life of the newborn child.[52]

Recent visualisation innovations include the albatross plot, which plots p-values against sample sizes, with approximate effect-size contours superimposed to facilitate analysis.[53] The contours can be used to infer effect sizes from studies that have been analysed and reported in diverse ways. Such visualisations may have advantages over other types when reviewing complex interventions.

Communication and dissemination

[edit]

Once these stages are complete, the review may be published, disseminated, and translated into practice after being adopted as evidence. The UK National Institute for Health Research (NIHR) defines dissemination as "getting the findings of research to the people who can make use of them to maximise the benefit of the research without delay".[54]

Some users do not have time to invest in reading large and complex documents and/or may lack awareness or be unable to access newly published research. Researchers are, therefore, developing skills to use creative communication methods such as illustrations, blogs, infographics, and board games to share the findings of systematic reviews.[55]

Automation

[edit]

Living systematic reviews are a newer kind of semi-automated, up-to-date online summaries of research that are updated as new research becomes available.[56] The difference between a living systematic review and a conventional systematic review is the publication format. Living systematic reviews are "dynamic, persistent, online-only evidence summaries, which are updated rapidly and frequently".[57]

The automation or semi-automation of the systematic process itself is increasingly being explored. While little evidence exists to demonstrate it is as accurate or involves less manual effort, efforts that promote training and using artificial intelligence for the process are increasing.[58][56] In particular, since 2023, there has been a growing emergence of tools powered by large language models designed to support, automate, or even generate literature reviews. [59]

Research fields

[edit]

Health and medicine

[edit]

Current use of systematic reviews in medicine

[edit]

Many organisations around the world use systematic reviews, with the methodology depending on the guidelines being followed. Organisations which use systematic reviews in medicine and human health include the National Institute for Health and Care Excellence (NICE, UK), the Agency for Healthcare Research and Quality (AHRQ, US), and the World Health Organization. Most notable among international organisations is Cochrane, a group of over 37,000 specialists in healthcare who systematically review randomised trials of the effects of prevention, treatments, and rehabilitation as well as health systems interventions. They sometimes also include the results of other types of research. Cochrane Reviews are published in The Cochrane Database of Systematic Reviews section of the Cochrane Library. The 2015 impact factor for The Cochrane Database of Systematic Reviews was 6.103, and it was ranked 12th in the Medicine, General & Internal category.[60]

There are several types of systematic reviews, including:[61][62][63][64]

  1. Intervention reviews assess the benefits and harms of interventions used in healthcare and health policy.
  2. Diagnostic test accuracy reviews assess how well a diagnostic test performs in diagnosing and detecting a particular disease. For conducting diagnostic test accuracy reviews, free software such as MetaDTA and CAST-HSROC in the graphical user interface is available.[65][66]
  3. Methodology reviews address issues relevant to how systematic reviews and clinical trials are conducted and reported.
  4. Qualitative reviews synthesize qualitative evidence to address questions on aspects other than effectiveness.
  5. Prognosis reviews address the probable course or future outcome(s) of people with a health problem.
  6. Overviews of Systematic Reviews (OoRs) compile multiple pieces of evidence from systematic reviews into a single accessible document, sometimes referred to as umbrella reviews.
  7. Living systematic reviews are continually updated, incorporating relevant new evidence as it becomes available.[67]
  8. Rapid reviews are a form of knowledge synthesis that "accelerates the process of conducting a traditional systematic review through streamlining or omitting specific methods to produce evidence for stakeholders in a resource-efficient manner".[68]
  9. Reviews of complex health interventions in complex systems are to improve evidence synthesis and guideline development.[69]

Patient and public involvement in systematic reviews

[edit]
Further information: Patient and public involvement

There are various ways patients and the public can be involved in producing systematic reviews and other outputs. Tasks for public members can be organised as 'entry level' or higher. Tasks include:

  • Joining a collaborative volunteer effort to help categorise and summarise healthcare evidence[70]
  • Data extraction and risk of bias assessment
  • Translation of reviews into other languages

A systematic review of how people were involved in systematic reviews aimed to document the evidence-base relating to stakeholder involvement in systematic reviews and to use this evidence to describe how stakeholders have been involved in systematic reviews.[71] Thirty percent involved patients and/or carers. The ACTIVE framework provides a way to describe how people are involved in systematic review and may be used as a way to support systematic review authors in planning people's involvement.[72] Standardised Data on Initiatives (STARDIT) is another proposed way of reporting who has been involved in which tasks during research, including systematic reviews.[73][74]

There has been some criticism of how Cochrane prioritises systematic reviews.[75] Cochrane has a project that involved people in helping identify research priorities to inform Cochrane Reviews.[76][77] In 2014, the Cochrane–Wikipedia partnership was formalised.[78]

Environmental health and toxicology

[edit]

Systematic reviews are a relatively recent innovation in the field of environmental health and toxicology. Although mooted in the mid-2000s, the first full frameworks for conduct of systematic reviews of environmental health evidence were published in 2014 by the US National Toxicology Program's Office of Health Assessment and Translation[79] and the Navigation Guide at the University of California San Francisco's Program on Reproductive Health and the Environment.[80] Uptake has since been rapid, with the estimated number of systematic reviews in the field doubling since 2016 and the first consensus recommendations on best practice, as a precursor to a more general standard, being published in 2020.[81]

Social, behavioural, and educational

[edit]

In 1959, social scientist and social work educator Barbara Wootton published one of the first contemporary systematic reviews of literature on anti-social behavior as part of her work, Social Science and Social Pathology.[82][83]

Several organisations use systematic reviews in social, behavioural, and educational areas of evidence-based policy, including the National Institute for Health and Care Excellence (NICE, UK), Social Care Institute for Excellence (SCIE, UK), the Agency for Healthcare Research and Quality (AHRQ, US), the World Health Organization, the International Initiative for Impact Evaluation (3ie), the Joanna Briggs Institute, and the Campbell Collaboration. The quasi-standard for systematic review in the social sciences is based on the procedures proposed by the Campbell Collaboration, which is one of several groups promoting evidence-based policy in the social sciences.[84]

Others

[edit]

Some attempts to transfer the procedures from medicine to business research have been made,[85] including a step-by-step approach,[86][87] and developing a standard procedure for conducting systematic literature reviews in business and economics.

Systematic reviews are increasingly prevalent in other fields, such as international development research.[88] Subsequently, several donors (including the UK Department for International Development (DFID) and AusAid) are focusing more on testing the appropriateness of systematic reviews in assessing the impacts of development and humanitarian interventions.[88]

The Collaboration for Environmental Evidence (CEE) has a journal titled Environmental Evidence, which publishes systematic reviews, review protocols, and systematic maps on the impacts of human activity and the effectiveness of management interventions.[89]

Review tools

[edit]

A 2022 publication identified 24 systematic review tools and ranked them by inclusion of 30 features deemed most important when performing a systematic review in accordance with best practices. The top six software tools (with at least 21/30 key features) are all proprietary paid platforms, typically web-based, and include:[90]

  • Giotto Compliance
  • DistillerSR
  • Nested Knowledge
  • EPPI-Reviewer Web
  • LitStream
  • JBI SUMARI

The Cochrane Collaboration provides a handbook for systematic reviewers of interventions which "provides guidance to authors for the preparation of Cochrane Intervention reviews."[40] The Cochrane Handbook also outlines steps for preparing a systematic review[40] and forms the basis of two sets of standards for the conduct and reporting of Cochrane Intervention Reviews (MECIR; Methodological Expectations of Cochrane Intervention Reviews).[91] It also contains guidance on integrating patient-reported outcomes into reviews.

Limitations

[edit]

Out-dated or risk of bias

[edit]

While systematic reviews are regarded as the strongest form of evidence, a 2003 review of 300 studies found that not all systematic reviews were equally reliable, and that their reporting can be improved by a universally agreed upon set of standards and guidelines.[92] A further study by the same group found that of 100 systematic reviews monitored, 7% needed updating at the time of publication, another 4% within a year, and another 11% within 2 years; this figure was higher in rapidly changing fields of medicine, especially cardiovascular medicine.[93] A 2003 study suggested that extending searches beyond major databases, perhaps into grey literature, would increase the effectiveness of reviews.[94]

Some authors have highlighted problems with systematic reviews, particularly those conducted by Cochrane, noting that published reviews are often biased, out of date, and excessively long.[95] Cochrane reviews have been criticized as not being sufficiently critical in the selection of trials and including too many of low quality. They proposed several solutions, including limiting studies in meta-analyses and reviews to registered clinical trials, requiring that original data be made available for statistical checking, paying greater attention to sample size estimates, and eliminating dependence on only published data. Some of these difficulties were noted as early as 1994:

much poor research arises because researchers feel compelled for career reasons to carry out research that they are ill-equipped to perform, and nobody stops them.

— Altman DG, 1994[96]

Methodological limitations of meta-analysis have also been noted.[97] Another concern is that the methods used to conduct a systematic review are sometimes changed once researchers see the available trials they are going to include.[98] Some websites have described retractions of systematic reviews and published reports of studies included in published systematic reviews.[99][100][101] Eligibility criteria that is arbitrary may affect the perceived quality of the review.[102][103]

Limited reporting of data from human studies

[edit]

The AllTrials campaign report that around half of clinical trials have never reported results and works to improve reporting.[104] 'Positive' trials were twice as likely to be published as those with 'negative' results.[105]

As of 2016, it is legal for-profit companies to conduct clinical trials and not publish the results.[106] For example, in the past 10 years, 8.7 million patients have taken part in trials that have not published results.[106] These factors mean that it is likely there is a significant publication bias, with only 'positive' or perceived favourable results being published. A recent systematic review of industry sponsorship and research outcomes concluded that "sponsorship of drug and device studies by the manufacturing company leads to more favorable efficacy results and conclusions than sponsorship by other sources" and that the existence of an industry bias that cannot be explained by standard 'risk of bias' assessments.[107]

Poor compliance with review reporting guidelines

[edit]

The rapid growth of systematic reviews in recent years has been accompanied by the attendant issue of poor compliance with guidelines, particularly in areas such as declaration of registered study protocols, funding source declaration, risk of bias data, issues resulting from data abstraction, and description of clear study objectives.[108][109][110][111][112] A host of studies have identified weaknesses in the rigour and reproducibility of search strategies in systematic reviews.[113][114][115][116][117][118] To remedy this issue, a new PRISMA guideline extension called PRISMA-S is being developed.[119] Furthermore, tools and checklists for peer-reviewing search strategies have been created, such as the Peer Review of Electronic Search Strategies (PRESS) guidelines.[120]

A key challenge for using systematic reviews in clinical practice and healthcare policy is assessing the quality of a given review. Consequently, a range of appraisal tools to evaluate systematic reviews have been designed. The two most popular measurement instruments and scoring tools for systematic review quality assessment are AMSTAR 2 (a measurement tool to assess the methodological quality of systematic reviews)[121][122][123] and ROBIS (Risk Of Bias In Systematic reviews); however, these are not appropriate for all systematic review types.[124] Some recent peer-reviewed articles have carried out comparisons between AMSTAR 2 and ROBIS tools.[125][126]

History

[edit]

The first publication that is now recognized as equivalent to a modern systematic review was a 1753 paper by James Lind, which reviewed all of the previous publications about scurvy.[127] Systematic reviews appeared only sporadically until the 1980s, and became common after 2000.[127] More than 10,000 systematic reviews are published each year.[127]

History in medicine

[edit]

A 1904 British Medical Journal paper by Karl Pearson collated data from several studies in the UK, India and South Africa of typhoid inoculation. He used a meta-analytic approach to aggregate the outcomes of multiple clinical studies.[128] In 1972, Archie Cochrane wrote: "It is surely a great criticism of our profession that we have not organised a critical summary, by specialty or subspecialty, adapted periodically, of all relevant randomised controlled trials".[129] Critical appraisal and synthesis of research findings in a systematic way emerged in 1975 under the term 'meta analysis'.[130][131] Early syntheses were conducted in broad areas of public policy and social interventions, with systematic research synthesis applied to medicine and health.[132] Inspired by his own personal experiences as a senior medical officer in prisoner of war camps, Archie Cochrane worked to improve the scientific method in medical evidence.[133] His call for the increased use of randomised controlled trials and systematic reviews led to the creation of The Cochrane Collaboration,[134] which was founded in 1993 and named after him, building on the work by Iain Chalmers and colleagues in the area of pregnancy and childbirth.[135][129]

See also

[edit]

References

[edit]
[edit]
Revisions and contributorsEdit on WikipediaRead on Wikipedia

Systematic review

View on Grokipedia
from Grokipedia
A systematic review is a that uses explicit, reproducible, and systematic processes to identify, appraise, and synthesize all relevant that meets pre-specified eligibility criteria, in order to answer a clearly defined and minimize . This approach distinguishes systematic reviews from traditional reviews by emphasizing transparency, comprehensiveness, and rigor in searching, selection, and analysis of studies. Systematic reviews play a critical role in evidence-based practice, particularly in fields like medicine, public health, social sciences, business management, and entrepreneurship, by providing reliable summaries of the effects of interventions, diagnostic tests, prognostic factors, strategies, or theoretical developments. Recent advances, including AI-assisted tools and living reviews updated in response to events like the , have further expanded their utility. They help decision-makers, such as clinicians, policymakers, and researchers, avoid redundant studies, identify gaps in knowledge, and inform guidelines with high-quality . For instance, these reviews often incorporate meta-analysis, a statistical technique to combine quantitative data from multiple studies, enhancing the precision of effect estimates when appropriate. While the core principles and steps of systematic reviews remain generalizable across disciplines, applications in fields such as business management and entrepreneurship often involve specific adaptations, including greater flexibility in protocols, emphasis on theory building, and handling of heterogeneous evidence sources (see Applications Across Disciplines). The origins of systematic reviews trace back to the , with early examples like James Lind's synthesis of scurvy treatments, but modern formalized methods emerged in the mid-20th century amid growing research volumes. The term "" was coined by Gene Glass in 1976, and the approach gained prominence through Archie Cochrane's 1979 critique of inefficient , leading to the establishment of the Cochrane Collaboration in 1993 to produce high-quality reviews. As of , hundreds of thousands of systematic reviews had been published, with tens of thousands appearing annually and the number continuing to grow rapidly.

Definition and Characteristics

Core Principles

A systematic review is defined as a rigorous synthesis of on a clearly formulated , employing explicit, pre-specified eligibility criteria to identify, select, appraise, and synthesize all relevant studies while minimizing bias through structured methods. This approach ensures that the review process is methodical and comprehensive, aiming to reduce subjectivity and provide a reliable overview of the existing . Central to systematic reviews are several core principles that uphold their scientific integrity. Comprehensiveness in literature searching requires exhaustive efforts to locate all pertinent studies across multiple databases and sources, avoiding selective inclusion that could skew results. Transparency in methods demands detailed documentation of every step, from search strategies to inclusion decisions, allowing readers to understand and scrutinize the process. is achieved through the development and adherence to a pre-defined protocol, often registered in advance, which outlines the review's objectives, criteria, and analytical plans to enable replication by others. Critical appraisal of study quality involves systematically evaluating the methodological strengths and limitations of included studies using validated tools, ensuring that only high-quality informs the synthesis. These principles originated within the movement of the late 20th century, which sought to integrate the best available research evidence with clinical expertise and patient values to improve healthcare decisions. By adhering to them, systematic reviews facilitate evidence-based decision-making, such as developing clinical guidelines and informing policies, by distilling complex evidence into actionable insights that reduce uncertainty and enhance reliability.

Distinctions from Other Reviews

Systematic reviews differ from reviews primarily in their methodological rigor and approach to synthesis. reviews, also known as traditional or non-systematic reviews, provide an expert-driven overview of a topic by selectively summarizing key , often relying on the authors' and without predefined criteria for inclusion. In contrast, systematic reviews employ explicit, reproducible protocols to identify, appraise, and synthesize all relevant , minimizing through comprehensive searches across multiple databases and transparent eligibility criteria. This structured process ensures higher confidence in the findings, as evidenced by studies showing reviews can reach differing conclusions from the same body of due to subjective selection. Literature reviews, frequently synonymous with reviews in practice, aim to contextualize a area by thematically discussing existing studies but lack the systematic rigor required to control for or ensure completeness. Unlike systematic reviews, which use prespecified protocols, exhaustive search strategies, and formal quality assessments to avoid cherry-picking studies, literature reviews often involve searches and subjective synthesis, making them suitable for broad overviews but less reliable for informing policy or practice. Umbrella reviews, sometimes called reviews of reviews, further distinguish themselves by synthesizing evidence from multiple existing systematic reviews and meta-analyses rather than primary studies, providing a high-level overview of broad topics such as intervention effects across interventions. While systematic reviews focus on primary data synthesis with original eligibility criteria applied to individual studies, umbrella reviews assess the quality and consistency of those syntheses, reanalyzing data where needed to standardize methods and identify overarching patterns or gaps. The following table enumerates key methodological differences across these review types:
AspectSystematic ReviewNarrative/Literature ReviewUmbrella Review
Search StrategyExhaustive, predefined across databasesAd hoc, selectiveTargets existing systematic reviews
Inclusion CriteriaExplicit, prespecified eligibilitySubjective, often implicitApplied to systematic reviews/meta-analyses
Bias ControlFormal assessment and minimizationInformal, prone to author biasEvaluates bias in included reviews
Synthesis ApproachReproducible, may include meta-analysisThematic narrative summaryOverarching synthesis of review findings
PurposeAnswer specific question with high rigorProvide context or overviewBroad evidence overview from reviews
These distinctions underscore the superiority of systematic reviews in producing unbiased, comprehensive evidence summaries compared to more flexible but less rigorous alternatives.

Types of Systematic Reviews

Scoping Reviews

Scoping reviews, also referred to as scoping studies, represent a type of knowledge synthesis designed to map the breadth of on a specific topic or field by identifying key concepts, main sources and types of , and research gaps. Unlike more focused reviews, they emphasize exploration over evaluation, providing an initial overview of the extent, range, and nature of available without conducting in-depth critical appraisals of individual study quality. This approach is particularly valuable for clarifying complex or undefined research areas, informing policy, practice, or subsequent studies by highlighting thematic patterns and areas needing further investigation. The purpose of scoping reviews centers on delineating the landscape of existing to guide , such as determining the feasibility of a full systematic review or identifying priorities for primary . They are especially suited to emerging topics where is heterogeneous or evolving, allowing researchers to assess the volume and variety of studies before pursuing narrower syntheses. By focusing on descriptive mapping, scoping reviews help stakeholders understand what is known and unknown, thereby supporting evidence-based planning in fields like and . Methodologically, scoping reviews follow a structured yet flexible framework originally outlined by Arksey and O'Malley in 2005, comprising five core stages: formulating the research question to define the scope; searching for relevant studies across multiple databases and sources, including grey literature; selecting studies using predefined but broad inclusion criteria; charting data through extraction of key information into tables or charts for organization; and collating, summarizing, and reporting results via narrative or visual descriptions. An optional sixth stage involves consulting stakeholders, such as practitioners or policymakers, to refine interpretations and enhance practical relevance. This process employs wider inclusion parameters than traditional systematic reviews to capture diverse evidence types, prioritizing descriptive summaries over quantitative analysis or meta-synthesis. Reporting standards, such as the PRISMA extension for scoping reviews (PRISMA-ScR), ensure transparency in these steps. Scoping reviews are recommended when a topic is broad, complex, or preliminary, such as in emerging issues where a comprehensive synthesis would be premature or resource-intensive. For example, they have been applied to map interventions for in governmental practice, revealing implementation gaps and priority areas for targeted . In another case, a scoping review examined interventions delivered via beauty salons, identifying common strategies for disease prevention and underserved populations to inform scalable programs. These applications demonstrate how scoping reviews serve as foundational tools for policy-oriented fields by providing actionable overviews without exhaustive depth.

Meta-Analyses

A meta-analysis represents a quantitative extension of systematic reviews, involving the statistical combination of results from multiple independent studies to produce an overall estimate of , thereby enhancing precision and resolving inconsistencies among individual findings. Coined by Gene V. Glass in as "the statistical analysis of a large collection of analysis results from individual studies for the purpose of integrating the findings," this method is particularly valuable in fields like and social sciences for synthesizing evidence on interventions or associations. Results from meta-analyses are commonly visualized through forest plots, which graphically display each study's effect estimate, confidence intervals, weights, and the pooled summary effect, facilitating intuitive assessment of consistency and overall impact. Key methods in meta-analysis include the choice between fixed-effect and random-effects models, alongside rigorous assessment of heterogeneity. The fixed-effect model posits that all studies share a common true , with observed differences attributable only to sampling variation, and assigns greater weight to larger studies; it is suitable when studies are sufficiently similar. Conversely, the random-effects model incorporates an additional source of variation to account for true differences in effect sizes across studies, providing more conservative estimates and broader confidence intervals, and is preferred when between-study heterogeneity is anticipated or observed. Heterogeneity is quantified using the I² statistic, which measures the proportion of total variability in study estimates that is due to heterogeneity rather than chance. This is computed via the formula: I2=100%×(Q−df)QI^2 = 100\% \times \frac{(Q - df)}{Q} where QQ is Cochran's heterogeneity statistic (a chi-squared test for variation) and dfdf is the degrees of freedom (typically the number of studies minus one). Values of I² range from 0% (no heterogeneity) to 100% (complete heterogeneity), with thresholds like 25% for low, 50% for moderate, and 75% for high often guiding interpretation, though context matters. Conducting a meta-analysis necessitates selecting homogeneous studies with comparable outcomes, such as similar measures of effect (e.g., odds ratios or mean differences) and aligned PICO elements (population, intervention, comparison, outcomes), to ensure the validity of pooling and minimize confounding. When full homogeneity is absent, subgroup analyses allow exploration of potential moderators by dividing studies into categories—such as by age group, dosage, or geographic region—and performing separate meta-analyses within each, followed by tests for subgroup differences to identify sources of variation. Assessments of risk of bias in included studies, often using tools like the Cochrane Risk of Bias instrument, are essential to appropriately weight contributions and interpret results. Reporting standards for meta-analyses follow the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, which mandate transparent documentation including a of study selection, detailed descriptions of statistical methods (e.g., model choice and heterogeneity tests), forest plots, and sensitivity analyses to evaluate how results change with alternative assumptions or exclusions. These elements promote reproducibility and critical appraisal, with PRISMA emphasizing the reporting of effect sizes, confidence intervals, and any limitations like . The updated PRISMA 2020 statement further refines these requirements to reflect advances in synthesis methods.

Rapid Reviews

Rapid reviews are streamlined versions of systematic reviews that accelerate the evidence synthesis process to deliver timely information for urgent , particularly in , clinical, or contexts such as emergencies. They maintain the core aim of systematically identifying, selecting, and synthesizing relevant studies but abbreviate certain steps to shorten timelines, often responding to time-sensitive needs where full systematic reviews would be too slow. This approach has gained prominence during events like the , where rapid evidence was essential for guiding interventions and . Key methodological adaptations distinguish rapid reviews from traditional systematic reviews, focusing on efficiency without entirely sacrificing rigor. These include limiting literature searches to a smaller number of databases (typically 2-3, such as , , and the ), restricting inclusion to high-quality study designs or existing systematic reviews, and employing single-reviewer screening for titles and abstracts with optional dual verification on a (e.g., 20%). Data extraction is often performed by one reviewer with verification, and full risk-of-bias assessments are abbreviated or omitted, prioritizing key outcomes. The entire process typically spans 1 to 12 weeks, compared to 12-24 months for a standard systematic review, enabling quicker dissemination of findings. Established frameworks guide the conduct of rapid reviews to ensure transparency and reproducibility. The Cochrane Rapid Reviews Methods Group provides interim guidance with 26 specific recommendations (updated to 24 in 2024), emphasizing stakeholder involvement in question formulation, protocol registration (e.g., on ), narrative synthesis over unless feasible, and clear reporting of limitations. These guidelines recommend focusing searches on English-language publications unless multilingual is critical and using tools like GRADE for assessing certainty when resources permit. While rapid reviews offer significant advantages in speed and applicability to urgent scenarios, they involve inherent trade-offs that can affect comprehensiveness and reliability. Streamlined methods, such as single-reviewer processes, increase the risk of and may miss relevant studies, with estimates suggesting up to 5% fewer inclusions compared to dual-reviewer approaches. Limited database coverage and abbreviated bias assessments can lead to less robust conclusions, potentially underestimating evidence gaps, though proponents argue the benefits of timely action outweigh these risks in high-stakes situations like health crises. To mitigate issues, guidance stresses explicit documentation of methodological shortcuts and their implications for decision-makers.

Living Systematic Reviews

Living systematic reviews (LSRs) represent a dynamic approach to evidence synthesis, defined as systematic reviews that are continually updated to incorporate relevant new evidence as it becomes available. Unlike traditional systematic reviews, LSRs involve ongoing of the through frequent searches, often utilizing automated alerts from bibliographic to identify emerging studies efficiently. This methodology ensures that the review remains current, particularly in fields where evidence evolves rapidly, by integrating new data without restarting the entire process from scratch. The core methodology of LSRs adheres to principles established by the Living Systematic Review Network in 2017, emphasizing streamlined workflows, technology integration for efficiency, and a focus on end-user utility while minimizing author burden. Continuous screening occurs alongside regular literature searches, typically monthly for major databases like and , with partial updates published every 2 to 6 months or sooner if new evidence significantly impacts findings. These updates may include living network meta-analyses, which extend traditional network meta-analysis techniques to dynamically compare multiple interventions as new trials accrue, providing ongoing relative effect estimates. Screening and incorporation follow standard systematic review protocols, often supported by software tools for and to handle the influx of citations. LSRs are particularly applied in fast-changing domains such as infectious diseases and clinical guideline development, where timely is critical for . A prominent example is the suite of Cochrane living systematic reviews on interventions, which addressed pharmacological treatments, diagnostics, and risk factors through monthly searches and iterative updates to inform responses during the . These reviews demonstrated LSRs' value in synthesizing rapidly accumulating data from diverse study designs, including randomized trials and observational studies, to reduce waste and support adaptive guidelines. Despite their benefits, LSRs present notable challenges, primarily their resource-intensive nature, which demands sustained team commitment, frequent monitoring, and ongoing editorial support to maintain methodological rigor. poses additional difficulties, as managing multiple iterations requires clear documentation of changes, consistent use of tools like "What's New" tables, and standardized policies for digital object identifiers (DOIs) across publications to track evolution without confusion. These demands can strain resources, particularly during high-volume evidence periods like pandemics, though and predefined stopping criteria help mitigate workload.

Conducting a Systematic Review

Formulating the

Formulating a clear and focused is the foundational step in conducting a systematic review, as it defines the scope, guides the selection of studies, and ensures the review addresses a specific knowledge gap. A well-defined question helps maintain methodological rigor, minimizes in the review process, and facilitates by outlining the objectives upfront. According to the Cochrane Handbook for Systematic Reviews of Interventions, the should be structured to be answerable through synthesis of existing , emphasizing precision to avoid ambiguity that could lead to inconsistent interpretations. Common frameworks assist in developing research questions tailored to the review's purpose. For quantitative or clinical intervention studies, the PICO framework—standing for Population (or Patient), Intervention, Comparison, and Outcome—is widely used to break down the question into searchable components, such as "In adults with (P), does metformin (I) compared to lifestyle changes (C) improve glycemic control (O)?" This approach, originally proposed by Richardson et al. in 1995, promotes clarity and directs the literature search effectively. For qualitative or mixed-methods reviews, alternatives like PICo (Population, phenomenon of Interest, and Context) or (Sample, Phenomenon of Interest, Design, Evaluation, and Research type) are preferred to capture experiential or contextual elements, as PICO may be less sensitive for non-intervention queries. For instance, SPIDER can frame questions about patient experiences, such as "What are the experiences (E) of caregivers (S) regarding dementia care (PI) in settings (D, RT)?" These frameworks, compared in Methley et al. (2014), enhance specificity in qualitative evidence synthesis. Once formulated, the informs the development of a detailed protocol, which specifies the review's objectives, (e.g., study types, publication dates, and languages), and overall scope to prevent deviations during execution. Protocols are typically registered prospectively to promote transparency and reduce duplication; , maintained by the Centre for Reviews and Dissemination at the , serves as an international registry for health-related systematic reviews, requiring submission of the question, methods, and rationale before data collection begins. For non-health fields or scoping reviews ineligible for , the Open Science Framework (OSF) provides a platform for protocol preregistration, allowing timestamped archiving of plans and supporting practices. Involving stakeholders, such as clinicians or policymakers, during question formulation ensures relevance and practicality, as recommended in methodological guidelines. A key benefit of rigorous question formulation is its role in preventing , where the review expands uncontrollably, leading to resource inefficiency and diluted focus; studies show that poorly defined questions correlate with higher rates of protocol amendments. Common pitfalls include crafting overly broad questions, such as "What treatments work for depression?" which yield unmanageable volumes of irrelevant studies, or neglecting to align the question with feasible evidence types, resulting in empty syntheses. To mitigate these, iterative refinement with frameworks and pilot testing of criteria is essential, as highlighted in analyses of review failures.

Literature Searching

Literature searching in systematic reviews involves a structured and exhaustive process to identify all potentially relevant studies on a predefined research question, minimizing the risk of bias due to incomplete retrieval. This phase emphasizes sensitivity over precision to ensure comprehensive coverage, typically yielding thousands of records that are later screened for eligibility. Key sources for identifying studies include electronic databases such as MEDLINE (accessed via PubMed), Embase, and the Cochrane Central Register of Controlled Trials (CENTRAL) within the Cochrane Library, which collectively index millions of biomedical records from the mid-20th century onward. Grey literature, encompassing unpublished or non-commercially published materials like theses, conference proceedings, clinical trial registries (e.g., ClinicalTrials.gov), and regulatory documents, is essential to capture studies not yet indexed in journals or those at risk of publication bias. Hand-searching involves manually reviewing key journals, reference lists of included studies, and conference abstracts to uncover additional relevant citations. Effective search strategies combine controlled vocabularies, such as () in , with free-text terms to enhance sensitivity, using operators like AND (to narrow intersections), OR (to broaden synonyms), and NOT (to exclude irrelevant concepts). Citation tracking, including backward searching of references and forward searching via tools like or , helps identify related studies by tracing connections from known relevant papers. To ensure strategy quality, searches should undergo by a or information specialist using the PRESS (Peer Review of Electronic Search Strategies) checklist, which evaluates elements like translation of the research question, use of limits, and spelling. Comprehensiveness requires avoiding restrictions on , date, or status unless justified by the review's scope, ideally including studies in any to reduce , with translations sought as needed. All search details—such as database names, full search strings, dates conducted, and any filters applied—must be documented meticulously for and transparency, often appended to the review protocol or report. The yield from these searches is reported via a as per PRISMA 2020 guidelines, illustrating the total records identified (often in the thousands), duplicates removed, and progression to screening, thereby providing a visual of the process. While automation tools can assist in initial querying, manual oversight remains critical for strategy development and validation.

Screening and Selection

Screening and selection in a systematic review involve systematically applying predefined eligibility criteria to the pool of identified studies from the literature search, ensuring only relevant and appropriate studies proceed to further analysis. This process typically occurs in two sequential levels to minimize bias and maximize comprehensiveness: initial screening of titles and abstracts, followed by full-text assessment of potentially eligible studies. At the title and abstract screening stage, at least two independent reviewers examine the records to determine initial relevance, prioritizing sensitivity to avoid excluding potentially eligible studies. This step filters out clearly irrelevant items, with reviewers working separately to reduce subjective . Software tools such as Rayyan, a web-based platform designed for collaborative screening, or Covidence, which supports team-based management, facilitate this process by allowing simultaneous access, annotation, and prioritization features like machine learning-assisted suggestions. Eligibility criteria, explicitly outlined in the review protocol, are applied rigorously during both screening levels, assessing aspects such as study design, , intervention, and outcomes. Reviewers exclude studies that fail to meet any criterion, documenting reasons for exclusion at the full-text stage to ensure transparency and ; these records contribute to the PRISMA illustrating the selection pathway. Disagreements between reviewers are resolved through discussion to reach consensus, or escalated to a third reviewer for if needed. To evaluate the consistency of reviewer judgments, is often measured using statistic, which quantifies agreement beyond chance. The formula is given by: κ=po−pe1−pe\kappa = \frac{p_o - p_e}{1 - p_e} where pop_o represents the observed proportion of agreement between reviewers, and pep_e the expected proportion by chance. Kappa values above 0.8 indicate substantial agreement, helping to identify training needs or criterion ambiguities.

Data Extraction and Risk Assessment

Data extraction in systematic reviews involves systematically collecting relevant information from included studies to facilitate subsequent analysis. Reviewers typically use standardized data collection forms to record details on study characteristics, such as participant populations (e.g., demographics, eligibility criteria), interventions or exposures, comparators, outcomes (including measures, time points, and effect estimates), and methods (e.g., study design, , blinding). These forms are developed in advance, often piloted for clarity and completeness, and tailored to the review's protocol to ensure consistency across extractors. To minimize errors and subjectivity, data extraction is ideally performed independently by at least two reviewers, with discrepancies resolved through discussion or consultation with a third party; this dual extraction approach reduces transcription errors and interpretive biases, particularly for numerical outcome data. Extractors may also note any ambiguities in reporting, such as unclear denominators or missing standard deviations, which can be addressed by contacting study authors if necessary. Risk of bias assessment evaluates the of included studies to determine how confidently results can be trusted. In a systematic review, quality criteria (often referred to as risk of bias or methodological quality assessment) are set by pre-specifying them in the review protocol. Reviewers select validated tools appropriate to the study designs included, such as Cochrane's RoB 2 tool for randomized trials. Signalling questions are used to guide judgments (low risk, some concerns, high risk), performed independently by at least two reviewers. Criteria are tailored to the review question and justified transparently. For randomized controlled trials (RCTs), the Cochrane Risk of Bias 2 (RoB 2) tool is widely recommended, assessing bias across five domains: bias arising from the randomization process, due to deviations from intended interventions (performance bias), in measurement of the outcome (detection bias), due to missing outcome data (attrition bias), and in selection of the reported result (). Each domain is judged as low , some concerns, or high based on responses to signaling questions, with an overall risk judgement derived algorithmically. For non-randomized studies of interventions, the Risk Of Bias In Non-randomized Studies - of Interventions (ROBINS-I) tool is used, which evaluates bias in seven domains: bias due to , selection of participants, classification of interventions, deviations from interventions, , outcome measurement, and selection of reported results. Judgements are made as low, moderate, serious, critical, or no information, relative to a hypothetical ideal randomized trial, to inform the credibility of effect estimates. Qualitative appraisal of evidence certainty complements risk of bias assessments by grading the overall quality of the body of for specific outcomes. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach rates certainty as high, moderate, low, or very low, starting from high for RCTs and low for observational studies, then upgrading or downgrading based on five domains: risk of bias (downgraded for limitations in study design or execution), inconsistency (unexplained heterogeneity in results), indirectness (evidence not directly applicable to the review question), imprecision (wide confidence intervals suggesting uncertain estimates), and (evidence of selective reporting). This structured evaluation helps reviewers communicate the strength of supporting conclusions. During data extraction, reviewers document variations in study characteristics—such as differences in definitions, intervention intensities, or outcome measures—to inform later assessments of heterogeneity; these notes highlight potential sources of clinical or methodological diversity without attempting statistical quantification at this stage.

Data Synthesis and Analysis

Data synthesis in systematic reviews involves integrating the extracted data from included studies to draw meaningful conclusions about the , often combining qualitative and quantitative approaches depending on the nature of the evidence. This process aims to assess the consistency, strength, and applicability of findings while addressing potential biases, such as those identified during . When is feasible, quantitative methods provide a pooled estimate of effect; otherwise, approaches organize and interpret the data thematically. The choice of method is guided by the heterogeneity of studies and the availability of comparable data, ensuring transparency in how conclusions are reached. Narrative synthesis is employed when quantitative pooling via is inappropriate, such as in reviews with heterogeneous studies or non-numeric outcomes, relying primarily on words and text to summarize and explain findings from multiple studies. It typically involves four elements: developing preliminary synthesis, exploring relationships in the data, assessing robustness of the synthesis, and providing a textual summary that groups studies thematically or via tabulations. For instance, studies may be organized into tables by intervention type or outcome measures to highlight patterns, such as converging on across qualitative reports. This method promotes a structured textual approach to integration, avoiding ad hoc descriptions, and is particularly useful for synthesizing qualitative or mixed-methods . Guidance emphasizes tabulating key features like study design and results to facilitate thematic grouping and identify gaps or contradictions. Quantitative synthesis, often through , statistically combines effect estimates from comparable studies to produce an overall summary measure, such as odds ratios or mean differences, weighted by precision (e.g., inverse variance method). This is applicable when studies share similar populations, interventions, and outcomes with low clinical heterogeneity, using fixed-effect models for homogeneous data or random-effects for anticipated variation. Heterogeneity is quantified using the I² statistic, where values above 50% indicate moderate to substantial inconsistency, prompting exploration via subgroups rather than pooling. If is pursued, it provides a more precise estimate than individual studies but requires careful interpretation of forest plots displaying individual and pooled effects. To detect publication bias in quantitative syntheses, funnel plots are constructed by plotting effect sizes against their standard errors, with asymmetry suggesting smaller studies with null or negative results may be missing. Egger's regression test formally assesses this asymmetry by regressing the standardized effect estimate against its precision, where a significant intercept (typically P < 0.10) indicates potential bias. This graphical and statistical approach is recommended for meta-analyses with at least 10 studies, helping to evaluate the robustness of pooled results, though it can be influenced by true heterogeneity or small-study effects. Sensitivity analyses test the stability of synthesis findings by systematically varying methodological choices, such as excluding studies at high risk of bias, altering effect measures, or imputing missing data differently. Common applications include one-study-out analyses to identify influential studies or subgroup explorations to assess impact of factors like study quality. These analyses reveal how robust conclusions are to assumptions, with changes in direction or magnitude signaling the need for cautious interpretation; for example, excluding low-quality studies might strengthen evidence for an intervention's efficacy. Pre-specifying such analyses in the review protocol enhances transparency and minimizes selective reporting. Certainty of evidence is evaluated using the GRADE (Grading of Recommendations Assessment, Development and Evaluation) framework, which rates the overall quality for each outcome as high, moderate, low, or very low based on five domains: risk of bias, inconsistency, indirectness, imprecision, and publication bias. Starting from high certainty for randomized trials or low for observational studies, ratings are downgraded (by 1 or 2 levels) for limitations like unexplained heterogeneity (I² > 50%) or wide confidence intervals failing to meet optimal information size thresholds, and upgraded for large effects or dose-response gradients. GRADE summaries, often presented in 'Summary of Findings' tables, provide a transparent judgment of confidence in effect estimates, informing the strength of review conclusions. This approach ensures systematic reviews communicate not just findings but their reliability across outcomes.

Reporting and Dissemination

Reporting systematic reviews requires adherence to established guidelines to ensure transparency, , and completeness, allowing readers to assess the methods and findings critically. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 statement serves as the primary framework, consisting of a 27-item for the main text and an eight-item for abstracts, designed to guide the reporting of systematic reviews evaluating interventions, while also applicable to other fields. This update from the 2009 version incorporates advances in review methods, such as risk-of-bias assessments and certainty of evidence evaluations, and emphasizes the inclusion of a to illustrate the study selection process. The recommended structure for a systematic review report begins with a title and abstract that clearly identify the work as a systematic review and outline the objectives. The introduction provides rationale and objectives, followed by a detailed methods section covering eligibility criteria, information sources, search strategy, study selection, data collection, risk of bias assessment, and synthesis methods. Results sections present study selection (via the PRISMA flow diagram), characteristics of included studies, risk of bias, and synthesis outcomes, such as effect estimates from meta-analyses; the discussion interprets findings, discusses limitations, and outlines implications for practice or policy. Funding sources and competing interests are disclosed at the end. For scoping reviews, the PRISMA extension for Scoping Reviews (PRISMA-ScR) provides a 20-item tailored to mapping evidence and identifying knowledge gaps, without requiring the full meta-analytic detail of PRISMA 2020. This includes explicit reporting of rationale, protocol details, search strategy, selection of sources, data charting, and implications for future research, ensuring scoping reviews are distinguished from more evaluative systematic reviews. Dissemination of systematic reviews typically occurs through publication in peer-reviewed journals, where adherence to PRISMA enhances acceptance and impact. Organizations like Cochrane mandate PRISMA compliance for their reviews, alongside plain language summaries to make findings accessible to non-experts, policymakers, and patients; these summaries highlight key results and implications without technical jargon. Updates to existing reviews, such as those in the , follow similar reporting standards to reflect new evidence. Open access publication broadens reach and accelerates uptake, with many journals offering gold open access options for systematic reviews to maximize dissemination. Sharing review materials, including protocols (often registered in repositories like PROSPERO), full datasets, and analytic code, promotes transparency and enables reuse; repositories such as Zenodo or Figshare facilitate this, aligning with growing expectations for data sharing in high-quality reviews.

Applications Across Disciplines

Health and Medicine

In health and medicine, systematic reviews form the cornerstone of by synthesizing rigorous evidence from multiple studies to guide clinical practice and policy decisions. They are integral to the development of clinical guidelines by organizations such as the National Institute for Health and Care Excellence (NICE) and the World Health Organization (WHO), where they ensure recommendations are based on comprehensive, unbiased assessments of intervention effectiveness, harms, and applicability. The Cochrane Reviews, produced by the Cochrane Collaboration, represent the gold standard for such syntheses in health care, with over 11,000 published by 2023, spanning topics from pharmacological treatments to interventions. Systematic reviews in this domain address specific applications, including evaluations of drug efficacy, comparisons of therapeutic interventions, and assessments of diagnostic test accuracy, often incorporating meta-analyses to quantify effects across studies. Patient involvement enhances their relevance through initiatives like the Alliance, which uses priority-setting partnerships to identify evidence gaps in collaboration with patients, caregivers, and clinicians, ensuring reviews align with real-world uncertainties in care. These reviews have profoundly impacted medical practice by standardizing approaches and reducing variability in treatment decisions. A landmark example is the 1988 systematic review by the Antiplatelet Trialists' Collaboration, which analyzed 31 trials and demonstrated that prolonged antiplatelet therapy, primarily aspirin, reduced the odds of serious vascular events by 23% in patients with prior , , or transient ischemic attacks, prompting its broad adoption for secondary prevention of . In subfields like and , systematic reviews synthesize evidence on exposure-related risks to inform regulatory and preventive measures. For example, they have evaluated the health impacts of pesticide exposure, identifying associations with endocrine disruption, , and cancer, thereby supporting evidence-based policies on and occupational limits.

Social and Behavioral Sciences

In the social and behavioral sciences, systematic reviews adapt traditional methodologies to address broader, non-clinical outcomes such as behavior change, , and , often incorporating diverse evidence from interventions in , , and . Unlike reviews in health sciences that prioritize clinical , these adaptations emphasize contextual factors like impacts and long-term societal effects, guided by standards from the Campbell Collaboration, which promotes rigorous evidence synthesis for policy-relevant questions in social welfare and . The Campbell Collaboration's Methodological Expectations of Campbell Collaboration Intervention Reviews (MECCIR) outline 35 items across seven sections, building on PRISMA-2020 to ensure transparency in searching, screening, and synthesizing studies with varied designs, including quasi-experimental and qualitative data. Representative examples illustrate these applications. A Campbell systematic review and of guaranteed basic interventions in high- countries synthesized 27 studies, finding modest reductions in poverty-related outcomes like financial hardship and insecurity, highlighting the role of such reviews in evaluating social safety nets. Similarly, in behavioral therapies for , a Campbell review of Multisystemic examined 23 randomized trials, demonstrating moderate effects on reducing antisocial behaviors and improving family functioning among youth with social, emotional, and behavioral problems, underscoring the value of these reviews for community-based interventions. Challenges in conducting systematic reviews in these fields arise from the heterogeneity of study designs, ranging from randomized trials to observational and , complicating synthesis and risk-of-bias assessments. Integrating qualitative evidence, which captures nuanced social processes like participant experiences in educational programs, requires mixed-methods approaches to avoid losing contextual depth, as discussed in frameworks for combining diverse data types in reviews. Tools from the Evidence for Policy and Practice Information and Co-ordinating (EPPI-) Centre, such as EPPI-Reviewer software, facilitate this by supporting screening, coding, and thematic synthesis for education-focused reviews, enabling users to manage large datasets across review stages. The use of systematic reviews in social and behavioral sciences has grown significantly since the , driven by demands for evidence-based policymaking. This expansion has informed policies on social interventions, such as anti- programs in schools; for instance, a systematic review of 53 evaluations on school-based anti-bullying programs found that they reduced bullying perpetration by 20-23% and victimization by 17-20%, influencing guidelines from organizations like the U.S. Department of Education. These reviews align with reporting standards like those in broader guidelines to enhance accessibility for policymakers.

Environmental and Other Fields

Systematic reviews in play a crucial role in synthesizing evidence on complex ecological processes, such as the impacts of on . For instance, a systematic review examining effects on across multiple ecosystems identified shifts in distributions and increased risks, with analysis spanning genetic to levels. These reviews often highlight how rising temperatures and altered patterns exacerbate loss. The Collaboration for Environmental Evidence (CEE) provides specialized guidelines for conducting such reviews, emphasizing transparent protocols for searching heterogeneous environmental data sources, including gray literature from government reports and field observations. CEE standards, updated in version 5.1 (2022), recommend pre-registering review protocols to minimize and ensure , particularly when integrating qualitative evidence on ecosystem services. A prominent example of environmental systematic reviews is the use of systematic maps to catalog evidence on conservation interventions. These maps identify and visualize the distribution of studies on topics like effectiveness. For instance, a CEE-funded systematic map of impacts on human in developing countries collated over 1,000 articles (1,043 total), with over 25% examining linkages to economic , including improvements, but highlighting sparse data on equity effects. Unique to environmental applications, systematic reviews must address challenges in handling spatial data, such as integrating GIS-based analyses to model geographic range shifts, which requires standardized metadata for georeferenced studies to avoid aggregation biases. Similarly, incorporating long-term studies—often spanning decades—poses issues like data incompleteness due to funding discontinuities, prompting CEE guidelines to advocate for sensitivity analyses on temporal trends. Beyond ecology, systematic reviews have expanded into business, management, entrepreneurship, and engineering fields to evaluate policy effectiveness, management practices, and entrepreneurial phenomena. In business management, systematic reviews synthesize evidence on organizational strategies and contribute to theory development. Pioneering work by Tranfield, Denyer, and Smart (2003) adapted systematic review methods from health sciences to management, proposing a methodology to produce evidence-informed knowledge that accommodates heterogeneous study designs and emphasizes theoretical contributions. More recently, Sauer and Seuring (2023) outlined a six-step process—defining the research question, determining characteristics of primary studies, retrieving literature, selecting pertinent studies, synthesizing the literature, and reporting results—with 14 associated decisions that allow for flexibility, iterative refinement, and focus on theory building (inductive, abductive, or deductive). These reviews commonly use databases such as Web of Science and Scopus, and may incorporate grey literature for emerging topics. For example, a meta-analysis of 50 studies on agile practices demonstrated a 25% improvement in project success rates across industries. These reviews often employ content analysis, bibliometric techniques, or statistical synthesis to advance management theories and appraise diverse sources including case studies and surveys for replicability. In entrepreneurship research, systematic reviews follow similar core steps but emphasize peer-reviewed journal articles from high-quality outlets, with quality appraisal often based on journal ranking systems such as VHB, ABS, or JCR. They are particularly valuable for addressing terminological inconsistencies and fragmentation in the field, synthesizing diverse perspectives to clarify concepts and support theory development. Kraus et al. (2020) proposed a three-stage approach—planning the review (including protocol development), conducting the review (identification, extraction, and synthesis), and reporting findings—with a focus on transparent methodologies, concept-centric analysis, and exclusion of grey literature to maintain rigor. In , systematic reviews assess intervention , for example, mapping evidence on sustainable infrastructure that reduced material waste by 15-30% in construction projects based on 40 empirical studies. -focused reviews in these areas often quantify , such as evaluations of environmental regulations in showing compliance costs offset by long-term gains in 60% of cases. Emerging interdisciplinary areas, including approaches that link environmental, animal, and human systems, have seen significant growth in systematic reviews since 2020, driven by global health crises. This surge underscores the value of systematic methods in cross-disciplinary policy, such as mapping interventions for in agricultural settings. As of 2025, living systematic reviews have become more prominent in to address evolving threats like zoonotic diseases.

Tools and Technologies

Software for Manual Processes

Software tools for managing manual processes in systematic reviews primarily support reference organization, screening, data extraction, and compliance with reporting standards, enabling researchers to handle large volumes of literature collaboratively and transparently. like and plays a foundational role by allowing users to import, organize, and deduplicate citations from multiple databases, which is essential for preparing datasets for subsequent review stages. , a proprietary tool, facilitates the creation of customized libraries where references can be grouped by criteria such as study type or relevance, and its duplicate detection algorithm compares fields like title, author, year, and DOI to identify and merge overlaps, reducing manual effort in preprocessing search results. , an open-source alternative, offers similar capabilities through its for seamless citation capture, folder-based organization, and automated deduplication, while also supporting PDF annotation and group libraries for team-based workflows in academic settings. These tools ensure that initial literature imports—often exceeding thousands of records—are efficiently managed without data loss, as demonstrated in library protocols. For the core manual tasks of screening and data extraction, specialized platforms such as Covidence and DistillerSR provide structured, collaborative interfaces tailored to systematic review protocols. Covidence enables teams to conduct title and abstract screening in parallel, with built-in tools and customizable forms for full-text assessment, streamlining the inclusion-exclusion decisions that form the basis of review eligibility criteria. It supports data extraction by allowing reviewers to populate standardized templates for key study variables, such as participant demographics and outcomes, while tracking progress to minimize errors in multi-reviewer environments. DistillerSR complements this by offering configurable workflows for hierarchical screening—starting with titles and abstracts before advancing to full texts—and flexible forms for extracting both qualitative and quantitative data, accommodating projects with over 675,000 references per review. Both tools emphasize human oversight, with DistillerSR's interface allowing supervisors to monitor reviewer assignments and ensure consistent application of inclusion criteria across distributed teams. A evaluation highlights EPPI-Reviewer and Nested Knowledge as prominent options for comprehensive manual support, particularly in and sciences . EPPI-Reviewer, a web-based application, integrates reference import with for bulk handling, enables mobile-friendly screening and coding of studies against predefined frameworks, and includes audit trails via collaborative "wizards" that log all decisions and revisions for . Nested Knowledge similarly excels in dual-reviewer screening protocols, where teams tag and extract data using hierarchical structures to link concepts across studies, with traceable paths documenting each reference's journey from import to synthesis. These platforms were ranked highly in comparative analyses for their density of manual features, such as customizable coding schemes and export options, outperforming generalist tools in handling complex, multi-stage reviews. Compliance with reporting guidelines like PRISMA is embedded in these tools to facilitate transparent documentation and export of review outputs. DistillerSR generates PRISMA 2020 flow diagrams automatically from screening data, alongside reports on and full audit trails that capture 100% of changes to searches, references, and extractions, ensuring regulatory readiness in fields like . Nested Knowledge produces PRISMA-compliant diagrams and supports exports to formats like Excel or RIS for integration with reporting software, while its real-time tracking maintains an immutable record of manual inputs. EPPI-Reviewer aids compliance through Excel-compatible exports of screening results and synthesis summaries, aligning with Cochrane-endorsed standards for verifiable review processes. Covidence similarly streamlines PRISMA adherence by visualizing screening flows and allowing direct export of extracted data, reducing the administrative burden of manual diagram creation.

Automation and AI Innovations

Automation in systematic reviews has increasingly incorporated machine learning (ML) techniques to streamline labor-intensive processes such as title and abstract screening. ASReview, an open-source tool employing active learning algorithms, enables reviewers to iteratively label records while the model predicts relevance for subsequent ones, thereby prioritizing potentially relevant studies. This approach has demonstrated substantial workload reductions, with evaluations showing an average 83% decrease in screening time while identifying 95% of relevant records in biomedical reviews. Large language models (LLMs) represent a more recent advancement, facilitating end-to-end automation of review workflows. For instance, otto-SR, introduced in 2025, leverages LLMs such as GPT-4o and o3-mini to handle tasks from literature searching and screening to data extraction and synthesis, completing workflows equivalent to 12 work-years of human effort in just two days for Cochrane-level reviews. Similarly, Rayyan incorporates AI-driven prioritization features, using predictive algorithms to rank records by relevance during screening, which enhances efficiency in collaborative review environments. Evidence PRIME's Laser AI tool further exemplifies this trend, applying (NLP) to automate deduplication, screening, and quality assessment in living systematic reviews, minimizing human intervention while maintaining methodological rigor. Integration of these AI innovations into established frameworks like Cochrane has accelerated since 2023, with guidelines now endorsing semi-automated tools for evidence synthesis to address rising review volumes. A analysis of 2,271 Cochrane, Campbell, and Environmental Evidence syntheses from 2017 to 2024 revealed a marked uptick in ML-based , particularly for screening and extraction, reflecting broader adoption in high-impact reviews. NLP techniques have proven particularly effective for semi-automated data extraction, where models extract structured information from unstructured text with accuracies exceeding 80% for key variables like outcomes and interventions in clinical studies. Despite these efficiencies, ethical considerations remain paramount, especially regarding transparency in AI to ensure and mitigate biases. Studies emphasize the need for explainable AI models that disclose prediction rationales, as opaque "" processes could undermine trust in automated outputs for . A 2025 analysis indicates that AI tools are integrated into approximately 12% of evidence syntheses (via ML-enabled tools), with about 5% explicitly reporting ML use, driven by their ability to scale reviews amid growing literature volumes, though full is tempered by requirements for human oversight.

Limitations and Challenges

Methodological Biases and Risks

, also known as the file-drawer problem, occurs when studies with statistically significant or positive results are more likely to be published than those with null or negative findings, leading to an overestimation of effect sizes in systematic reviews and meta-analyses. This bias arises because researchers and journals preferentially disseminate favorable outcomes, leaving non-significant results unpublished and hidden in file drawers. Selective complements this issue by involving the selective inclusion or emphasis of certain outcomes within published studies, such as highlighting only statistically significant results while omitting others, which distorts the synthesized evidence. These biases threaten the validity of systematic reviews by skewing the pooled estimates toward inflated effects. Funnel plots serve as a primary visual tool for detecting , plotting study effect sizes against a measure of precision (such as ) to reveal indicative of missing small studies with non-significant results. In an unbiased , the plot resembles a symmetrical inverted ; suggests . At the review level, additional risks include outdated searches, as new evidence can emerge that alters conclusions, with update frequency depending on the topic's evolution and availability of recent studies rather than a fixed timeline, potentially rendering reviews misleading for decision-making. Incomplete inclusion of —such as unpublished reports, , or government documents—further exacerbates this by underrepresenting non-commercial evidence, which often reports smaller or null effects. To mitigate these biases, funnel plot asymmetry can be statistically tested using methods like Egger's regression test, which regresses the standardized effect estimate against its precision to detect significant deviation from symmetry (p < 0.05 indicating potential bias). The trim-and-fill method addresses identified bias by iteratively estimating and imputing "missing" studies on the less-populated side of the , then recalculating the pooled effect to assess sensitivity. For timeliness, living systematic reviews continuously update searches and incorporate new evidence as it emerges, reducing the risk of obsolescence in rapidly evolving fields. Tools for assessing study-level biases, such as the RoB 2 tool, can complement these by evaluating individual trial risks during data extraction. Recent literature from 2024-2025 highlights emerging concerns with AI-induced es in automated screening for systematic reviews, where models may perpetuate algorithmic unfairness—such as over- or under-retrieval of studies based on training data imbalances—potentially introducing new distortions in selection. For instance, stage-wise es in AI pipelines can amplify disparities if not transparently reported, underscoring the need for human oversight and audits in hybrid workflows.

Resource and Reproducibility Issues

Conducting systematic reviews is highly resource-intensive, often requiring 12 to 24 months from initiation to completion, depending on the scope and complexity of the topic. These timelines reflect the extensive stages involved, including protocol development, literature searching, screening, extraction, and synthesis, which demand coordinated effort to maintain rigor. Typically, a team of 3 to 5 members is assembled for standard reviews, including subject experts, methodologists, librarians, and statisticians, though larger teams of up to 10 or more are common for comprehensive or multidisciplinary projects. Financial costs can exceed $100,000 for large-scale reviews, encompassing personnel salaries, software licenses, database access fees, and publication expenses, with estimates ranging from $80,000 to $300,000 USD per review. Reproducibility in systematic reviews is frequently compromised by poor adherence to established protocols and standards. Assessments using the AMSTAR 2 tool reveal widespread issues, with up to 90% of reviews rated as critically low quality due to deficiencies in protocol registration, search comprehensiveness, and of bias evaluation. Additionally, access to proprietary or poses significant barriers, as unavailable datasets from industry-sponsored studies or paywalled sources hinder independent verification and replication of findings. These challenges undermine the transparency essential for evidence-based , particularly in fields reliant on cumulative knowledge synthesis. Reporting gaps further exacerbate reproducibility concerns, with many systematic reviews featuring incomplete descriptions of methods, such as unclear inclusion criteria or unstated data extraction processes, and limited inclusion of human study data when applicable. To address these, the NIRO-SR guidelines, introduced in 2023, provide a structured for planning and conducting non-interventional, reproducible, and open systematic reviews, emphasizing pre-registration, sharing, and detailed methodological transparency. Emerging solutions focus on mitigating these resource and hurdles through open-source tools, enhanced programs, and greater patient and public involvement. , such as Rayyan for screening and packages for , reduces costs and promotes shared methodologies accessible to diverse teams. Specialized initiatives, including workshops on protocol adherence and AMSTAR 2 application, build reviewer capacity and improve compliance rates. Incorporating patient and public involvement from the protocol stage enhances review relevance, ensures ethical considerations, and fosters broader stakeholder buy-in for transparent dissemination.

History and Evolution

Early Origins

The origins of systematic reviews can be traced to early efforts in evidence synthesis within medicine, beginning in the . In 1747, Scottish naval surgeon conducted what is regarded as the first controlled to evaluate treatments for , assigning 12 patients with the disease to six pairs receiving different interventions—such as cider, vinegar, or —while controlling for diet and conditions. His findings, published in 1753 in A Treatise of the Scurvy, included a critical and chronological review of prior literature on the disease, synthesizing historical accounts and proposed remedies to contextualize his trial results; this approach exemplified an early proto-systematic synthesis of evidence, though citrus treatments were not widely adopted until later. In the early , statistical innovations laid groundwork for quantitative meta-analytic techniques, particularly in . During the and , Ronald A. Fisher, working at the Rothamsted Experimental Station, developed methods for analyzing data from multiple experiments, such as combining results on effects across varying years and locations to assess consistency and variability. In his 1935 book , Fisher illustrated how to integrate findings from several agricultural studies using techniques like the inverse sine transformation for proportions, promoting the idea of treating disparate datasets as part of a unified to draw robust inferences. The medical roots of systematic reviews emerged in the 1970s amid growing critiques of traditional narrative reviews, which often relied on selective or rather than rigorous evaluation. , a British epidemiologist, highlighted these shortcomings in his 1972 Effectiveness and Efficiency: Random Reflections on Health Services, arguing that healthcare decisions should be based on systematic evaluations of randomized controlled trials to identify interventions that truly benefit patients. specifically called for compiling and analyzing all available randomized trial data on specific topics, such as the efficacy of treatments for conditions like or , to replace unreliable expert opinions with evidence-based assessments. Initial frameworks for systematic reviews gained traction in the , revealing persistent delays in clinical adoption. A seminal 1992 study by and colleagues examined cardiovascular therapies for , finding that cumulative meta-analyses of randomized controlled trials demonstrated statistically significant mortality reductions for treatments like thrombolytics as early as 1973 (based on 10 trials with 2,544 patients), yet most expert recommendations and textbooks lagged by 10–13 years, continuing to endorse ineffective or harmful options like lidocaine. This analysis underscored the need for systematic methods to accelerate the integration of trial evidence into practice, particularly in where narrative overviews had delayed uptake of proven interventions like beta-blockers and antiplatelet drugs.

Key Milestones and Modern Advances

The 1990s marked a pivotal era for systematic reviews, with the establishment of the Cochrane Collaboration in 1993, which aimed to organize production and maintenance of systematic reviews of healthcare interventions based on randomized controlled trials. This initiative was followed by the publication of the first Cochrane Handbook in 1994, providing methodological guidance that standardized review processes and emphasized rigorous evidence synthesis. Concurrently, meta-analyses gained prominence in leading medical journals, including the New England Journal of Medicine, where publications such as cumulative meta-analyses of therapeutic trials for highlighted their utility in tracking evolving evidence and informing clinical strategies. In the 2000s and 2010s, systematic reviews expanded beyond medicine into social sciences through the founding of the Campbell Collaboration in 2000, which focused on evidence synthesis for policy and practice in education, social welfare, and crime reduction. A key methodological advancement came with the PRISMA statement in 2009, a 27-item and flow diagram designed to enhance the transparency and completeness of reporting in systematic reviews and meta-analyses. By the mid-2010s, the field had scaled significantly, with over 10,000 systematic reviews published annually, reflecting widespread adoption across disciplines and the growing volume of primary research. The EQUATOR Network, launched in 2008, further supported global standardization by promoting reporting guidelines like PRISMA and fostering collaboration among researchers, journals, and funders to improve research reliability. Recent developments from 2020 to 2025 have emphasized adaptability and technological integration. The PRISMA 2020 update refined the original guidelines to incorporate advances in search methods, risk-of-bias assessments, and synthesis approaches, addressing limitations in equity, certainty of evidence, and non-health research. The COVID-19 pandemic accelerated the use of living systematic reviews, which continuously update with emerging evidence to guide rapid decision-making, as seen in initiatives like Cochrane's living reviews on treatments and vaccines. AI integration advanced with tools like ASReview in 2019, an open-source machine learning framework that employs active learning to streamline title and abstract screening, reducing workload by up to 80% while maintaining accuracy. By 2025, large language model (LLM) workflows have emerged as milestones in automation, enabling tasks such as automated data extraction and protocol generation, though human oversight remains essential for validity. For non-health fields, the NIRO-SR guidelines, published in 2023, provide a comprehensive checklist for non-interventional, reproducible, and open systematic reviews, filling gaps in protocol pre-registration and reporting outside clinical contexts.

References

  1. https://www.ncbi.nlm.nih.gov/books/NBK44088/
  2. https://pmc.ncbi.nlm.nih.gov/articles/PMC5903119/
  3. https://link.springer.com/article/10.1007/s11846-023-00668-3
  4. https://link.springer.com/article/10.1007/s11365-020-00635-4
  5. https://ebm.bmj.com/content/23/4/121
  6. https://www.sciencedirect.com/science/article/pii/S0895435621001748
  7. https://www.betterevaluation.org/methods-approaches/methods/systematic-review
  8. https://pubmed.ncbi.nlm.nih.gov/34550581/
  9. https://pubmed.ncbi.nlm.nih.gov/9245227/
  10. https://pmc.ncbi.nlm.nih.gov/articles/PMC4504929/
  11. https://pmc.ncbi.nlm.nih.gov/articles/PMC8133804/
  12. https://bmjmedicine.bmj.com/content/1/1/e000071
  13. https://www.tandfonline.com/doi/full/10.1080/1364557032000119616
  14. https://www.acpjournals.org/doi/10.7326/M18-0850
  15. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-018-0611-x
  16. https://jbi-global-wiki.refined.site/space/MANUAL/355862553
  17. https://journals.lww.com/jphmp/fulltext/2024/07000/a_scoping_review_of_health_equity_interventions_in.4.aspx
  18. https://www.frontiersin.org/journals/public-health/articles/10.3389/fpubh.2023.1161645/full
  19. https://www.ncbi.nlm.nih.gov/books/NBK378934/
  20. https://journals.sagepub.com/doi/10.3102/0013189X005010003
  21. https://onlinelibrary.wiley.com/doi/10.1002/sim.1186
  22. https://www.prisma-statement.org/
  23. https://www.bmj.com/content/372/bmj.n71
  24. https://guides.library.utoronto.ca/systematicreviews/rapidreviews
  25. https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-022-02011-5
  26. https://www.bmj.com/content/384/bmj-2023-076335
  27. https://methods.cochrane.org/sites/methods.cochrane.org.rapidreviews/files/uploads/cochrane_rr_-_guidance-23mar2020-final.pdf
  28. https://www.jclinepi.com/article/S0895-4356(17)30636-4/fulltext
  29. https://community.cochrane.org/sites/default/files/uploads/inline-files/Transform/201912_LSR_Revised_Guidance.pdf
  30. https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-016-0596-4
  31. https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-023-02325-y
  32. https://training.cochrane.org/handbook/current/chapter-02
  33. https://pubmed.ncbi.nlm.nih.gov/7582737/
  34. https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-014-0579-0
  35. https://pubmed.ncbi.nlm.nih.gov/22829486/
  36. https://www.crd.york.ac.uk/prospero/
  37. https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-023-02255-9
  38. https://pmc.ncbi.nlm.nih.gov/articles/PMC6691636/
  39. https://training.cochrane.org/handbook/current/chapter-04
  40. https://www.prisma-statement.org/prisma-search
  41. https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-016-0384-4
  42. https://pmc.ncbi.nlm.nih.gov/articles/PMC3900052/
  43. https://training.cochrane.org/handbook/current/chapter-05
  44. https://training.cochrane.org/handbook/current/chapter-08
  45. https://methods.cochrane.org/bias/resources/rob-2-revised-cochrane-risk-bias-tool-randomized-trials
  46. https://www.bmj.com/content/355/bmj.i4919
  47. https://gdt.gradepro.org/app/handbook/handbook.html
  48. https://training.cochrane.org/handbook/current/chapter-09
  49. https://www.bmj.com/content/368/bmj.l6890
  50. https://training.cochrane.org/handbook/current/chapter-10
  51. https://www.bmj.com/content/315/7109/629
  52. https://www.gradeworkinggroup.org/
  53. https://pubmed.ncbi.nlm.nih.gov/33782057/
  54. https://pubmed.ncbi.nlm.nih.gov/30178033/
  55. https://www.cochrane.org/authors/handbooks-and-manuals/handbook/current/chapter-iii
  56. https://www.bmj.com/content/379/bmj-2022-072428
  57. https://pubmed.ncbi.nlm.nih.gov/35285884/
  58. https://www.nice.org.uk/process/pmg20/chapter/6-reviewing-research-evidence
  59. https://www.who.int/publications/who-guidelines
  60. https://pmc.ncbi.nlm.nih.gov/articles/PMC11795965/
  61. https://pmc.ncbi.nlm.nih.gov/articles/PMC6720333/
  62. https://pubmed.ncbi.nlm.nih.gov/3125883/
  63. https://www.sciencedirect.com/science/article/pii/S2214750024002233
  64. https://pmc.ncbi.nlm.nih.gov/articles/PMC8118386/
  65. https://www.campbellcollaboration.org/methods/standards/
  66. https://www.campbellcollaboration.org/review/effects-of-guaranteed-basic-income-interventions-on-poverty-related-outcomes-in-high-income-countries-a-systematic-review-and-meta-analysis/
  67. https://www.campbellcollaboration.org/review/multisystemic-therapy-social-emotional-behavioral-problems/
  68. https://pmc.ncbi.nlm.nih.gov/articles/PMC404509/
  69. https://eppi.ioe.ac.uk/cms/er4/
  70. https://onlinelibrary.wiley.com/doi/10.4073/csr.2009.6
  71. https://www.tandfonline.com/doi/full/10.1080/20964129.2018.1530054
  72. https://environmentalevidence.org/information-for-authors/
  73. https://environmentalevidence.org/wp-content/uploads/2022/10/CEE-Guidelines-Version-5.0-051022.pdf
  74. https://environmentalevidence.org/project/what-are-the-effects-of-nature-conservation-on-human-well-being-a-systematic-map-of-empirical-evidence-from-developing-countries/
  75. https://journals.sagepub.com/doi/10.1177/10704965231190126
  76. https://www.researchgate.net/publication/6618138_Guidelines_for_Systematic_Review_in_Environmental_Management
  77. https://onlinelibrary.wiley.com/doi/10.1111/1467-8551.00375
  78. https://onlinelibrary.wiley.com/doi/10.1111/ijmr.12245
  79. https://www.tandfonline.com/doi/full/10.1080/03043797.2021.1980770
  80. https://www.sciencedirect.com/science/article/abs/pii/S1462901122001071
  81. https://www.frontiersin.org/journals/public-health/articles/10.3389/fpubh.2022.889854/full
  82. https://www.cochrane.org/news/new-cochrane-review-living-systematic-review-antimicrobial-resistance
  83. https://library-guides.ucl.ac.uk/endnote/systematic
  84. https://www.zotero.org/
  85. https://guides.lib.unc.edu/systematic-reviews/manage-citations
  86. https://www.covidence.org/
  87. https://www.distillersr.com/
  88. https://www.distillersr.com/products/distillersr-systematic-review-software
  89. https://pubmed.ncbi.nlm.nih.gov/35499859/
  90. https://about.nested-knowledge.com/
  91. https://www.nature.com/articles/s42256-020-00287-7
  92. https://pmc.ncbi.nlm.nih.gov/articles/PMC11624811/
  93. https://www.medrxiv.org/content/10.1101/2025.06.13.25329541v1
  94. https://www.evidenceprime.com/blog/webinar-laser-ai-the-new-generation-tool-for-systematic-reviews
  95. https://onlinelibrary.wiley.com/doi/full/10.1002/cesm.70046
  96. https://www.cambridge.org/core/journals/research-synthesis-methods/article/automating-the-data-extraction-process-for-systematic-reviews-using-gpt4o-and-o3/28C54A601B80E2BE6611C8B7B15FEDAF
  97. https://bmcmedethics.biomedcentral.com/articles/10.1186/s12910-025-01243-z
  98. https://www.scribbr.com/research-bias/publication-bias/
  99. https://web.ma.utexas.edu/users/mks/statmistakes/filedrawer.html
  100. https://catalogofbias.org/biases/outcome-reporting-bias/
  101. https://pmc.ncbi.nlm.nih.gov/articles/PMC10933152/
  102. https://pubmed.ncbi.nlm.nih.gov/11576817/
  103. https://journals.sagepub.com/doi/pdf/10.1177/1536867X0400400204
  104. https://www.bmj.com/content/354/bmj.i3507
  105. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-017-0347-z
  106. https://pubmed.ncbi.nlm.nih.gov/10877304/
  107. https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1001603
  108. https://www.medrxiv.org/content/10.1101/2025.05.16.25327774v1
  109. https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-024-02682-2
  110. https://www.researchgate.net/publication/314107862_Analysis_of_the_time_and_workers_needed_to_conduct_systematic_reviews_of_medical_interventions_using_data_from_the_PROSPERO_registry
  111. https://guides.mclibrary.duke.edu/sysreview/team
  112. https://guides.lib.uw.edu/hsl/sr/[plan](/page/Plan)
  113. https://www.sciencedirect.com/science/article/pii/S2451865419302054
  114. https://www.sciencedirect.com/science/article/pii/S1551741124004042
  115. https://pmc.ncbi.nlm.nih.gov/articles/PMC8863703/
  116. https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0243091
  117. https://www.researchgate.net/publication/372293438_An_integrative_framework_for_planning_and_conducting_Non-Intervention_Reproducible_and_Open_Systematic_Reviews_NIRO-SR
  118. https://www.frontiersin.org/journals/research-metrics-and-analytics/articles/10.3389/frma.2023.1268045/full
  119. https://bmjopen.bmj.com/content/14/9/e083215
  120. https://pmc.ncbi.nlm.nih.gov/articles/PMC3149409/
  121. https://www.jameslindlibrary.org/lind-j-1753/
  122. https://pubmed.ncbi.nlm.nih.gov/12496338/
  123. https://pmc.ncbi.nlm.nih.gov/articles/PMC2121629/
  124. https://www.jameslindlibrary.org/cochrane-al-1972/
  125. https://pmc.ncbi.nlm.nih.gov/articles/PMC2746659/
  126. https://pubmed.ncbi.nlm.nih.gov/1535110/
  127. https://www.jameslindlibrary.org/wp-data/uploads/2010/05/Antman_Lau_Kupelnick_Mosteller_Chalmers_1992.pdf
  128. https://www.cochrane.org/about-us/our-story
  129. https://pmc.ncbi.nlm.nih.gov/articles/PMC10284251/
  130. https://www.nejm.org/doi/full/10.1056/NEJM199207233270406
  131. https://www.campbellcollaboration.org/about/history/
  132. https://pubmed.ncbi.nlm.nih.gov/19621072/
  133. https://www.ahajournals.org/doi/10.1161/cir.0000000000000523
  134. https://www.equator-network.org/about-us/equator-network-what-we-do-and-how-we-are-organised/
  135. https://asreview.nl/
  136. http://gala.gre.ac.uk/id/eprint/37802/
Add your contribution
Related Hubs
User Avatar
No comments yet.