National Academies Launch Update to Foundational 2011 Standards

The National Academies of Sciences, Engineering, and Medicine have convened an ad hoc committee to revise the landmark 2011 standards for systematic reviews of comparative effectiveness research. This effort builds directly on the Institute of Medicine report titled Finding What Works in Health Care: Standards for Systematic Reviews, which established 21 standards covering the full lifecycle of evidence synthesis.

The committee's work responds to rapid evolution in evidence synthesis methods, stakeholder engagement practices, and digital technologies that have transformed how researchers locate, appraise, and integrate health care data since the original standards were published.

Background on the 2011 Standards and Their Enduring Influence

In 2011, the Institute of Medicine committee identified significant variability in systematic review quality. Many reviews lacked transparency in protocol development, conflict-of-interest management, and evidence appraisal. The resulting 21 standards addressed eight core areas for initiating reviews and additional standards for finding and assessing studies, synthesizing evidence, and reporting findings.

These standards quickly became a reference point for organizations producing clinical practice guidelines, health technology assessments, and policy reports. They emphasized minimizing bias through structured protocols, public registration, and independent peer review.

Scope and Objectives of the Current Revision Project

The new committee will evaluate each of the original 21 standards against contemporary practices. Key focus areas include incorporating advances in living systematic reviews, artificial intelligence-assisted screening, patient and public involvement throughout the process, and methods for synthesizing complex or sparse evidence.

The project aims to deliver updated standards, a framework for their application, and identification of areas requiring further methodological research. Emphasis is placed on maintaining rigor while improving usability for diverse end users, including clinicians, policymakers, patients, and payers.

Call for Perspectives and Stakeholder Engagement

In early 2026, the National Academies issued a public call for perspectives to inform the committee's deliberations. Researchers, review producers, guideline developers, and other stakeholders were invited to share experiences with the 2011 standards and suggestions for improvement.

This inclusive approach mirrors one of the original report's core principles: ensuring user and stakeholder input shapes review questions and processes. Responses are helping the committee identify gaps in areas such as equity considerations, rapid review adaptations, and integration of real-world evidence.

Photo by Austin Kirk on Unsplash

Key Areas Targeted for Revision

Committee members are examining updates across multiple domains. Protocol development standards may incorporate requirements for living review protocols that allow ongoing updates. Standards for managing conflicts of interest are likely to address new challenges posed by industry-funded data sources and open-science platforms.

Evidence synthesis methods are another priority. The original standards predated widespread use of network meta-analysis, GRADE extensions for complex interventions, and machine-learning tools for study selection. Updated guidance will likely recommend validated approaches for these techniques while preserving requirements for human oversight and transparency.

Reporting standards will also receive attention. The committee is considering alignment with evolving checklists such as PRISMA 2020 and extensions for abstracts, protocols, and equity-focused reviews.

Implications for Researchers and Evidence Producers

Academic researchers conducting systematic reviews will need to adapt workflows once new standards are released. Institutions supporting evidence synthesis centers may revise training programs and quality assurance processes. Funding agencies could incorporate the updated standards into grant requirements for evidence reviews.

PhD students and early-career investigators specializing in health services research or clinical epidemiology stand to benefit from clearer expectations. The revisions may streamline certain processes while raising the bar in others, particularly around reproducibility and stakeholder engagement.

Potential Impacts on Clinical Practice Guidelines and Policy

Systematic reviews underpin most major clinical practice guidelines issued by organizations such as the U.S. Preventive Services Task Force and professional societies. Revised standards could lead to more consistent, higher-quality inputs for these guidelines, ultimately affecting patient care recommendations and coverage decisions.

Health technology assessment bodies and payers may also adjust their evidence requirements. Greater emphasis on patient engagement and equity could result in reviews that better reflect diverse populations and outcomes important to end users.

Timeline and Next Steps for the Committee

The project remains in the information-gathering phase as of June 2026. The committee is reviewing submitted perspectives and planning public meetings. A draft report is anticipated in the coming months, followed by a public comment period before final publication.

Interested parties can monitor progress through the National Academies project page and sign up for updates. Participation in future workshops or submission of additional input remains possible.

Photo by Luis Cortés on Unsplash

Broader Context Within Evidence-Based Health Care

This standards update occurs alongside parallel efforts to improve evidence synthesis globally. Initiatives such as the Cochrane Collaboration's methodological developments and the EQUATOR Network's reporting guidelines continue to evolve. The National Academies effort complements these by focusing specifically on U.S. comparative effectiveness research needs while drawing on international best practices.

Advances in open data, preprint servers, and automated tools create both opportunities and challenges. The revised standards are expected to balance innovation with safeguards against bias and error.

Looking Ahead: Preparing for the Updated Standards

Organizations and individuals involved in health care evidence synthesis can begin preparing now. Reviewing the 2011 standards alongside recent methodological literature provides a strong foundation. Participating in professional networks focused on systematic review methods offers opportunities to stay informed.

Academic institutions may consider developing internal capacity for stakeholder engagement and technology-supported review processes. These preparations position teams to adopt the new standards efficiently once released.