Academic Jobs - Home of Higher Ed Logo

UK Officials Describe Distributed Peer Review as 'Good but No Holy Grail' for Research Assessment

0views
Submit News
a laptop computer sitting on top of a wooden desk
Photo by Emiliano Vittoriosi on Unsplash

UK Research Officials Weigh In on Distributed Peer Review

At the Association of Research Managers and Administrators conference held in June 2026, a senior metascience adviser from the UK Metascience Unit offered a measured view on distributed peer review. Jack Leahy described the approach as promising yet cautioned against viewing it as a universal solution for the challenges facing research funding assessment. His comments reflect ongoing efforts by the Department for Science, Innovation and Technology and UK Research and Innovation to refine how grants are evaluated amid rising application volumes.

Distributed peer review has gained attention as funders seek ways to handle increasing numbers of proposals while maintaining quality. Leahy emphasised that it serves as one option among several, suitable for certain schemes but not all. This perspective comes at a time when traditional peer review processes face strain from high demand and administrative burdens.

Understanding Distributed Peer Review in Detail

Distributed peer review, often abbreviated as DPR, operates on a reciprocal model where individuals who submit applications to a funding call also serve as reviewers for other submissions in the same opportunity. Each applicant agrees to provide assessments, and their own proposal receives evaluations from fellow applicants. Importantly, the scores assigned by a reviewer have no direct impact on the ranking of their own application, which helps preserve impartiality.

The process begins with applicants submitting proposals and simultaneously committing to review a set number of others. Reviews are typically completed independently, with scores aggregated to inform funding decisions. This differs from conventional methods that rely on external volunteer experts or convened panels. Proponents note that DPR can increase the speed and volume of feedback while drawing on the collective expertise of the applicant pool itself.

Guidance from UK authorities outlines clear rules to support consistent application of the method, including instructions for scoring and conflict management. The approach draws on principles of crowd wisdom, where a larger group of informed participants contributes to evaluations rather than a smaller set of gatekeepers.

Challenges Facing Traditional Grant Assessment in the UK

UK research funders have reported sharp increases in grant applications in recent years, creating bottlenecks in assessment timelines. Traditional peer review often involves recruiting external specialists, which can lead to delays and reviewer fatigue. The Independent Review of Research Bureaucracy in 2022 and subsequent analyses highlighted the need for more efficient, tailored processes.

High volumes strain resources at institutions and funding bodies alike. Researchers spend considerable time preparing applications with uncertain success rates, while panels convene to deliberate. These pressures have prompted exploration of alternatives that maintain rigour without adding excessive administrative layers.

The UK Metascience Unit and Recent Trials

The UK Metascience Unit, a collaboration between DSIT and UKRI, has actively tested distributed peer review as part of broader efforts to improve research processes. A trial conducted by UKRI demonstrated significant efficiency gains, with assessment times reduced by up to 65 percent compared to standard calls. This led to wider adoption in selected funding opportunities across research councils.

Officials have positioned DPR as a response to recommendations from earlier reviews of peer review practices. The method aligns with calls for more democratic and scalable assessment frameworks. Implementation has included specific rules to ensure fairness, such as mechanisms to prevent strategic scoring.

Further iterations are under development, including provisions for co-leads on applications to participate as reviewers, which could distribute the workload more evenly.

Benefits Observed in Practice

Participants in DPR pilots have noted faster turnaround and potentially more consistent feedback due to the larger pool of reviewers. The approach reduces reliance on recruiting external volunteers, freeing administrative capacity. It also encourages applicants to engage deeply with peers' work, fostering a broader understanding of the research landscape.

By involving applicants directly, the system can feel more inclusive, particularly for early-career researchers who gain experience in evaluation. Funders report streamlined decision-making, which supports quicker disbursement of resources to successful projects.

Limitations Highlighted by Officials

Jack Leahy stressed that distributed peer review should not be treated as a complete fix. It works best for funding calls with sufficient application volumes and comparable proposals. Niche opportunities with fewer submissions may not benefit equally, as the reciprocal reviewer pool could prove too limited.

Concerns raised at the conference included the additional time burden on applicants, who must balance reviewing duties with their research commitments. Some delegates questioned whether the absence of panel-style discussion limits opportunities for clarification or nuanced debate on complex proposals. Officials acknowledged these points and noted that DPR represents one tool rather than a replacement for all existing methods.

Stakeholder Perspectives from Researchers and Administrators

University research managers have expressed interest in DPR for its potential to accelerate processes, though they emphasise the need for clear communication to applicants about expectations. Researchers appreciate the potential for quicker outcomes but voice worries about workload, especially in competitive environments where time is already scarce.

Early-career academics and postdoctoral researchers may find value in gaining review experience, yet they also highlight risks if the system inadvertently favours those with more capacity. Funders continue to monitor feedback to refine guidelines and ensure equitable participation.

Connections to Artificial Intelligence in Research

Discussions at the conference extended to the role of AI in grant writing and assessment. Leahy announced plans for a comprehensive national survey examining how and why researchers across disciplines use AI tools. While correlation exists between AI adoption and application volumes, causation remains under investigation.

Officials noted that AI can assist applicants with strong ideas but weaker writing skills or those for whom English is not a first language. Detection tools for AI-generated content were described as unreliable at the individual level. The focus remains on responsible use rather than prohibition.

Official UK government guidance on distributed peer review provides further details on integrating these elements.

Implications for UK Higher Education and Research Careers

Changes in assessment methods influence how researchers allocate time and position their work. Faster processes could benefit those seeking timely funding for projects, while workload considerations affect work-life balance. Institutions may need to provide support for staff engaging in DPR to maximise participation without compromising research output.

For those pursuing academic careers, understanding evolving review practices becomes increasingly relevant. Awareness of these developments can inform strategies for grant writing and professional development.

Complementary Approaches and Future Outlook

Leahy and colleagues pointed to partial randomisation and other innovations as additional options for funders. Combining methods tailored to specific schemes offers flexibility. Continued experimentation, informed by data from trials and the upcoming AI survey, will shape refinements.

The broader goal remains a research system that supports high-quality work efficiently. Distributed peer review contributes to this aim but requires ongoing evaluation to address limitations and optimise outcomes for the diverse UK research community.

Nature coverage of distributed peer review experiments offers additional international context on similar initiatives.

a web page with the words design workflows on it

Photo by Team Nocoloco on Unsplash

Practical Guidance for Researchers Considering DPR Opportunities

Those preparing applications should review funder-specific guidelines carefully, noting review commitments and scoring criteria. Allocating dedicated time for assessments helps maintain quality. Engaging constructively with the process can yield insights into peer expectations and strengthen future submissions.

Institutions and professional associations continue to share best practices through events like ARMA conferences. Staying informed supports effective navigation of these evolving assessment landscapes.

Portrait of Dr. Liam Whitaker
About the author

Dr. Liam WhitakerView author

Academic Jobs In House Author

Discussion

Sort by:

Be the first to comment on this article!

You

Please keep comments respectful and on-topic.

New0 comments

Join the conversation!

Add your comments now!

Have your say

Engagement level

Browse by Faculty

Browse by Subject

Frequently Asked Questions

🔍What is distributed peer review?

Distributed peer review (DPR) is a funding assessment model in which applicants to a grant call also review other proposals submitted to the same opportunity. Each participant provides scores that help determine outcomes, with safeguards ensuring a reviewer's own application is not affected by their assessments. This reciprocal system aims to increase speed and scalability compared to traditional external reviewer panels.

⚖️How does distributed peer review differ from traditional peer review?

Traditional peer review typically relies on external volunteer experts or convened panels who assess proposals independently of the applicant pool. In contrast, DPR draws reviewers directly from the group of applicants, creating a larger, more immediate reviewer base while reducing recruitment needs. Both approaches seek rigorous evaluation but differ in structure and participant involvement.

🗣️What did UK officials say about distributed peer review?

At the ARMA 2026 conference, Jack Leahy, senior metascience adviser at the UK Metascience Unit, described distributed peer review as a valuable option but emphasised it is not the holy grail. He noted it works well for certain funding schemes with adequate application volumes yet is not suitable for every opportunity, particularly niche calls.

📊What results came from UKRI trials of DPR?

UKRI trials found that distributed peer review shortened assessment times by up to 65 percent compared with standard processes. This efficiency gain contributed to its rollout in selected major funding calls. Officials continue to refine the approach based on participant feedback and implementation experience.

What are the main benefits of distributed peer review?

Key advantages include faster decision timelines, reduced administrative burden on funders, and access to a broader pool of reviewer expertise. The model can feel more democratic and provides applicants with direct exposure to peer evaluation standards. It also supports scalability during periods of high application volumes.

⚠️What limitations does distributed peer review have?

Limitations include potential workload increases for applicants, reduced opportunity for in-depth panel discussion, and lower suitability for low-volume or highly specialised funding calls. Officials stress the importance of matching the method to the specific characteristics of each scheme.

🤖How does DPR relate to AI use in research applications?

Discussions highlighted correlations between AI tools and rising application numbers. A planned national survey will examine AI adoption patterns. Officials noted AI can support applicants with strong ideas but varying writing skills, and detection tools remain imperfect for individual cases.

👥Who can participate in distributed peer review?

Participation is tied to submitting an application to a DPR-designated funding call. Applicants agree to both submit proposals and complete reviews. Newer iterations explore options for co-leads to share review responsibilities, helping manage individual workloads.

🛠️What other approaches complement DPR in UK research funding?

Officials mentioned partial randomisation of decisions and ongoing improvements to traditional peer review as complementary tools. The Metascience Unit advocates selecting methods based on the needs of each funding opportunity rather than applying a single solution universally.

📖Where can researchers find official guidance on DPR?

Detailed applicant and reviewer guidance is available on the gov.uk website for specific funding opportunities using distributed peer review. UKRI also publishes rules and guidelines tailored to individual calls, outlining scoring, conflicts of interest, and process expectations.

🌱How might DPR affect early-career researchers?

Early-career researchers may gain valuable evaluation experience through participation, yet they must balance review duties with research time. Clear institutional support and transparent guidelines help ensure equitable involvement across career stages.

🔮What is the future outlook for distributed peer review in the UK?

Continued experimentation, data collection from trials, and the upcoming AI survey will inform refinements. The approach is expected to remain one of several tools available to funders seeking efficient, high-quality assessment methods tailored to different research contexts.