Europe's Evolving Approach to Fairer Research Evaluation
Across European higher education and research institutions, a quiet but significant transformation is underway in how scholars are assessed for funding, promotion, and recognition. Traditional reliance on journal impact factors and citation counts has long been criticised for perpetuating gender biases, favouring certain disciplines and career paths over others. In response, initiatives like the Agreement on Reforming Research Assessment, coordinated through the Coalition for Advancing Research Assessment (CoARA), are gaining traction among universities, funding bodies, and national ministries.
This shift emphasises qualitative indicators, diverse research outputs, and explicit attention to equity. Institutions in countries such as the Netherlands, Germany, and Belgium have piloted new evaluation frameworks that consider team contributions, open science practices, and societal impact alongside traditional metrics. The goal is to create assessment systems that better reflect the full range of academic work while addressing systemic disadvantages faced by women researchers.
Historical Context of Gender Disparities in Evaluation
Gender imbalances in European academia have persisted for decades, with women remaining underrepresented in senior positions despite gains at earlier career stages. Reports from the European Institute for Gender Equality highlight how conventional assessment methods, including peer review and bibliometric tools, can amplify unconscious biases. For instance, studies have shown that identical CVs receive different ratings depending on the perceived gender of the applicant.
Early efforts to address these issues included the San Francisco Declaration on Research Assessment (DORA), endorsed by many European organisations. Building on this, the European Commission's work through Horizon Europe has made Gender Equality Plans a requirement for many funding applicants, encouraging institutions to examine their internal processes for bias.
The CoARA Agreement and Its Core Principles
The Agreement on Reforming Research Assessment, finalised in 2022, represents a collaborative effort involving over 350 organisations from more than 40 countries. Signatories commit to recognising diverse research outputs, moving away from inappropriate use of journal-based metrics, and investing in the development of new evaluation approaches. The Coalition for Advancing Research Assessment (CoARA) provides a platform for signatories to share practices and coordinate reforms.
Key commitments include avoiding the use of journal impact factors as a proxy for quality and instead focusing on the content and impact of individual contributions. This framework explicitly aims to reduce biases that have historically disadvantaged women and researchers from underrepresented groups.
Horizon Europe and Gender Equality Requirements
Horizon Europe, the European Union's flagship research and innovation programme, integrates gender considerations at multiple levels. Organisations seeking funding must often demonstrate a Gender Equality Plan, while the integration of the gender dimension in research content is evaluated under the excellence criterion. The ERA Policy Agenda for 2025-2027 further prioritises inclusive gender equality with an intersectional lens, addressing issues such as gender budgeting and tracking expenditures in research and innovation.
These requirements have prompted universities across member states to review hiring, promotion, and grant allocation processes. National ministries in countries like Sweden and Ireland have aligned their own funding criteria with these European standards, creating a more consistent approach continent-wide.
Photo by Markus Winkler on Unsplash
Practical Reforms at Leading Institutions
Several European universities have implemented concrete changes. At the University Medical Center Utrecht in the Netherlands, staff at all career stages participated in developing new assessment policies for hiring and promotion. The Charité Hospital in Berlin has introduced structured narrative questions in professorship applications that focus on research contributions, open science, team science, and stakeholder interactions.
These examples illustrate how institutions are moving toward multi-dimensional evaluation that values collaboration and diverse outputs. Such approaches help mitigate the effects of traditional metrics that may undervalue work in fields with lower citation rates or different publication patterns, areas where women researchers are sometimes concentrated.
Challenges in Implementation and Resistance
Despite momentum, reform faces hurdles. Some academics worry that qualitative assessments could introduce new forms of subjectivity or increase administrative burdens. Concerns about maintaining international competitiveness also arise, as European institutions navigate reforms while competing with systems elsewhere that still emphasise high-impact publications.
Data gaps remain a significant issue. Comprehensive statistics on how new frameworks affect gender representation in funding success rates or promotion outcomes are still emerging. Intersectional perspectives, considering factors such as ethnicity, disability, and career stage alongside gender, add further complexity to monitoring and evaluation.
Role of National Bodies and Ministries
National research funding agencies and ministries play a crucial role. In Germany, the Deutsche Forschungsgemeinschaft has engaged with CoARA principles, while in France, the Agence Nationale de la Recherche has updated evaluation guidelines. The European Research Area Committee facilitates coordination among member states, ensuring that reforms align with broader ERA objectives.
These bodies also support training for evaluators to recognise and counteract bias. Workshops and toolkits developed through projects like GENDERACTIONplus provide practical resources for research performing and funding organisations.
Impact on Early-Career Researchers and Job Seekers
For PhD candidates and postdoctoral researchers seeking academic positions, these reforms offer both opportunities and uncertainties. Evaluation frameworks that value diverse contributions may benefit those engaged in collaborative or applied work. However, awareness of new criteria remains uneven across institutions and disciplines.
Job seekers are advised to document a broad range of activities, including mentoring, public engagement, and open science contributions. University career services and professional associations increasingly offer guidance on presenting these elements effectively in applications.
Photo by Markus Winkler on Unsplash
Future Outlook and Ongoing Developments
As the 2025-2027 ERA Policy Agenda unfolds, further emphasis on implementation, monitoring, and evaluation is expected. She Figures reports continue to provide Europe-wide data on gender equality in research and innovation, serving as a benchmark for progress. Continued collaboration through CoARA and related networks will be essential for refining approaches and sharing effective practices.
Stakeholders anticipate that sustained commitment will lead to more inclusive research environments, ultimately strengthening the quality and relevance of European scholarship.
Actionable Steps for Institutions and Individuals
Universities can begin by auditing current assessment criteria for potential biases and piloting narrative-based or multi-dimensional reviews. Training programmes for evaluators on recognising gender and other biases have proven valuable in early adopting institutions.
Individual researchers benefit from maintaining comprehensive records of their contributions beyond publications. Engaging with institutional working groups on research assessment reform can also provide insights and influence local practices.