Academic Jobs - Home of Higher Ed Logo

China Research Evaluation Reform Curbs Impact Factor Use

Post a Story
24views
a yellow and blue sign that says china immigration inspection
Photo by Christian Lue on Unsplash

The worst thing about China's impact factor crackdown is the applause. Universities finally received permission to ignore journal metrics in hiring and promotion decisions, and the response looked like a research culture turning a corner. It wasn't. The rule Beijing handed down in February 2020 was the easy part, because it told institutions what to stop doing. It said far less about what to do instead, and the people who actually sit on promotion committees know the difference.

On 18 February 2020, the Ministry of Education and the Ministry of Science and Technology jointly issued the Opinions on Regulating the Use of SCI Paper-Related Indicators in Institutions of Higher Education and Establishing Correct Evaluation Orientation. The directive arrived after years of Chinese universities paying cash prizes for papers in journals with high impact factors, and after the "Five Onlys" cleanup that began in 2018 had already signalled Beijing's impatience with evaluation by publication count.

The document is unusually blunt for a bureaucratic notice. It tells universities not to use Science Citation Index paper counts, journal impact factors, or citations as core indicators in recruitment, professional title promotion, awards, project approvals, or discipline evaluation. It also says those indicators should not be directly linked to financial rewards.

Five instructions that should have changed promotion folders

The opinions read like a checklist for dismantling the paper metric. Their five main instructions are:

  • Stop using SCI paper counts and journal impact factors as core evaluation indicators for hiring, promotion, awards, grants, and resource allocation.
  • Do not rank institutions, departments, or individual researchers simply by SCI publication numbers.
  • Do not tie SCI paper metrics to cash bonuses, title promotions, project approvals, or discipline evaluations.
  • Require peer review of a limited set of representative works instead of large publication lists.
  • Tailor evaluation to the kind of research: basic research should be judged by peer review of representative papers; applied and clinical work by actual contribution and outcomes.

That last point matters more than it looks. It forces universities to ask whether a clinical surgeon and a condensed-matter physicist should be assessed with the same template. Previously, they often were.

Why the rule arrived in 2020

By 2020 the volume game had become industrial. The incentive structure pushed researchers to slice work into least publishable units, court citation rings, and buy authorship from paper mills. The most infamous episode came in 2017, when the journal Tumor Biology retracted 107 papers with Chinese affiliations after discovering fabricated peer review. It wasn't the first red flag, but it made the phrase "paper-only evaluation" impossible to ignore in Beijing.

The retraction wave gave the reform its urgency. Chinese universities had become world leaders in publication output, but administrators knew that raw output was not the same as research strength. The problem wasn't one bad journal. It was the system that rewarded the thinnest slices of science as if each one were a discovery.

Both the Ministry of Education and the Ministry of Science and Technology have posted official English notices about the 2020 change, and the State Council's English portal carries the broader October 2020 Overall Plan for Deepening Education Evaluation Reform in the New Era.

Here's the catch

A rule about what not to count is not a rule about what to count. The 2020 opinions name peer review and representative works as the replacement, but they do not provide money or time for that work. A promotion committee member still faces a folder of forty candidates. Removing the journal name from the cover sheet doesn't add hours to the day.

The gap between a directive and a personnel file is where reform stalls. Some universities have rewritten their promotion guidelines to say candidates should submit a small set of representative papers. That sounds fine until you see the accompanying criteria: many still ask for "papers in high-level international journals." The impact factor has been renamed, not removed. Journal prestige becomes the shortcut for quality, and the whole exercise slides back to counting, this time with better manners.

This is the same problem AcademicJobs.com has flagged in its examination of journal indexation: a journal's name was never a guarantee that the paper inside was sound. Replacing "impact factor" with "high-level journal" is a branding move, not a research culture shift. Read more about why journal indexation is not a quality guarantee.

The implementation gap on Chinese campuses

The policy has forced Chinese universities to issue new appointment and promotion regulations, often with stronger language on paper. The change on paper is real. National and provincial education authorities have repeated the directive in follow-up notices, and several Double First-Class universities have added "representative work" language to faculty handbooks. But the hard data on whether hiring committees actually changed their first-pass filters are not public.

The most visible effect so far is linguistic. Committees still ask for international publications, just without the three-letter acronym. That is not a failure of will alone. Journal name carries real information when reading time is scarce, and no circular from Beijing can manufacture that time.

Hype says the impact factor is dead in China. Reality says it has been renamed and reburied in personnel guidelines. The policy is a real administrative shift, but it's not the research culture revolution some headlines imply.

What the reform does not fix

The 2020 directives focus on evaluation, not on the publishing market that feeds it. SCI-indexed journals, open access fees, and citation databases remain the infrastructure through which Chinese research reaches the world. A university that stops rewarding impact factors can still be charged article processing fees by a publisher that benefits from the same prestige system. The invoice just moves.

Nor does the reform address the funding system that rewards proposal writing and publication volume before a project begins. Science funding agencies in China still ask applicants to list representative outputs, but the pressure to produce regularly is not gone. Taking away a metric does not take away the workload that produced it.

The last word belongs to the evaluator

No policy removes the eleven minutes per file. Until promotion committees get paid time and training to read representative papers properly, journal metrics will remain the easiest shortcut. The 2020 rule tells them not to use it. It doesn't tell them what to do at seven in the evening with forty files and a Friday deadline. That's the reform that still hasn't been written.

So when you hear China has "ended" impact factor reliance, check the fine print. The ban is real. The replacement is still being drafted, one overworked committee at a time.

person holding no china extradition poster

Photo by Joseph Chan on Unsplash

Portrait of Dr. Oliver Fenton
About the author

Dr. Oliver FentonView author

Academic Jobs In House Author

Discussion

Sort by:

Be the first to comment on this article!

You

You’ll be asked to sign in before your comment is posted.

New0 comments

Join the conversation!

Add your comments now!

Have your say

Engagement level

Browse by Faculty

Browse by Subject

Frequently Asked Questions

📋What did China's 2020 research evaluation reform actually change?

The February 2020 joint directive told Chinese universities to stop using Science Citation Index paper counts, journal impact factors, and citation numbers as core indicators for hiring, promotion, awards, project approval, and resource allocation. It asked institutions to rely on peer review of a limited set of representative works instead of long publication lists.

🔬What is the Science Citation Index and why did it matter so much in China?

The Science Citation Index, or SCI, is a commercial citation database that tracks which journals cite which papers and from which the impact factor is calculated. In China it became a default quality proxy because it was easy to count. A researcher with more SCI papers in higher-impact journals looked stronger, so universities used it for promotions, cash bonuses, and even department rankings.

🚫Does China's new policy ban impact factors entirely?

No. The policy says impact factors should not be used as core evaluation indicators or directly linked to financial rewards in universities. It doesn't erase the metric from journals or prohibit researchers from mentioning it. In practice, some institutions have simply replaced the term with softer language such as "high-level international journal."

📄What are representative works in China's new research evaluation system?

A representative work is a small number of publications that a researcher selects to stand for the quality and significance of their contribution. Instead of showing a long list of papers, candidates are expected to submit a handful of works, often three to five, which a committee reads closely and judges by peer review rather than by journal title alone.

🏛️How are Chinese universities implementing the rules in hiring and promotion?

Implementation is uneven. Many universities have updated formal regulations to repeat the directive's language, and some have added representative work requirements. But department-level committees still face heavy workloads and often rely on journal prestige as a shortcut. The gap between written policy and personnel practice remains wide.

🧹What was the Five Onlys campaign in China?

The Five Onlys cleanup began in 2018 and targeted evaluation by papers, titles, degrees, awards, and hats alone — "hats" being elite talent labels. It was the precursor to the 2020 SCI-specific rule. The campaign told universities and funding bodies to stop treating these five signals as the whole of a researcher's merit.

🎓How does the reform affect early-career researchers and postdocs?

Early-career researchers are the most exposed to the change. Many were trained to maximise paper output, and now face committees that claim to value depth over volume but have not yet built reliable processes for judging depth. Postdocs applying for jobs in China should still expect questions about their strongest work, not just a count of papers.

⚠️Do paper mills and citation manipulation remain a problem after the reform?

Yes. The reform changed evaluation language, not the industrial incentives that created paper mills. Retractions such as the 107 papers pulled by Tumor Biology in 2017 showed how deep the problem ran. Without new enforcement tools and more time for genuine peer review, the same pressures can simply reappear under different labels.

💰Are cash rewards for publishing now illegal in Chinese universities?

The 2020 directive said SCI paper metrics should not be directly linked to financial rewards. Many provinces and universities have scrapped public cash bonus schemes for high-impact papers. What remains harder to police is informal support, internal performance pay, and indirect advantages that still track journal prestige.

🌍How does China's reform compare with DORA and other global efforts?

China's 2020 policy takes a similar position to the San Francisco Declaration on Research Assessment, known as DORA, which argues against using journal impact factors as a proxy for individual paper quality. The difference is that China issued the rule as state policy, giving it direct reach over public universities, while DORA is a voluntary commitment.

🔗Where can I find the official English documents on China's research evaluation reform?

The Ministry of Education and the Ministry of Science and Technology both maintain English-language portals. The State Council's English website also carries the October 2020 Overall Plan for Deepening Education Evaluation Reform in the New Era, which broadens the campaign beyond research assessment into teaching and student evaluation.

✈️What should international applicants to Chinese universities know about these changes?

International applicants should read the fine print in job advertisements and promotion guidelines. Some universities have replaced impact factor language with "high-level international journals," which can mean the same thing. Ask directly how a representative work is reviewed, who reads it, and how long a committee spends on each file.