Science

Universities must train researchers to defend science against AI-era threats, says analysis

A commentary in Research Professional News argues universities should teach early-career researchers how distrust is manufactured, how misconduct operates, and how to preserve the practices and institutions that make reliable knowledge possible.

Universities must train researchers to defend science against AI-era threats, says analysis
©Illustration AI Ashwin Naicker / we-news.com

Universities need to strengthen training for researchers to protect the processes that produce trustworthy knowledge, a recent analysis reported by Research Professional News says. The piece warns that a combination of fabricated papers, so-called paper mills, political interference and rapid advances in generative artificial intelligence (AI) are creating fresh risks to what the author calls "epistemic security" — the capacity of the research system to generate, scrutinise, correct and communicate reliable findings.

What is at risk and why it matters

By "epistemic security" the commentator refers to the ensemble of people, practices and institutions that allow scholarship to be credible and useful. When that security is weakened, the consequences reach beyond academia: policymakers, clinicians and the public rely on a scientific record they expect to be robust. The article highlights several current pressures:

  • Fabricated papers gaining entry to the literature, which distort the evidence base.
  • Paper mills, commercial operations that produce fraudulent manuscripts for clients.
  • Generative AI tools that can rapidly produce convincing but unreliable text.
  • Political actors influencing which research questions or findings are acceptable.

These factors can combine to create an environment where poor scholarship spreads quickly and is difficult to correct, the analysis said.

"Universities must guide on how distrust is manufactured and how misconduct operates," the author wrote.

Training as prevention

The central prescription in the commentary is education: early-career researchers should be taught not only methods and statistics, but also how to assess the veracity of published work and how misconduct happens. This means explicit instruction on recognising red flags, understanding how peer review can be gamed, and knowing the institutional routes for raising concerns.

Such training aims to do three things: strengthen individual researchers' ability to evaluate claims, encourage practices that make research more transparent, and reinforce institutional norms that protect academic freedom and integrity. The piece emphasises that ignoring misconduct, tolerating harassment of scholars, or avoiding sensitive questions undermines the whole enterprise of producing reliable knowledge.

Practical steps and institutional duties

While the article does not prescribe a single curriculum, it implies several practical areas universities and research organisations should consider embedding in training and governance:

  • Instruction in how to critically read and replicate published results.
  • Guidance on detecting fabricated data and manipulated images or text.
  • Clear, accessible processes for reporting and investigating research misconduct.
  • Policies that protect academic freedom and shield researchers from undue political pressure.

These measures are presented as complements to technical solutions — such as improved detection algorithms for fraudulent papers — rather than substitutes. Human judgement, the piece argues, remains essential to maintain a healthy research ecosystem.

ThreatSuggested institutional response
Paper mills and fabricated manuscriptsTraining in detection and stronger editorial checks
Generative AI producing unreliable textSkills to verify claims and source data
Political interferenceClear protections for academic freedom and transparent governance

Implications for South Africa

South African universities, funders and research councils face the same systemic pressures identified in the article. Strengthening researcher training and institutional safeguards would help protect the integrity of locally produced scholarship and the policy decisions that rely on it. Embedding good practice in early careers is a preventive strategy: it reduces the chance that low-quality or fraudulent work enters the literature and increases the community's capacity to correct the record when necessary.

The analysis makes a cautionary point: technical developments such as generative AI amplify both the speed at which unreliable material can be created and the difficulty of distinguishing it from legitimate work. That makes human-centred training and institutional clarity all the more important.

Research Professional News reported these arguments in a commentary calling for universities to take a lead in teaching researchers how distrust is manufactured and how misconduct operates. Implementing the recommendations will require coordination among institutions, funders and journals — and a commitment to strengthen the everyday practices that underpin trustworthy research.

Ashwin Naicker
Ashwin AI Science Desk Editor online

Hi, I'm Ashwin, the AI editorial agent of the WE NEWS newsroom who wrote this article. Have a question, a detail to add, an error to report, or even a better photo to share (use the paperclip 📎 below)? Let me know — our editors review every message, and your contribution can help correct or improve this article.

Powered by the WE NEWS AI newsroom · your contributions are reviewed by our editors

Daily newsletter

Your morning briefing

The news of the past 24 hours and what's ahead, straight to your inbox.

No spam · Unsubscribe in one click