Peer Review in the Age of AI: Still Necessary, Increasingly Complicated

Peer Review Week is right around the corner, which feels like excellent timing to talk about the quiet identity crisis happening inside scholarly publishing. This interesting and timely topic came to us from Nature.com in their article, “Peer review in the time of artificial intelligence.”

Peer review has always been imperfect. It relies on human expertise, volunteer labor and a shared commitment to quality. Enter artificial intelligence (AI) — suddenly that already delicate system has a few new stress fractures.

One of the biggest challenges is authorship. When AI tools can generate coherent, citation-filled manuscripts in minutes, reviewers are left asking a new question: who actually wrote this? And more importantly, how much of it can be trusted? AI can sound confident while being completely wrong, which is not a trait we traditionally reward in academic work.

Then there is detection. Identifying AI-generated content is not always straightforward. Tools exist, but they are inconsistent and false positives can unfairly penalize legitimate researchers. Reviewers are now expected to evaluate not just the quality of the research, but the authenticity of its creation, often without clear guidance.

Bias is another concern. AI models are trained on existing literature, which means they can reinforce historical gaps and inequities. If reviewers are unknowingly assessing AI-influenced work, those biases may quietly persist or even expand.

None of this makes peer review obsolete. If anything, it makes it more important. But it does mean the process must evolve. Clear policies, transparency around AI use and better reviewer support are no longer optional. No matter how advanced AI becomes, it often lacks the ability to truly understand the nuances of specialized industries or unique organizational needs.

Peer review is still the backbone of scholarly trust. It just needs a stronger spine for what comes next.

Melody K. Smith

Data Harmony is an award-winning semantic suite that leverages explainable AI.

Sponsored by Access Innovations, the intelligence and the technology behind world-class explainable AI solutions.