Skip to main content
EcoSphere News
ScienceUnited Kingdom

AI‑driven science under scrutiny: From gene banks to falsified papers

Mathematicians clash over AI claims and journals warn of AI‑generated scientific slop that could erode trust and slow real breakthroughs.

Source: bbc.co.uk2 min read
AI‑driven science under scrutiny: From gene banks to falsified papers
Image via bbc.co.uk

In brief

An ambitious DNA storage facility, Basecamp, and a recent OpenAI claim to have solved the Navier–Stokes equations have sparked a heated debate about the role of artificial intelligence in science. A clash between mathematicians at NYU and Anthropic raised doubts that AI models may be inadvertently ingesting private research, while hundreds of papers now show AI fingerprints that could distort the literature. DeepMind’s AlphaFold success is hailed as a watershed moment, yet critics warn that peer review and citation practices are being compromised by AI‑generated “slop.” Publishers and academic netizens are call­ing for robust safeguards and “research‑grade AI” that keeps researchers firmly in the driver’s seat. The debate touches on how researchers can best use AI to accelerate genuine discoveries without eroding the integrity that underpins scientific progress.

In a former watch factory in central London, a bank of white freezers hums as dozens of glass tubes hold one‑hundred‑billion genes. The co‑founder of the Basecamp Research institute, Dr Oliver Vince, argues that this genetic library could feed a next‑generation AI that speaks the language of biology much like current large language models parse text.

The promise of AI to accelerate research is tempered by a fresh controversy: a month ago OpenAI announced that its model had cracked the Navier–Stokes equations in 88 hours, a longstanding mathematical challenge. Hours beforehand, Tristan Buckmaster of New York University and Levent Alpöge of Anthropic said they had been working on the same problem in the OpenAI coding tool Codex and that their drafts may have been read by OpenAI staff, even though the company insists no third‑party work was incorporated.

The debate reveals a growing concern that AI might undermine scientific trust. Generative models can hallucinate facts—making up conferences or quotes—so they may also fabricate research findings, embed phantom citations, and dilute peer review with AI‑generated text. A study of a million biomedical papers found that nearly 90 % show AI fingerprints; separate work uncovered 147,000 invented references cited in peer‑reviewed publications.

Academic publishers are racing to respond. Elsevier lists 100 signals that flag suspect papers, while Nature forbids AI‑generated images and requires referees to avoid uploading manuscripts into AI systems. The “research‑grade AI” model championed by Prof Sarah Main emphasises that researchers must retain control and accountability over AI‑assisted outputs.

The stakes stretch beyond academic integrity. If AI slips earlier the scientific process, society could waste public funds on flawed studies and miss breakthrough solutions to climate–related challenges such as clean energy, carbon capture, and disease control. The narrative of the story balances warning and hope: the work of Dr Andrea Pauli at the Vienna BioCenter, who combined AI with experimental biology to uncover a sperm‑egg lock‑and‑key mechanism, shows that when used responsibly, AI can drive genuine discovery. Yet the broader question remains whether AI will soon erode the very bricks on which science is built, or whether it will be harnessed under strict safeguards to unlock sustainable futures.

Topics

More on this story