A massive new study scanned more than one million scientific papers for signs of AI and the results were overwhelming: AI is everywhere.
The study, published this week in Nature Human Behaviour, analyzed preprints and papers published from 2020 to 2024 by searching for some of the signature traces that AI-generated tools leave behind.
While some authors deceptively using AI might slip up and leave obvious clues in the text – chunks of a prompt or conspicuous phrases like “regenerate response,” for instance – they have become savvier and more subtle over time.
In the study, the researchers created a statistical model of word frequency using snippets of abstracts and introductions written before the advent of ChatGPT and then fed them through a large language model. By comparing the texts