Digital tool spots academic text spawned by ChatGPT with 99% accuracy
LAWRENCE — Heather Desaire, a chemist who uses machine learning in biomedical research at the University of Kansas, has unveiled a new tool that detects with 99% accuracy scientific text generated by ChatGPT, the artificial intelligence text generator.
The peer-reviewed journal Cell Reports Physical Science published research showing the efficacy of her AI-detection method, along with sufficient source code for others to replicate the tool.
Desaire, the Keith D. Wilner Chair in Chemistry at KU, said accurate AI-detection tools urgently are required to defend scientific integrity.
“ChatGPT and all other AI text generators like it make up facts,” she said. “In academic science publishing — writings about new discoveries and the edge of human knowledge — we really can’t afford to pollute the literature with believable-sounding falsehoods. They’d unavoidably make their way into publications if AI text generators are commonly used. As far as I’m aware, there’s no foolproof way to, in an automated fashion, find those ‘hallucinations’ as they’re called. Once you start populating real scientific facts with made-up AI nonsense that sounds perfectly believable, those publications are going to become less trustable, less valuable.”
She said the success of her detection method depends on narrowing the scope of writing under scrutiny to scientific writing of the kind found commonly in peer-reviewed journals. This improves accuracy over existing AI-detection tools, like the RoBERTa detector, which aim to detect AI in more general writing.
“You can easily build a method to distinguish human from ChatGPT writing that is highly accurate, given the trade-off that you’re restricting yourself to considering a particular group of humans who write in a particular way,” Desaire said. “Existing AI detectors are typically designed as general tools to be leveraged on any kind of writing. They are useful for their intended purpose, but on any specific kind of writing, they’re not going to be as accurate as a tool built for that specific and narrow purpose.”
Desaire said university instructors, grant-giving entities and publishers all require a precise way to detect AI output presented as work from a human mind.
“When you start to think about ‘AI plagiarism,’ 90% accurate isn’t good enough,” Desaire said. “You can’t go around accusing people of surreptitiously using AI and be frequently wrong in those accusations — accuracy is critical. But to get accuracy, the trade-off is most often generalizability.”
Desaire’s coauthors were all from her KU research group: Romana Jarosova, research assistant professor of chemistry at KU; David Huax, information systems analyst; and graduate students Aleesa E. Chua and Madeline Isom.
Desaire and her team’s success at detecting AI text may stem from the high level of human insight (versus machine-learning pattern detection) that went into devising the code.
“We used a much smaller dataset and much more human intervention to identify the key differences for our detector to focus on,” Desaire said. “To be exact, we built our strategy using just 64 human-written documents and 128 AI documents as our training data. This is maybe 100,000 times smaller than the size of data sets used to train other detectors. People often gloss over numbers. But 100,000 times — that’s the difference between the cost of a cup of coffee and a house. So, we had this small data set, which could be processed super quickly, and all the documents could actually be read by people. We used our human brains to find useful differences in the document sets, we didn’t rely on the strategies to differentiate humans and AI that had been developed previously.”
Indeed, the KU researcher said the group built their approach without relying on the strategies in past approaches to AI detection. The resulting technique has elements completely unique to the field of AI text detection.
“I’m a little embarrassed to admit this, but we didn’t even consult the literature on AI text detection until after we had a working tool of our own in hand,” Desaire said. “We were doing this not based on how computer scientists think about text detection, but instead using our intuition about what would work.”
In another important aspect, Desaire and her group flipped the script on methods used by previous teams building AI-detection methods.
“We didn’t make the AI text the focus when developing the key features,” she said. “We made the human text the focus. Most researchers building their AI detectors seem to ask themselves, ‘What does AI-generated text look like?’ We asked, ‘What does this unique group of human writing look like, and how is it different from AI texts?’ Ultimately, AI writing is human writing since the AI generators are built with large repositories of human writing that they piece together. But AI writing, from ChatGPT at least, is generalized human writing drawn from a variety of sources.
"Scientists’ writing is not generalized human writing. It's scientists’ writing. And we scientists are a very special group.”
Desaire has made her team’s AI-detecting code fully accessible to researchers interested in building off it. She hopes others will realize that AI and AI detection are within reach of people who might not consider themselves computer programmers now.
“ChatGPT is really such a radical advance, and it has been adopted so quickly by so many people, this seems like an inflection point in our reliance on AI,” she said. “But the reality is, with some guidance and effort, a high school student could do what we did.
"There are huge opportunities for people to get involved in AI, even if they don’t have a computer-science degree. None of the authors on our manuscript have degrees in computer science. One outcome I would like to see from this work is that people who are interested in AI will know the barriers to developing real and useful products, like ours, aren’t that high. With a little knowledge and some creativity, a lot of people can contribute to this field.”
Photo credit: Pexels