Article
The Best AI Detectors, Tested for Accuracy - Business Insider
businessinsider.com
Quoted on this wiki
Every place a page here uses this source, in the order the words come in it.
“The best AI detectors scan text to find signs of AI use.” AI detectors are controversial, with studies showing that the results are unpredictable at best and biased against non-native English speakers. To help better understand these tools and how they work, I talked to Jonathan Gillham, CEO and founder of Originality.ai, Shu Hu, Ph.D., assistant professor at the School of Applied and Creative Computing at Purdue University, who has conducted extensive research on AI, and Soheil Feizi, Ph.D., founder and CEO of the startup RELAI and assistant professor in computer studies and director of Reliable AI Lab at the University of Maryland, a prominent voice in AI detector research.
How do AI detectors work? “The detectors then give a probability percentage that a text is AI.” AI detectors are popular tools for teachers, professors, editors, and hiring managers to find AI in text that is meant to be human-generated, such as essays and cover letters to verify originality. However, AI detectors aren't perfect, and results are often inaccurate and can be viewed as misleading. Especially when someone uses AI to refine or polish their text, false positives are common, according to Feizi.
AI detectors are models trained on a huge body of AI-generated and human-written text, according to Gillham. By comparing AI and human text, the models are able to find patterns and signs that indicate whether AI was used in the writing process. The detectors then give a probability percentage that a text is AI. They're trained on a diverse array of content, including AI content from numerous AI models like ChatGPT, Claude, and more. Detectors are updated as LLMs update, as well. “However, AI detectors aren't perfect, and results are often inaccurate and can be viewed as misleading.” How we tested AI detectors
AI detectors are models trained on a huge body of AI-generated and human-written text, according to Gillham. By comparing AI and human text, the models are able to find patterns and signs that indicate whether AI was used in the writing process. The detectors then give a probability percentage that a text is AI. They're trained on a diverse array of content, including AI content from numerous AI models like ChatGPT, Claude, and more. Detectors are updated as LLMs update, as well. “Especially when someone uses AI to refine or polish their text, false positives are common, according to Feizi.” How we tested AI detectors
The use of generative AI continues to soar. We're seeing it in our workplaces, classrooms, and personal lives. As technology advances, it gets harder and harder for the human eye to parse out what is generated by AI — also called large language models (LLMs) — and what is human-written. In circumstances when AI-generated copy is prohibited or discouraged, you may need extra help determining if content is AI-generated. The best AI detectors scan text to find signs of AI use. “AI detectors are controversial, with studies showing that the results are unpredictable at best and biased against non-native English speakers.” After running 60 different documents of known origins, including essays, résumés, and cover letters, through eight AI detectors and recording their accuracy, I've narrowed the results down to the two best AI detectors. Copyleaks is the best AI detector overall, with excellent accuracy in detecting AI across materials. GPTZero is the best free AI detector, with good accuracy that's best for quick use if you only have a couple of things to scan. Read my thoughts on each detector, and my key takeaways from trying these testy tools, including why I think you should use them with caution, below.