Creators of a ChatGPT bot causing a stir for its ability to mimic human writing on Tuesday released a tool designed to detect when written works are authored by artificial intelligence.
The announcement came amid intense debate at schools and universities in the United States and around the world over concerns that the software can be used to assist students with assignments and help them cheat during exams.
US-based OpenAI said in a blog post Tuesday that its detection tool has been trained “to distinguish between text written by a human and text written by AIs from a variety of providers.”
The bot from OpenAI, which recently received a massive cash injection from Microsoft, responds to simple prompts with reams of text inspired by data gathered on the internet.
OpenAI cautioned that its tool can make mistakes, particularly with texts containing fewer than 1,000 characters.
“While it is impossible to reliably detect all AI-written text, we believe good classifiers can inform mitigations for false claims that AI-generated text was written by a human,” OpenAI said in the post.
“For example, running automated misinformation campaigns, using AI tools for academic dishonesty, and positioning an AI chatbot as a human.”
A top French university last week forbade students from using ChatGPT to complete assignments, in the first such ban at a college in the country.
The decision came shortly after word that ChatGPT had passed exams at a US law school after writing essays on topics ranging from constitutional law to taxation.
ChatGPT still makes factual mistakes, but education facilities have rushed to ban the AI tool.
“We recognize that identifying AI-written text has been an important point of discussion among educators, and equally important is recognizing the limits and impacts of AI generated text classifiers in the classroom,” OpenAI said in the post.
“We are engaging with educators in the US to learn what they are seeing in their classrooms and to discuss ChatGPT´s capabilities and limitations.”
Officials in New York and other jurisdictions have forbidden its use in schools.
A group of Australian universities have said they would change exam formats to banish AI tools and regard them as cheating.