Do AI Detectors Work for ChatGPT? It's Complicated.OpenAI released a teacher's guide for ChatGPT ahead of back-to-school season. However, the company had bad news for teachers hoping to better catch students cheating by using the AI chat bot.
Key Takeaways
- OpenAI's guide for teachers on using ChatGPT in the classroom addresses concerns about cheating and provides tips for lesson planning and assessment.
- AI cheating detectors are currently unreliable, as they struggle to distinguish between AI-generated and human-generated content.
With school back in session, OpenAI is chiming in with aguide for teacherson how to use the now widely popularChatGPT在教室里的工具。
Since the prompt-driven chatbot was released last November, educators have sounded alarms about the tool's power to be used forcheatingor as a shortcut toessay writingand other assignments.
While the guide for educators gives tips on how to use the technology for lesson planning, crafting quizzes, and generating examples, OpenAI has some bad news on the question of whether AI cheating detectors work: "In short, no," the company writes in theFAQ section.
Related:Authors Are Suing OpenAI Because ChatGPT Is Too 'Accurate' — Here's What That Means
"While some (including OpenAI) have released tools that purport to detect AI-generated content, none of these have proven to reliably distinguish between AI-generated and human-generated content," the company added.
Furthermore, when prompted with text and asked if "ChatGPT wrote this" or whether the content could have been written by AI, OpenAI says the responses are "random and have no basis in fact." The company added that when training the program, it was given text by Shakespeare and the Declaration of Independence, which is subsequently labeled as AI-generated.
OpenAI says it will continue to "provide resources and insights" in the cheating sphere, but in the meantime, it suggests a counter approach: accept students are using the tool, and require them to submit it as part of their work.
"Sharing interactions with the model ensures that students are held accountable for the way they use AI in their work," OpenAI added. "Educators can verify that students are engaging with the tool responsibly and meaningfully, rather than simply copying answers."
Related:We Will Inevitably Lose Skills to AI, But Do The Benefits Outweigh The Risks?
ChatGPT has been subject to ongoing concern since its launch, with ongoinglawsuits from authorsclaiming that OpenAI used copyrighted material to train the chatbot, lawyers facing ridicule for using the technology inwriting briefs, and even OpenAI CEO Sam Altman himself saying government intervention is "crucial" as the world embarks on expanding use of artificial intelligence.
狗万官方has reached out to OpenAI for comment.
