OpenAI shuts down its AI detection tool AI Classifier due to low accuracy

According to a Decrypt report on July 25, in January this year, OpenAI released the AI detection tool AI Classifier, which can be used to detect whether content was created using generative AI tools. Last week, however, OpenAI quietly shut down the detection tool, citing "its low accuracy rate." This explanation did not appear in the new announcement, but was added to the notes of the blog post that first announced the tool. Currently, the link to AI Classifier is no longer available.

OpenAI wrote: "Due to low accuracy rates, the AI classifier is no longer available as of July 20, 2023. We are working hard to incorporate feedback and are currently researching more effective text provenance techniques and commit to developing and deploying mechanisms that will enable users to understand whether audio or video content was generated by artificial intelligence." OpenAI said that AI Classifier's limitations include: being unreliable in texts of fewer than 1,000 characters, falsely labeling human-written text as AI-authored Text, and neural network-based classifiers perform poorly outside of the training data.