Meta is developing an internal AI detection tool for Meta AI, a move that could allow users to analyze content for AI generation, even as the company's own generative AI tools contribute to a surge of synthetic media online. This paradoxical development, first uncovered by TestingCatalog on March 15
More from the reading room.
This development highlights a growing tension within the AI landscape: companies developing generative AI models are increasingly facing pressure to also provide tools that identify the content these models produce. Google already offers a similar AI video detection tool within its Gemini platform, indicating a broader industry trend. The key question remains whether Meta’s detector will identify content from any AI model or exclusively target content generated by Meta's own AI.
Meta’s move to develop an AI detector should be viewed in the context of its wider push for digital safety and content moderation. The company has recently rolled out several new scam detection tools across three major platforms: Facebook, WhatsApp, and Messenger. These tools are designed to combat various forms of exploitation and fraud. For instance, Facebook now issues alerts for suspicious friend requests. WhatsApp has introduced device linking warnings to prevent users from being tricked into linking their accounts to scammers' devices.
Messenger, in particular, is expanding its advanced scam detection capabilities to more countries this month. This system uses AI to review chat patterns for common scam indicators, such as suspicious job offers, and prompts users to block or report problematic accounts. While these efforts focus on scams rather than general AI-generated "slop," they demonstrate Meta's increasing reliance on AI for content analysis and user protection. However, this commitment to safety faces scrutiny; Meta and Luxottica were recently hit with a proposed class action alleging that videos from AI-enabled smart glasses were shared with third-party contractors without user consent.