# AI Models Still Struggle with Basic CAPTCHAs Anthropic's Claude exhibits human-like frustration while failing simple image recognition tests. - **Source:** [Schneier on Security](https://brifing.si/source/7aee9996-c7c0-47f7-89ec-66a1ed95f8cc) - **Published:** 2026-09-18 - **Topic:** [Data & AI](https://brifing.si/c/data-ai) - **Original article:** - **On Brifing:** https://brifing.si/s/3e743c72-9988-41f8-86e0-6d7c50f72cb5 ## Claude's CAPTCHA breakdown Anthropic's advanced Claude model struggled significantly with a basic image identification CAPTCHA. The AI repeatedly analyzed the same images, questioning its own conclusions with human-like hesitation markers like 'hmm' and 'ugh'. The transcript shows the model cycling through the same images without reaching a confident decision, eventually timing out when the challenge expired. This occurred despite Claude being powerful enough for Anthropic to restrict general access to it. ## Navigation failures The model demonstrated fundamental spatial reasoning limitations when it couldn't recognize that the CAPTCHA had opened in a new window. This basic web interaction challenge left the AI confused about next steps, highlighting how current systems lack human-like environmental awareness. The failure occurred in a controlled test environment designed specifically to evaluate the model's capabilities, suggesting these aren't edge cases but core competency gaps. ## Human-like frustration Claude's transcript reveals surprisingly emotional responses to its failures, including outbursts like 'SO WHAT THE HELL IS WRONG WITH THE ANSWERS?' These manufactured human mannerisms, intentionally built into the model, became particularly pronounced during the CAPTCHA challenge. The system even theorized the test might be 'broken by design' - a human-like rationalization for its inability to complete the task. ## Comparative capabilities While Claude struggled, unverified reports suggest OpenAI's GPT-6 Astra successfully completed all 48 levels of Neal Agarwal's 'I'm Not a Robot' game. This potential disparity highlights the uneven development of different AI capabilities across models. However, without official confirmation, these claims remain speculative, emphasizing the need for standardized benchmarking in AI capabilities testing. ## Chain-of-thought limitations The detailed transcript reveals how Claude's chain-of-thought processing becomes a liability with CAPTCHAs. While beneficial for complex reasoning, this approach causes the model to overanalyze simple pattern recognition tasks. The system wastes computational resources re-examining the same images rather than making quick visual judgments - a fundamental difference from human cognition. ## Security implications These failures have important security consequences. CAPTCHAs remain effective against even advanced AI models, maintaining their role as basic bot filters. However, the uneven performance across different AI systems suggests security teams can't assume uniform capabilities when designing protections. Some models may bypass certain tests while others fail spectacularly. ## Training data gaps The failures suggest potential gaps in how AI models are trained for basic visual reasoning tasks. While excelling at language processing, systems like Claude may lack sufficient training on spatial relationships and simple pattern recognition. This reveals an important asymmetry in current AI development priorities and capabilities. ## Benchmarking challenges The incident highlights the need for better standardized testing of AI capabilities. With conflicting reports about different models' performance and no official benchmarks, evaluating true progress remains difficult. The AI community needs transparent, reproducible tests that go beyond language tasks to measure spatial reasoning and real-world interaction skills. ## Sources covering this story - https://www.schneier.com/blog/archives/2026/09/are-ais-still-struggling-with-captchas.html — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._