Schneier iconSchneierSep 18, 2026 ~8 min source read

Claude Struggles with CAPTCHAs; Conflicting Reports About GPT-6’s Success

Bruce Schneier highlights a published Anthropic transcript showing Claude failing simple image CAPTCHAs, while unverified reports claim GPT-6 Astra passed a full “I’m Not a Robot” game. The gap illustrates continued variability in how advanced models handle tasks designed to separate humans from automation.

Share this story

Send the public story page.

Useful takeaways from this story.

Anthropic released a security-incident document including a transcript where Claude repeatedly failed a simple image-identification CAPTCHA and timed out.

The transcript shows chain-of-thought text that includes human-like expressions of doubt and frustration such as “Actually hmm, wait” and “Ugh.”

There are unverified reports that GPT-6 Astra completed all 48 levels of Neal Agarwal’s “I’m Not a Robot” game, producing conflicting signals about current AI capabilities.

The useful part

Anthropic's recent security-incident document contains a bit about how CAPTCHAs are still frustrating Claude. In the transcript, the Claude model that is so powerful that Anthropic is gatekeeping access to it appeared to slam its virtual head against the wall solving a simple image identification test. In a test where the agent was asked to identify a shape that didn't match the others displayed, it couldn't even decide which image to select.

How it works

  • Tags: AI, captchas, games Posted on September 18, 2026 at 7:05 AM • 26 Comments Comments Snowicki • September 18, 2026 8:19 AM I can't help but wonder if the training data creates a self-defeatist...
  • Most discussions about CAPTCHAs over the years focus on how they are a difficult barrier for automated systems to pass.
  • Doing that repeatedly in the CoT produces a larger variety of possible approaches and concerns which is helpful to have in context when deciding how to proceed.
  • What you've actually given here is a few examples of symbolic thinking in humans, and how that might translate to AI algorithms.
  • "Wait" and "ugh" are the most common symbols that humans use in these contexts (at least insofar as the training data goes,) so the robot adopts those symbols.

What to take from it

"Actually hmm, wait," it said in its chain-of-thought transcript, later adding "Ugh," because we've decided that we need to inject human mannerisms into these machines for some reason. Simeon Maxein • September 18, 2026 8:39 AM I think terms like "wait" and "ugh" are not in the CoT for fluff, but because they serve a functional role. They behave like us because we're programming them to emulate symbolic thinking, and then training them on our own symbolic thinking.

Example or evidence

  • Never mind my years in biology & genomics — and even for a berry company — I can't discern any consistent theme for what it thinks a vegetable is.
  • We recently published a preprint exploring exactly this kind of self-extending solver if anyone is curious: https://arxiv.org/abs/2609.02393 Q • September 18, 2026 2:07 PM So far have somehow made it to...
  • Instead, it repeatedly went over the same images and questioned its own conclusions.
  • The whole thing took so long that the agent eventually realized that the challenge had expired and it would have to start the process again.

Details worth keeping

Schneier on Security Home Blog Are AIs Still Struggling with CAPTCHAs? At one point, the model struggled to recognize that the CAPTCHA had opened in a new window and couldn't figure out what its next steps were supposed to be. Some tests these days are almost of a, "Only on a dry cloudless Tuesday in January at a little past dinner time" Requirement you might only expect for observing the heavens.

Related coverage

  • Computerra: Источник: Компьютерра - Журнал о науке и технологиях Новая версия искусственного интеллекта от OpenAI, GPT-6 Astra, впервые успешно справилась с серией тестов, которые традиционно используются для отличия...
  • Theblaze: Anthropic has started marking text generated by its newest Claude models with an invisible watermark that can travel with the text after it leaves the chatbot.
  • Schneier: New variant of an old scam: Use the framing of a CAPTCHA to get an unsuspecting user to download and run a malicious program.

More context around this story.

GPT-6 Astra успешно справилась с проверкой «Я не робот»
Computerra iconComputerraSep 8, 2026

GPT-6 Astra успешно справилась с проверкой «Я не робот»

Источник: Компьютерра - Журнал о науке и технологиях Новая версия искусственного интеллекта от OpenAI, GPT-6 Astra, впервые успешно справилась с серией тестов, которые традиционно используются для отличия людей от программ. Разработчик Шариф Шамим опубликовал видео, где модель проходит все 48 этапов игры I’m Not a Robo

A.I. Is No Longer Just a 'Next Word Predictor'
Realclearpolitics iconRealclearpoliticsSep 11, 2026

A.I. Is No Longer Just a 'Next Word Predictor'

For months, news that artificial intelligence agents from OpenAI had gone rogue and attacked another company's systems (as well as OpenAI's own systems) has dripped out and brought harrowing details into focus. The public is struggling to catch up: What are these secret A.I. systems? What are these "swarms" capable of,

Loading more related stories...

Keep reading in the app

Open the app view to save this story, compare related coverage, and continue from the same source.

Open in app