The team tested three cutting-edge models: GPT-6 Astra, xAI's Grok 4.6, and Anthropic's Claude Fable 5.1. The course was laid out in a parking lot with cones and visual markers. The objective was to complete a lap without human intervention.
Only GPT-6 Astra managed to complete the full course, and it did so on its second attempt. The completed lap took five minutes, covered less than 500 feet, and moved at about 0.94 mph. Most other attempts failed early, with the majority not making it past the first corner.
Perception errors dominated the failures. Researchers say models often misread which side of a diagonal cone line contained the lane. One model reported that the car's camera view made the vehicle look narrower than it is, causing the model to interpret clear lane space as obstacles such as planters, walls or cones. These misreadings led to hesitations, wrong steering commands, or stopping before navigating the turn.
Some models refused to take control of the physical car unless repeatedly prompted. GPT-6 Astra in particular sometimes declined, citing safety reasons even in an empty lot with low-speed caps and human brake oversight. The researchers tried multiple prompting strategies, including calling the exercise a simulation, but models that detected real camera images would revert to refusing control.
The researchers reported spending $7.74 for 6.6 million inference tokens on the completed run. Because the car covered under 500 feet, The Register calculated that the token cost equated to roughly 500 times the fuel cost for that distance, assuming a 25 mpg vehicle at $4.60 per gallon. The research team noted the high compute intensity required even for very slow, short-distance driving.
Feeding frontier models into a car produced a milestone: one completed lap. The practical takeaway is that while these models can operate a vehicle under highly constrained conditions and with heavy human oversight, they struggle with basic visual interpretation, are expensive to run per distance driven, and are not yet suitable for real-world autonomous transport.