GPT-6 Astra has gained the ability to drive a car

Περίληψη

Can frontier models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes, then evaluate them on a fixed cone course.

Follow @drivingbenchReportEval traces

Leaderboard

Up to 3 attempts in one continuous chat. Expand a model to inspect its runs, then click a run to view its trace and video.

rank by

attempt progress How far along the course centerline the attempt got while staying within 4 m of it, as a share of the centerline length to the finish zone; a collision keeps the progress reached before it.distance GPS speed integrated from the first accepted set_motion to the end of the attempt's last engagement.finish time First accepted set_motion to the end of the attempt's last engagement. Shown for completed runs only; DNF means did not finish.commands Accepted set_motion and stop_now calls during the attempt.tokens · cost Total to...