All AutosheetBench tasks

Freeze the top row and three columns

Spreadsheet manipulationMediumDeterministic scoringLatest run

Passed by 11 of 12 products on their best model. Failed: Copilot in Excel.

Prompt and starting spreadsheet

Task files

Prompt

Freeze the top row and the first three columns.

Starting spreadsheet

Data
ABCDEFG
1DateProductRegionSalesRevenueOrder IDAmount
22026-03-14AtlasEurope1814400O-1001720
32026-01-08BeaconNorth America118250O-1002450
42026-02-17CometEurope2718900O-1003980
52026-01-29AtlasAsia1411200O-1004610
62026-03-03BeaconEurope2216500O-1005540
72026-02-09CometNorth America97200O-1006320
82026-03-21DeltaEurope3124800O-10071250
92026-01-17DeltaAsia1612800O-1008890

A passing output

Autosheet in Excel · Opus 5.5

How each AI configuration did

19 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • The first row and the first 3 columns are frozen

Passed 19

Autosheet in Excel Opus 5.5 · Medium

Passed6s · 2¢

Autosheet in Excel GPT-6 Astra · Low

Passed5s · 4¢

Autosheet in Sheets Opus 5.5 · Medium

Passed6s · 2¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed3s · 0.8¢

Claude in Excel Opus 5.5 · High

Passed5s · 4¢

Autosheet in Excel Haiku 5.5 · High

Passed4s · 0.1¢

Claude in Sheets Opus 5.5 · Medium

Passed8s · 3¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed16s · N/A

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed21s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed46s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed13s · 0.1¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed10s · 32¢

Claude in Excel Haiku 5.5 · High

Passed6s · 0.2¢

Claude in Sheets Haiku 5.5 · High

Passed10s · 0.3¢

ChatGPT + Drive MCP GPT-6 · Medium

Passed23s · N/A

ChatGPT in Excel GPT-6 Luna · High

Passed14s · 0.4¢

Gemini in Sheets Auto

Passed36s · N/A

ChatGPT in Sheets GPT-6 Astra · Medium

Passed11s · 25¢

ChatGPT in Sheets GPT-6 Luna · High

Passed13s · 0.3¢

Failed 3

Autosheet in Excel GPT-6.1 Sol · Medium

Failed7s · 5¢

Why it failed: Panes are frozen at E3 instead of D2.

Autosheet in Excel GPT-6 Luna · High

Failed6s · 0.1¢

Why it failed: Panes are frozen at E3 instead of D2.

Copilot in Excel Auto

Failed15s · N/A

Why it failed: Panes are frozen at E3 instead of D2.