All AutosheetBench tasks

Hide two columns

FormattingEasyDeterministic scoringLatest run

Passed by 11 of 12 products on their best model. Failed: Copilot in Excel.

Prompt and starting spreadsheet

Task files

Prompt

Hide the revenue and amount columns.

Starting spreadsheet

Data
ABCDEFG
1DateProductRegionSalesRevenueOrder IDAmount
22026-03-14AtlasEurope1814400O-1001720
32026-01-08BeaconNorth America118250O-1002450
42026-02-17CometEurope2718900O-1003980
52026-01-29AtlasAsia1411200O-1004610
62026-03-03BeaconEurope2216500O-1005540
72026-02-09CometNorth America97200O-1006320
82026-03-21DeltaEurope3124800O-10071250
92026-01-17DeltaAsia1612800O-1008890

A passing output

Autosheet in Excel · Opus 5.5

How each AI configuration did

20 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • Columns E and G are hidden
  • Columns A–D and F are visible

Passed 20

Autosheet in Excel Opus 5.5 · Medium

Passed6s · 2¢

Autosheet in Excel GPT-6 Astra · Low

Passed5s · 4¢

Autosheet in Sheets Opus 5.5 · Medium

Passed7s · 2¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed5s · 0.8¢

Claude in Excel Opus 5.5 · High

Passed16s · 12¢

Autosheet in Excel Haiku 5.5 · High

Passed5s · 0.1¢

Claude in Sheets Opus 5.5 · Medium

Passed16s · 3¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed23s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed7s · 1¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed22s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed40s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed13s · 0.1¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed16s · 35¢

Claude in Excel Haiku 5.5 · High

Passed9s · 0.4¢

Claude in Sheets Haiku 5.5 · High

Passed16s · 1¢

ChatGPT + Drive MCP GPT-6 · Medium

Passed28s · N/A

ChatGPT in Excel GPT-6 Luna · High

Passed11s · 0.4¢

Gemini in Sheets Auto

Passed26s · N/A

ChatGPT in Sheets GPT-6 Astra · Medium

Passed17s · 28¢

ChatGPT in Sheets GPT-6 Luna · High

Passed16s · 0.3¢

Failed 2

Autosheet in Excel GPT-6 Luna · High

Failed5s · 0.1¢

Why it failed: Columns E and G aren't hidden.

Copilot in Excel Auto

Failed15s · N/A

Why it failed: Columns E and G aren't hidden.