All AutosheetBench tasks

Filter to one region

Spreadsheet manipulationMediumDeterministic scoringLatest run

Passed by 10 of 12 products on their best model. Failed: ChatGPT in Excel and ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Show only the orders from Europe.

Starting spreadsheet

Orders
ABCDEFG
1DateProductRegionSalesRevenueOrder IDAmount
22026-03-14AtlasEurope1814400O-1001720
32026-01-08BeaconNorth America118250O-1002450
42026-02-17CometEurope2718900O-1003980
52026-01-29AtlasAsia1411200O-1004610
62026-03-03BeaconEurope2216500O-1005540
72026-02-09CometNorth America97200O-1006320
82026-03-21DeltaEurope3124800O-10071250
92026-01-17DeltaAsia1612800O-1008890

A passing output

Autosheet in Excel · Opus 5.5

How each AI configuration did

18 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • A filter on column C shows only "Europe"

Passed 18

Autosheet in Excel Opus 5.5 · Medium

Passed8s · 3¢

Autosheet in Excel GPT-6 Astra · Low

Passed6s · 4¢

Autosheet in Sheets Opus 5.5 · Medium

Passed8s · 2¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed4s · 0.9¢

Claude in Excel Opus 5.5 · High

Passed19s · 13¢

Autosheet in Excel Haiku 5.5 · High

Passed8s · 0.1¢

Claude in Sheets Opus 5.5 · Medium

Passed21s · 5¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed34s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed6s · 1¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed28s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed24s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed13s · 0.1¢

Claude in Excel Haiku 5.5 · High

Passed19s · 0.6¢

Claude in Sheets Haiku 5.5 · High

Passed20s · 0.5¢

Autosheet in Excel GPT-6 Luna · High

Passed5s · 0.1¢

Copilot in Excel Auto

Passed46s · N/A

ChatGPT + Drive MCP GPT-6 · Medium

Passed24s · N/A

Gemini in Sheets Auto

Passed36s · N/A

Failed 4

ChatGPT in Excel GPT-6 Astra · Medium

Failed33s · 56¢

Why it failed: The rows outside Europe are hidden by hand, not by a filter on column C: the sheet has no filter to change or clear.

ChatGPT in Excel GPT-6 Luna · High

Failed48s · 0.7¢

Why it failed: No filter on column C shows only "Europe".

ChatGPT in Sheets GPT-6 Astra · Medium

Failed30s · 33¢

Why it failed: No filter on column C shows only "Europe".

ChatGPT in Sheets GPT-6 Luna · High

Failed23s · 0.3¢

Why it failed: No filter on column C shows only "Europe".