All AutosheetBench tasks

Sort a table with merged cells

Spreadsheet manipulationMediumDeterministic scoringLatest run

Passed by 10 of 12 products on their best model. Failed: Copilot in Excel and ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Sort the orders by Sales, largest first

Starting spreadsheet

Orders
ABCD
1DateProductRegionSales
22025-01-05AlphaEMEA4200
32025-01-06BravoEMEA7300
42025-01-07CharlieAPAC5100
52025-01-08DeltaAPAC2600
62025-01-09EchoAMER9100
72025-01-10FoxtrotAMER3300
82025-01-11GolfAMER6400
92025-01-12HotelAPAC8800

A passing output

Autosheet in Excel · Opus 5.5

How each AI configuration did

16 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • A1:D9 hold the expected values
  • No cells are merged on Orders

Passed 16

Autosheet in Excel Opus 5.5 · Medium

Passed18s · 5¢

Autosheet in Excel GPT-6 Astra · Low

Passed16s · 10¢

Autosheet in Sheets Opus 5.5 · Medium

Passed17s · 4¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed8s · 2¢

Claude in Excel Opus 5.5 · High

Passed18s · 11¢

Autosheet in Excel Haiku 5.5 · High

Passed22s · 0.3¢

Claude in Sheets Opus 5.5 · Medium

Passed19s · 9¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed34s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed23s · 4¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed54s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed39s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed29s · 0.2¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed47s · 68¢

Claude in Sheets Haiku 5.5 · High

Passed28s · 0.8¢

ChatGPT + Drive MCP GPT-6 · Medium

Passed34s · N/A

Gemini in Sheets Auto

Passed1m 2s · N/A

Failed 6

Claude in Excel Haiku 5.5 · High

Failed8s · 0.4¢

Why it failed: C5 is empty instead of "AMER". Merged cells remain on Orders.

Autosheet in Excel GPT-6 Luna · High

Failed8s · 0.1¢

Why it failed: C5 is empty instead of "AMER". Merged cells remain on Orders.

Copilot in Excel Auto

Failed13s · N/A

Why it failed: C5 is empty instead of "AMER". Merged cells remain on Orders.

ChatGPT in Excel GPT-6 Luna · High

Failed1m 44s · 1¢

Why it failed: C5 is empty instead of "AMER". Merged cells remain on Orders.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed2m 55s · 61¢

Why it failed: 30 cells are wrong, such as A2: "2025-01-05T00:00:00" instead of "2025-01-09". Merged cells remain on Orders.

ChatGPT in Sheets GPT-6 Luna · High

Failed22s · 0.4¢

Why it failed: 2 cells are wrong, such as C5: empty instead of "AMER". Merged cells remain on Orders.