All AutosheetBench tasks

Clear a row

Spreadsheet manipulationEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Clear everything in row 9.

Sheet1

Starting sheet
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
98800Open
109900Closed
11101000Open
12111100Closed

Models

Starting sheet
ABC
1ModelOwnerStatus
2ForecastAnaActive
3BudgetMarcDraft

Petty Cashbook

Starting sheet
ABC
1DateDescriptionAmount
22026-06-01Taxi32
32026-06-03Supplies18

Archive

Starting sheet
A
1Status
2Do not change

A passing output

Autosheet in Excel · Opus 5.5
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • Sheet1!A9:C9 are empty

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed7s · 2¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Autosheet in Excel GPT-6 Astra · Low

Passed4s · 3¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Autosheet in Sheets Opus 5.5 · Medium

Passed8s · 2¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Autosheet in Excel Sonnet 5.5 · Medium

Passed3s · 0.7¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Claude in Excel Opus 5.5 · High

Passed9s · 11¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Autosheet in Excel Haiku 5.5 · High

Passed4s · 0.1¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Claude in Sheets Opus 5.5 · Medium

Passed16s · 4¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed25s · N/A
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Autosheet in Excel GPT-6.1 Sol · Medium

Passed6s · 0.9¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed39s · N/A
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed30s · N/A
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Autosheet in Sheets Haiku 5.5 · High

Passed15s · 0.1¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

ChatGPT in Excel GPT-6 Astra · Medium

Passed11s · 35¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Claude in Excel Haiku 5.5 · High

Passed8s · 0.3¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Claude in Sheets Haiku 5.5 · High

Passed24s · 0.5¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Autosheet in Excel GPT-6 Luna · High

Passed6s · 0.1¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Copilot in Excel Auto

Passed15s · N/A
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

ChatGPT + Drive MCP GPT-6 · Medium

Passed23s · N/A
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

ChatGPT in Excel GPT-6 Luna · High

Passed6s · 0.3¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

Gemini in Sheets Auto

Passed59s · N/A
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

ChatGPT in Sheets GPT-6 Astra · Medium

Passed17s · 27¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed

ChatGPT in Sheets GPT-6 Luna · High

Passed11s · 0.3¢
Sheet13 cells changed
ABC
1IDValueStatus
21100Closed
32200Open
43300Closed
54400Open
65500Closed
76600Open
87700Closed
9
109900Closed
11101000Open
12111100Closed