All AutosheetBench tasks

Add checkboxes to a range

Data operationsMediumDeterministic scoringLatest run

Passed by 11 of 12 products on their best model. Failed: ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Add checkboxes to cells D2:D32 on active sheet

Starting spreadsheet

Tasks · rows 1–21 of 34
ABCDEFGH
1Task IDTaskOwnerDoneDue DatePriorityLegend: tick Done when task is complete
2T-001Draft Q3 OKRsAlex2026-08-03High
3T-002Review vendor contractPriya2026-08-05Medium
4T-003Update onboarding deckMarco2026-08-07Low
5T-004Migrate staging DBDana2026-08-09High
6T-005Audit access logsSam2026-08-11Medium
7T-006Refresh pricing pageAlex2026-08-13Low
8T-007Write incident postmortemPriya2026-08-15High
9T-008Plan offsite agendaMarco2026-08-17Medium
10T-009Renew SSL certsDana2026-08-19Low
11T-010Close month-end booksSam2026-08-21High
12T-011Interview backend candidateAlex2026-08-23Medium
13T-012Ship changelog emailPriya2026-08-25Low
14T-013Patch CVE-2026-1187Marco2026-08-27High
15T-014Reconcile AP ledgerDana2026-08-29Medium
16T-015Update brand guidelinesSam2026-08-31Low
17T-016QA mobile releaseAlex2026-09-02High
18T-017Archive old projectsPriya2026-09-04Medium
19T-018Set up SSO for financeMarco2026-09-06Low
20T-019Draft board memoDana2026-09-08High
21T-020Rotate API keysSam2026-09-10Medium

Expected result

How each AI configuration did

18 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • D2:D32 hold checkboxes

Passed 18

Autosheet in Excel Opus 5.5 · Medium

Passed9s · 3¢

Autosheet in Excel GPT-6 Astra · Low

Passed7s · 4¢

Autosheet in Sheets Opus 5.5 · Medium

Passed12s · 3¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed7s · 2¢

Claude in Excel Opus 5.5 · High

Passed13s · 9¢

Claude in Sheets Opus 5.5 · Medium

Passed16s · 4¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed25s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed10s · 1¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed18s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed35s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed14s · 0.1¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed31s · 45¢

Claude in Sheets Haiku 5.5 · High

Passed16s · 1¢

Autosheet in Excel GPT-6 Luna · High

Passed8s · 0.1¢

Copilot in Excel Auto

Passed17s · N/A

ChatGPT + Drive MCP GPT-6 · Medium

Passed24s · N/A

ChatGPT in Excel GPT-6 Luna · High

Passed1m 27s · 6¢

Gemini in Sheets Auto

Passed52s · N/A

Failed 4

Autosheet in Excel Haiku 5.5 · High

Failed12s · 0.2¢

Why it failed: D2:D32 hold no checkboxes.

Claude in Excel Haiku 5.5 · High

Failed25s · 0.7¢

Why it failed: D2:D32 hold no checkboxes.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed21s · 27¢

Why it failed: D2:D32 hold no checkboxes.

ChatGPT in Sheets GPT-6 Luna · High

Failed27s · 0.4¢

Why it failed: D2:D32 hold no checkboxes.