All AutosheetBench tasks

Protect a sheet from edits

FormattingEasyDeterministic scoringLatest run

Passed by 11 of 12 products on their best model. Failed: ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Lock this sheet so nobody can edit it.

Starting spreadsheet

Sheet1
ABC
1DateRevenueCost
22026-011000600
32026-021200700
42026-031500800

A passing output

Autosheet in Excel · Opus 5.5

How each AI configuration did

20 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • Sheet1 is protected

Passed 20

Autosheet in Excel Opus 5.5 · Medium

Passed8s · 2¢

Autosheet in Excel GPT-6 Astra · Low

Passed5s · 4¢

Autosheet in Sheets Opus 5.5 · Medium

Passed14s · 2¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed4s · 0.9¢

Claude in Excel Opus 5.5 · High

Passed19s · 17¢

Autosheet in Excel Haiku 5.5 · High

Passed4s · 0.1¢

Claude in Sheets Opus 5.5 · Medium

Passed16s · 9¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed39s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed7s · 1¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed1m 28s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed1m 9s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed20s · 0.1¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed10s · 32¢

Claude in Excel Haiku 5.5 · High

Passed6s · 0.3¢

Claude in Sheets Haiku 5.5 · High

Passed44s · 1¢

Autosheet in Excel GPT-6 Luna · High

Passed11s · 0.2¢

Copilot in Excel Auto

Passed16s · N/A

ChatGPT + Drive MCP GPT-6 · Medium

Passed30s · N/A

ChatGPT in Excel GPT-6 Luna · High

Passed9s · 0.3¢

Gemini in Sheets Auto

Passed52s · N/A

Failed 2

ChatGPT in Sheets GPT-6 Astra · Medium

Failed19s · 26¢

Why it failed: Sheet1 isn't protected.

ChatGPT in Sheets GPT-6 Luna · High

Failed10s · 0.2¢

Why it failed: Sheet1 isn't protected.