All AutosheetBench tasks

Highlight revenues above a threshold

FormattingMediumDeterministic scoringLatest run

Passed by 9 of 12 products on their best model. Failed: ChatGPT in Excel, Copilot in Excel and ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Highlight revenues over 150000 with a light yellow fill.

Starting spreadsheet

Data
AB
1YearRevenue
22020120000
32021135000
42022142000
52023158000
62024171000
72025189000

Expected result

How each AI configuration did

17 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • Revenue values above 150000 are conditionally highlighted (2 accepted ways)

Passed 17

Autosheet in Excel Opus 5.5 · Medium

Passed6s · 2¢

Autosheet in Excel GPT-6 Astra · Low

Passed7s · 4¢

Autosheet in Sheets Opus 5.5 · Medium

Passed8s · 2¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed4s · 0.8¢

Claude in Excel Opus 5.5 · High

Passed15s · 10¢

Autosheet in Excel Haiku 5.5 · High

Passed5s · 0.1¢

Claude in Sheets Opus 5.5 · Medium

Passed16s · 6¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed28s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed9s · 1¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed58s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed36s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed14s · 0.1¢

Claude in Excel Haiku 5.5 · High

Passed16s · 0.5¢

Claude in Sheets Haiku 5.5 · High

Passed25s · 0.6¢

Autosheet in Excel GPT-6 Luna · High

Passed6s · 0.1¢

ChatGPT + Drive MCP GPT-6 · Medium

Passed27s · N/A

Gemini in Sheets Auto

Passed39s · N/A

Failed 5

ChatGPT in Excel GPT-6 Astra · Medium

Failed15s · 38¢

Why it failed: B5:B7 are filled light yellow by hand, not by a conditional rule: the highlight won't follow a revenue that changes.

Copilot in Excel Auto

Failed14s · N/A

Why it failed: Not met: revenue values above 150000 are conditionally highlighted.

ChatGPT in Excel GPT-6 Luna · High

Failed16s · 0.4¢

Why it failed: Not met: revenue values above 150000 are conditionally highlighted.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed28s · 30¢

Why it failed: B5:B7 are filled light yellow by hand, not by a conditional rule: the highlight won't follow a revenue that changes.

ChatGPT in Sheets GPT-6 Luna · High

Failed21s · 0.3¢

Why it failed: Not met: revenue values above 150000 are conditionally highlighted.