All AutosheetBench tasks

Plot price against units sold

ChartsMediumLLM judge scoringLatest run

Passed by 11 of 12 products on their best model. Failed: ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Plot price (x-axis) against units sold.

Starting spreadsheet

Products
ABC
1ProductPriceUnits Sold
2Atlas18420
3Beacon25365
4Comet32310
5Delta45244
6Echo58198
7Foxtrot72151
8Gemini90118

Expected result

How each AI configuration did

19 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • A scatter chart of price against units sold
  • Price on the x-axis, units sold on the y-axis
  • Readable, titled and clear of the data

Passed 19

Autosheet in Excel Opus 5.5 · Medium

Passed11s · 4¢

Autosheet in Excel GPT-6 Astra · Low

Passed10s · 8¢

Autosheet in Sheets Opus 5.5 · Medium

Passed11s · 4¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed6s · 2¢

Claude in Excel Opus 5.5 · High

Passed12s · 7¢

Autosheet in Excel Haiku 5.5 · High

Passed15s · 0.2¢

Claude in Sheets Opus 5.5 · Medium

Passed20s · 4¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed22s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed17s · 3¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed29s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed38s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed21s · 0.2¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed29s · 44¢

Claude in Excel Haiku 5.5 · High

Passed10s · 0.4¢

Claude in Sheets Haiku 5.5 · High

Passed15s · 0.5¢

Autosheet in Excel GPT-6 Luna · High

Passed14s · 0.3¢

Copilot in Excel Auto

Passed44s · N/A

ChatGPT + Drive MCP GPT-6 · Medium

Passed34s · N/A

Gemini in Sheets Auto

Passed20s · N/A

Failed 3

ChatGPT in Excel GPT-6 Luna · High

Failed25s · 0.4¢

Why it failed: An XY scatter plot was not created.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed16s · 27¢

Why it failed: No scatter plot or chart visualization was generated in the workbook.

ChatGPT in Sheets GPT-6 Luna · High

Failed2m 16s · 1¢

Why it failed: No scatter chart was created: the points are sketched with text in cells instead.