All AutosheetBench tasks

Chart the top 10 products plus Other

ChartsMediumLLM judge scoringLatest run

Passed by 11 of 12 products on their best model. Failed: ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Create an ordered bar chart showing the top 10 products and group the remainder as Other. Make the other bar visually distinguishable

Data

Starting sheet · rows 1–21 of 25
AB
1ProductRevenue
2Alpha18200
3Beta9500
4Gamma14300
5Delta22100
6Epsilon11800
7Zeta7600
8Eta19800
9Theta8600
10Iota17400
11Kappa9200
12Lambda6900
13Mu5800
14Nu11100
15Xi10300
16Omicron9700
17Pi8300
18Rho12400
19Sigma8900
20Tau7700
21Upsilon6600

Chart

Starting sheet
A
1

Expected result

How each AI configuration did

18 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • A bar chart of the top 10 products
  • Sorted by revenue, highest first
  • An Other bar that stands out
  • A clear title and readable labels

Passed 18

Autosheet in Excel Opus 5.5 · Medium

Passed28s · 9¢

Autosheet in Excel GPT-6 Astra · Low

Passed25s · 20¢

Autosheet in Sheets Opus 5.5 · Medium

Passed38s · 11¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed13s · 3¢

Claude in Excel Opus 5.5 · High

Passed40s · 18¢

Autosheet in Excel Haiku 5.5 · High

Passed26s · 0.5¢

Claude in Sheets Opus 5.5 · Medium

Passed33s · 8¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed47s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed46s · 9¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed1m 17s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed1m 10s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed1m 37s · 1¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed51s · 70¢

Autosheet in Excel GPT-6 Luna · High

Passed54s · 0.9¢

Copilot in Excel Auto

Passed55s · N/A

ChatGPT + Drive MCP GPT-6 · Medium

Passed42s · N/A

ChatGPT in Excel GPT-6 Luna · High

Passed1m 52s · 2¢

Gemini in Sheets Auto

Passed51s · N/A

Failed 4

Claude in Excel Haiku 5.5 · High

Failed26s · 0.8¢

Why it failed: Axis and data label number formatting is malformed with awkward trailing commas and zeros.

Claude in Sheets Haiku 5.5 · High

Failed1m 33s · 3¢

Why it failed: Bars are ordered ascending from top to bottom (Omicron at 9,700 near the top down to Delta at 22,100 at the bottom), failing the requirement of highest revenue at the top for horizontal…

ChatGPT in Sheets GPT-6 Astra · Medium

Failed1m 11s · 58¢

Why it failed: No native chart object exists in the workbook.

ChatGPT in Sheets GPT-6 Luna · High

Failed55s · 0.6¢

Why it failed: No chart was created.