All AutosheetBench tasks

Create a bar chart labeling only its maximum

ChartsMediumLLM judge scoringLatest run

Passed by 8 of 12 products on their best model. Failed: Copilot in Excel, Claude Code + Autosheet MCP, ChatGPT + Autosheet MCP and ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Create a bar chart with only the highest value displayed

Data

Starting sheet
AB
1ProductRevenue
2Alpha9200
3Beta15100
4Gamma11800
5Delta13400
6Epsilon16900
7Zeta14350
8Eta11100
9Theta9800
10Iota17500
11Kappa12550
12Lambda16020
13Mu10580

Chart

Starting sheet
A
1

Expected result

How each AI configuration did

16 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • A bar chart of every product's revenue
  • Only the highest bar has a label
  • A clear title and readable labels

Passed 16

Autosheet in Excel Opus 5.5 · Medium

Passed14s · 5¢

Autosheet in Excel GPT-6 Astra · Low

Passed12s · 9¢

Autosheet in Sheets Opus 5.5 · Medium

Passed25s · 8¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed57s · 2¢

Claude in Excel Opus 5.5 · High

Passed27s · 15¢

Autosheet in Excel Haiku 5.5 · High

Passed1m 46s · 0.4¢

Claude in Sheets Opus 5.5 · Medium

Passed39s · 10¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed44s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed36s · 6¢

Autosheet in Sheets Haiku 5.5 · High

Passed2m 21s · 2¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed47s · 57¢

Claude in Excel Haiku 5.5 · High

Passed24s · 0.8¢

Claude in Sheets Haiku 5.5 · High

Passed1m 26s · 3¢

Autosheet in Excel GPT-6 Luna · High

Passed41s · 0.7¢

ChatGPT + Drive MCP GPT-6 · Medium

Passed53s · N/A

Gemini in Sheets Auto

Passed31s · N/A

Failed 6

Claude Code + Autosheet MCP Opus 5.5 · Medium

Failed39s · N/A

Why it failed: The chart plots only one product instead of all products from the data sheet.

ChatGPT + Autosheet MCP GPT-6 · Medium

Failed48s · N/A

Why it failed: Chart plots only one product instead of all products.

Copilot in Excel Auto

Failed53s · N/A

Why it failed: The chart does not show all products; it only plots Iota.

ChatGPT in Excel GPT-6 Luna · High

Failed52s · 0.7¢

Why it failed: Only a single product is plotted instead of all products from Data.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed59s · 53¢

Why it failed: No native bar or column chart was created.

ChatGPT in Sheets GPT-6 Luna · High

Failed1m 2s · 0.5¢

Why it failed: No bar or column chart was created.