All AutosheetBench tasks

Label only the tallest bar of a chart

ChartsHardLLM judge scoringLatest run

Passed by 6 of 12 products on their best model. Failed: Copilot in Excel, Claude in Sheets, ChatGPT + Autosheet MCP, ChatGPT + Drive MCP, Gemini in Sheets and ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Label only the tallest bar.

Starting spreadsheet

Sheet1
ABCDEFGHIJKLM
1YearRevenueProfit
220211250000180000
320221430000215000
420231590000248000
520241710000286000
620251880000324000
7
8
9
10
11
12
13
14
15
16
17

Expected result

How each AI configuration did

14 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • The chart is edited in place, colors kept
  • Only the tallest bar has a label

Passed 14

Autosheet in Excel Opus 5.5 · Medium

Passed13s · 5¢

Autosheet in Excel GPT-6 Astra · Low

Passed15s · 11¢

Autosheet in Sheets Opus 5.5 · Medium

Passed34s · 9¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed7s · 2¢

Claude in Excel Opus 5.5 · High

Passed14s · 12¢

Autosheet in Excel Haiku 5.5 · High

Passed11s · 0.2¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed37s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed31s · 4¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed1m 2s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed2m 47s · 1¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed37s · 51¢

Claude in Excel Haiku 5.5 · High

Passed15s · 0.6¢

Autosheet in Excel GPT-6 Luna · High

Passed46s · 1¢

ChatGPT in Excel GPT-6 Luna · High

Passed1m 8s · 0.8¢

Failed 8

Claude in Sheets Opus 5.5 · Medium

Failed1m 39s · 26¢

Why it failed: The original clustered column chart was converted to a combo chart where Profit became a line series instead of maintaining its original orange (#E97132) column bars.

ChatGPT + Autosheet MCP GPT-6 · Medium

Failed1m 50s · N/A

Why it failed: No data label is visible on the tallest bar (2025 Revenue) or any other bar in the chart.

Claude in Sheets Haiku 5.5 · High

Failed5m · 4¢

Why it failed: Still working at the 5-minute time limit. No data label is displayed on the tallest bar.

Copilot in Excel Auto

Failed31s · N/A

Why it failed: All bars in the chart have data labels displayed, failing the requirement that only the single tallest bar carry a data label.

ChatGPT + Drive MCP GPT-6 · Medium

Failed1m 15s · N/A

Why it failed: The chart was recreated with default Google Sheets colors (standard blue and red) rather than preserving the original series colors of #156082 (blue) and #E97132 (orange).

Gemini in Sheets Auto

Failed5m · N/A

Why it failed: Still working at the 5-minute time limit. Data labels are visible above all five bars in the Revenue series (1250000, 1430000, 1590000, 1710000, 1880000) instead of only the tallest bar.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed24s · 29¢

Why it failed: The existing chart was not updated with the requested changes; the agent made no modifications to the chart.

ChatGPT in Sheets GPT-6 Luna · High

Failed26s · 0.3¢

Why it failed: The tallest bar (2025 Revenue) does not have a data label.