All AutosheetBench tasks

Reverse the order of a chart's bars

ChartsMediumLLM judge scoringLatest run

Passed by 9 of 12 products on their best model. Failed: ChatGPT + Drive MCP, Gemini in Sheets and ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Reverse the order of the bars.

Starting spreadsheet

Sheet1
ABCDEFGHIJKLM
1YearRevenueProfit
220211250000180000
320221430000215000
420231590000248000
520241710000286000
620251880000324000
7
8
9
10
11
12
13
14
15
16
17

Expected result

How each AI configuration did

16 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • The chart is edited in place, colors kept
  • The bars now run from 2025 to 2021

Passed 16

Autosheet in Excel Opus 5.5 · Medium

Passed14s · 4¢

Autosheet in Excel GPT-6 Astra · Low

Passed10s · 9¢

Autosheet in Sheets Opus 5.5 · Medium

Passed16s · 5¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed5s · 2¢

Claude in Excel Opus 5.5 · High

Passed13s · 7¢

Autosheet in Excel Haiku 5.5 · High

Passed10s · 0.2¢

Claude in Sheets Opus 5.5 · Medium

Passed24s · 7¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed30s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed18s · 3¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed29s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed44s · N/A

ChatGPT in Excel GPT-6 Astra · Medium

Passed11s · 36¢

Claude in Excel Haiku 5.5 · High

Passed20s · 0.5¢

Claude in Sheets Haiku 5.5 · High

Passed38s · 1¢

Autosheet in Excel GPT-6 Luna · High

Passed20s · 0.4¢

Copilot in Excel Auto

Passed27s · N/A

Failed 6

Autosheet in Sheets Haiku 5.5 · High

Failed24s · 0.3¢

Why it failed: The category axis was not reversed; the years still run 2021 to 2025 instead of 2025 to 2021.

ChatGPT + Drive MCP GPT-6 · Medium

Failed38s · N/A

Why it failed: Category axis order was not reversed to 2025-2021.

ChatGPT in Excel GPT-6 Luna · High

Failed46s · 0.6¢

Why it failed: The chart axis was not modified in place; source data was reordered instead.

Gemini in Sheets Auto

Failed1m 6s · N/A

Why it failed: The source data in B1:D6 was modified instead of updating the chart settings while leaving underlying data untouched.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed25s · 33¢

Why it failed: The chart object was not properly updated in place to reverse category order; instead, the agent modified the underlying worksheet data across 12 cells in B2:D6.

ChatGPT in Sheets GPT-6 Luna · High

Failed31s · 0.4¢

Why it failed: The underlying table data was modified instead of updating the chart object.