All AutosheetBench tasks

Split two series onto their own axes

ChartsHardLLM judge scoringLatest run

Passed by 2 of 12 products on their best model: Autosheet in Excel and Claude in Excel.

Prompt and starting spreadsheet

Task files

Prompt

Put the 2 series on a different y-axis as a cluster bar. Color each y-axis of the serie's color it represent

Starting spreadsheet

Sheet1
ABCDEFGHIJKLM
1YearRevenueProfit
220211250000180000
320221430000215000
420231590000248000
520241710000286000
620251880000324000
7
8
9
10
11
12
13
14
15
16
17

Expected result

How each AI configuration did

7 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • One chart, Revenue in blue and Profit in orange
  • Columns side by side, not stacked
  • Two y-axes, each in its series' color

Passed 7

Autosheet in Excel Opus 5.5 · Medium

Passed1m 2s · 20¢

Autosheet in Excel GPT-6 Astra · Low

Passed39s · 27¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed26s · 6¢

Claude in Excel Opus 5.5 · High

Passed1m 7s · 37¢

Autosheet in Excel Haiku 5.5 · High

Passed1m 48s · 2¢

Claude in Excel Haiku 5.5 · High

Passed56s · 2¢

Claude in Sheets Haiku 5.5 · High

Passed55s · 3¢

Failed 15

Autosheet in Sheets Opus 5.5 · Medium

Failed43s · 12¢

Why it failed: While Revenue is on the primary axis and Profit is on the secondary axis, neither axis is colored to match its series (both axes remain black/grey).

Claude in Sheets Opus 5.5 · Medium

Failed35s · 11¢

Why it failed: Profit series was styled red (#EA4335) rather than orange.

Claude Code + Sheets MCP Opus 5.5 · Medium

Failed48s · N/A

Why it failed: While the two series are plotted on separate y-axes, the axes are not colored blue and orange to match their respective series; they remain black.

Autosheet in Excel GPT-6.1 Sol · Medium

Failed2m 11s · 22¢

Why it failed: The chart uses horizontal bars instead of vertical columns, and category labels for Year are missing.

Claude Code + Autosheet MCP Opus 5.5 · Medium

Failed42s · N/A

Why it failed: Neither axis line nor tick values are colored blue or orange.

ChatGPT + Autosheet MCP GPT-6 · Medium

Failed1m 14s · N/A

Why it failed: While two separate value axes were created, neither axis is colored (both remain black instead of blue for Revenue and orange for Profit), as confirmed visually and acknowledged in the…

Autosheet in Sheets Haiku 5.5 · High

Failed1m 1s · 0.7¢

Why it failed: While the series are plotted on separate value axes, the Profit axis is not colored orange (it displays default black text with no orange styling).

ChatGPT in Excel GPT-6 Astra · Medium

Failed2m 14s · $1.03

Why it failed: The chart plots the year as a third series and colors Revenue orange and Profit green, and neither axis takes its series' color.

Autosheet in Excel GPT-6 Luna · High

Failed1m 39s · 2¢

Why it failed: The chart uses horizontal bars rather than vertical columns, and the bars are superimposed/overlapping rather than side by side.

Copilot in Excel Auto

Failed1m 14s · N/A

Why it failed: The chart does not use vertical columns; it was changed to horizontal bars where the Profit and Revenue bars are superimposed/overlapping rather than side by side.

ChatGPT + Drive MCP GPT-6 · Medium

Failed42s · N/A

Why it failed: Although Revenue is on the primary left axis and Profit is on the secondary right axis, neither axis is colored blue or orange; both axes display standard black text and lines.

ChatGPT in Excel GPT-6 Luna · High

Failed3m 33s · 2¢

Why it failed: Used horizontal bars instead of vertical columns, resulting in superimposed overlapping series.

Gemini in Sheets Auto

Failed3m 21s · N/A

Why it failed: While Revenue and Profit are plotted on two separate value axes, neither axis is colored to match its series (both are plain black/grey instead of blue and orange).

ChatGPT in Sheets GPT-6 Astra · Medium

Failed28s · 34¢

Why it failed: Only one value axis exists; series were not split onto dual colored axes.

ChatGPT in Sheets GPT-6 Luna · High

Failed29s · 0.4¢

Why it failed: The chart only contains a single primary y-axis; no secondary y-axis exists for Profit, and neither axis is colored blue or orange.