All AutosheetBench tasks

Label only the latest point of a line

ChartsHardLLM judge scoringLatest run

Passed by 7 of 12 products on their best model. Failed: Copilot in Excel, Claude Code + Sheets MCP, Claude Code + Autosheet MCP, ChatGPT + Drive MCP and ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Create a line chart of revenue over time and display a label only on the most recent point.

Data

Starting sheet · rows 1–21 of 61
AB
1DateRevenue
22025-01-0111715
32025-01-0211990
42025-01-0312265
52025-01-0412540
62025-01-0512815
72025-01-0613090
82025-01-0713365
92025-01-0812975
102025-01-0913250
112025-01-1013525
122025-01-1113800
132025-01-1214075
142025-01-1314350
152025-01-1414625
162025-01-1514235
172025-01-1614510
182025-01-1714785
192025-01-1815060
202025-01-1915335
212025-01-2015610

Chart

Starting sheet
A
1

Expected result

How each AI configuration did

14 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • A line chart of revenue over time
  • Only the latest point has a label
  • No other series shown
  • Dates in order and a clear title

Passed 14

Autosheet in Excel Opus 5.5 · Medium

Passed16s · 6¢

Autosheet in Excel GPT-6 Astra · Low

Passed14s · 11¢

Autosheet in Sheets Opus 5.5 · Medium

Passed38s · 12¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed7s · 2¢

Claude in Excel Opus 5.5 · High

Passed37s · 20¢

Autosheet in Excel Haiku 5.5 · High

Passed17s · 0.3¢

Claude in Sheets Opus 5.5 · Medium

Passed57s · 14¢

Autosheet in Excel GPT-6.1 Sol · Medium

Passed33s · 4¢

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed59s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed1m 10s · 0.8¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed56s · 73¢

Claude in Excel Haiku 5.5 · High

Passed15s · 0.6¢

Autosheet in Excel GPT-6 Luna · High

Passed31s · 0.8¢

Gemini in Sheets Auto

Passed28s · N/A

Failed 8

Claude Code + Sheets MCP Opus 5.5 · Medium

Failed1m 3s · N/A

Why it failed: The most recent point has a marker dot but no visible data label showing the value.

Claude Code + Autosheet MCP Opus 5.5 · Medium

Failed1m 5s · N/A

Why it failed: No data label is visible on the most recent point; only a marker dot is rendered without any text or value label.

Claude in Sheets Haiku 5.5 · High

Failed1m 38s · 3¢

Why it failed: There is no data label visible on the most recent point (only a point marker).

Copilot in Excel Auto

Failed58s · N/A

Why it failed: Data labels are visible for every point along the line rather than exclusively on the final point.

ChatGPT + Drive MCP GPT-6 · Medium

Failed1m · N/A

Why it failed: There is no data label displayed on the most recent data point on the chart.

ChatGPT in Excel GPT-6 Luna · High

Failed1m 9s · 3¢

Why it failed: No label is displayed on the last value; the plot area is completely blank.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed1m 16s · 69¢

Why it failed: No line chart was created.

ChatGPT in Sheets GPT-6 Luna · High

Failed1m 32s · 0.7¢

Why it failed: No line chart was created.