Give a chart a proper title
ChartsMediumLLM judge scoringLatest run
Passed by 11 of 12 products on their best model. Failed: ChatGPT in Sheets.
Prompt
Give the chart a proper title.
Starting spreadsheet
Sheet1| A | B | C | D | E | F | G | H | I | J | K | L | M | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Year | Revenue | Profit | ||||||||||
| 2 | 2021 | 1250000 | 180000 | ||||||||||
| 3 | 2022 | 1430000 | 215000 | ||||||||||
| 4 | 2023 | 1590000 | 248000 | ||||||||||
| 5 | 2024 | 1710000 | 286000 | ||||||||||
| 6 | 2025 | 1880000 | 324000 | ||||||||||
| 7 | |||||||||||||
| 8 | |||||||||||||
| 9 | |||||||||||||
| 10 | |||||||||||||
| 11 | |||||||||||||
| 12 | |||||||||||||
| 13 | |||||||||||||
| 14 | |||||||||||||
| 15 | |||||||||||||
| 16 | |||||||||||||
| 17 |
Chart on this sheet
Expected result
Excel and Sheets · All types · All models · All outputs
Pass criteria
All must be met, checked by an LLM judge.- The chart is edited in place, colors kept
- A visible, descriptive title
Passed 19
Autosheet in Excel Opus 5.5 · Medium
Passed15s · 5¢
Autosheet in Excel GPT-6 Astra · Low
Passed11s · 9¢
Autosheet in Sheets Opus 5.5 · Medium
Passed13s · 5¢
Autosheet in Excel Sonnet 5.5 · Medium
Passed5s · 2¢
Claude in Excel Opus 5.5 · High
Passed10s · 6¢
Autosheet in Excel Haiku 5.5 · High
Passed9s · 0.2¢
Claude in Sheets Opus 5.5 · Medium
Passed15s · 4¢
Claude Code + Sheets MCP Opus 5.5 · Medium
Passed25s · N/A
Autosheet in Excel GPT-6.1 Sol · Medium
Passed14s · 7¢
Claude Code + Autosheet MCP Opus 5.5 · Medium
Passed36s · N/A
ChatGPT + Autosheet MCP GPT-6 · Medium
Passed37s · N/A
Autosheet in Sheets Haiku 5.5 · High
Passed19s · 0.2¢
ChatGPT in Excel GPT-6 Astra · Medium
Passed25s · 42¢
Claude in Excel Haiku 5.5 · High
Passed15s · 0.4¢
Claude in Sheets Haiku 5.5 · High
Passed23s · 0.9¢
Autosheet in Excel GPT-6 Luna · High
Passed14s · 0.3¢
Copilot in Excel Auto
Passed21s · N/A
ChatGPT + Drive MCP GPT-6 · Medium
Passed41s · N/A
Gemini in Sheets Auto
Passed51s · N/A
Failed 3
ChatGPT in Excel GPT-6 Luna · High
Failed18s · 0.4¢
Why it failed: Series configuration was altered, changing colors and plotting Year as a series.
ChatGPT in Sheets GPT-6 Astra · Medium
Failed19s · 28¢
Why it failed: The chart was not updated.
ChatGPT in Sheets GPT-6 Luna · High
Failed20s · 0.3¢
Why it failed: The chart lacks a title.