All AutosheetBench tasks

Create a Gantt chart

ChartsHardLLM judge scoringLatest run

Passed by 3 of 12 products on their best model: Autosheet in Excel, Claude in Excel and Claude in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Create a Gantt chart.

Data

Starting sheet
ABC
1TaskStart DateDuration (days)
2Plan2025-04-013
3Design2025-04-035
4Build2025-04-088
5QA2025-04-144
6Launch2025-04-192
7Training2025-04-203
8Review2025-04-242
9Wrap-up2025-04-261

Chart

Starting sheet
A
1

Expected result

How each AI configuration did

9 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • A horizontal bar chart
  • Only the task blocks are colored
  • Readable dates in order
  • A clear title; any legend at the top

Passed 9

Autosheet in Excel Opus 5.5 · Medium

Passed46s · 16¢

Autosheet in Excel GPT-6 Astra · Low

Passed1m 32s · 62¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed11s · 3¢

Claude in Excel Opus 5.5 · High

Passed51s · 27¢

Autosheet in Excel Haiku 5.5 · High

Passed46s · 0.8¢

Claude in Sheets Opus 5.5 · Medium

Passed42s · 17¢

Autosheet in Excel GPT-6.1 Sol · Medium

Passed1m 37s · 20¢

Claude in Excel Haiku 5.5 · High

Passed32s · 0.9¢

Autosheet in Excel GPT-6 Luna · High

Passed2m 16s · 2¢

Failed 13

Autosheet in Sheets Opus 5.5 · Medium

Failed45s · 12¢

Why it failed: The horizontal axis shows day numbers ('0', '10', '20', '30') labeled 'Days from project start' instead of readable calendar dates.

Claude Code + Sheets MCP Opus 5.5 · Medium

Failed59s · N/A

Why it failed: The horizontal axis shows numeric increments (0, 10, 20, 30) rather than dates.

Claude Code + Autosheet MCP Opus 5.5 · Medium

Failed1m 42s · N/A

Why it failed: The horizontal axis shows numeric day offsets rather than readable dates.

ChatGPT + Autosheet MCP GPT-6 · Medium

Failed1m 37s · N/A

Why it failed: No chart object was created (chartCount is 0).

Autosheet in Sheets Haiku 5.5 · High

Failed1m 31s · 1¢

Why it failed: The horizontal axis shows numeric day offsets (0, 10, 20, 30) rather than readable calendar dates.

ChatGPT in Excel GPT-6 Astra · Medium

Failed2m 45s · $1.37

Why it failed: The horizontal axis counts days from the start, 0 to 28, instead of showing dates.

Claude in Sheets Haiku 5.5 · High

Failed1m · 2¢

Why it failed: The horizontal axis displays numeric day offsets (0, 10, 20, 30) rather than readable dates.

Copilot in Excel Auto

Failed1m 26s · N/A

Why it failed: Floating Gantt blocks were not formed; standard solid bars originate from the vertical axis.

ChatGPT + Drive MCP GPT-6 · Medium

Failed54s · N/A

Why it failed: The horizontal axis displays numeric offsets (0, 10, 20, 30) rather than readable dates.

ChatGPT in Excel GPT-6 Luna · High

Failed1m 57s · 1¢

Why it failed: Start offset bars remain colored and visible.

Gemini in Sheets Auto

Failed3m 2s · N/A

Why it failed: The horizontal axis plots numeric day offsets (=B2-$B$2) rather than readable calendar dates.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed1m 1s · 57¢

Why it failed: No chart was created.

ChatGPT in Sheets GPT-6 Luna · High

Failed1m 54s · 0.9¢

Why it failed: No chart was created.