All AutosheetBench tasks

Build a cash-flow waterfall chart

ChartsMediumLLM judge scoringLatest run

Passed by 8 of 12 products on their best model. Failed: Claude Code + Sheets MCP, Claude Code + Autosheet MCP, Gemini in Sheets and ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Build a waterfall showing the cash-flow bridge.

Starting spreadsheet

Cash Flow
AB
1StageAmount
2Starting cash500000
3Operating cash flow185000
4Capital expenditure-120000
5Debt repayment-75000
6New financing90000
7Ending cash580000

Expected result

How each AI configuration did

16 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • A waterfall from starting to ending cash
  • Each movement goes the right way; it ends at 580,000
  • Readable and titled; the data is unchanged

Passed 16

Autosheet in Excel Opus 5.5 · Medium

Passed25s · 8¢

Autosheet in Excel GPT-6 Astra · Low

Passed30s · 21¢

Autosheet in Sheets Opus 5.5 · Medium

Passed30s · 17¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed14s · 3¢

Claude in Excel Opus 5.5 · High

Passed50s · 26¢

Autosheet in Excel Haiku 5.5 · High

Passed23s · 0.4¢

Claude in Sheets Opus 5.5 · Medium

Passed1m 2s · 15¢

Autosheet in Excel GPT-6.1 Sol · Medium

Passed56s · 10¢

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed1m 15s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed1m 7s · 0.7¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed1m 35s · $1.12

Claude in Excel Haiku 5.5 · High

Passed33s · 1¢

Claude in Sheets Haiku 5.5 · High

Passed53s · 2¢

Copilot in Excel Auto

Passed1m 11s · N/A

ChatGPT + Drive MCP GPT-6 · Medium

Passed48s · N/A

ChatGPT in Excel GPT-6 Luna · High

Passed2m 5s · 3¢

Failed 6

Claude Code + Sheets MCP Opus 5.5 · Medium

Failed39s · N/A

Why it failed: The chart includes 'Stage' as an x-axis point, treats 'Ending cash' as an intermediate incremental step of +580,000, and fails to establish a proper bridge from starting cash to ending cash.

Claude Code + Autosheet MCP Opus 5.5 · Medium

Failed1m 11s · N/A

Why it failed: The waterfall chart does not properly bridge starting cash to ending cash; it includes 'Stage' as a data category and adds 'Ending cash' as a movement instead of a final total.

Autosheet in Excel GPT-6 Luna · High

Failed48s · 0.6¢

Why it failed: Ending cash is plotted as an addition rather than the closing balance of the bridge.

Gemini in Sheets Auto

Failed39s · N/A

Why it failed: The chart is placed across A1:H20, directly obscuring the source data table in A1:B7.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed1m 7s · 61¢

Why it failed: No native waterfall chart was inserted into the workbook.

ChatGPT in Sheets GPT-6 Luna · High

Failed2m 14s · 1¢

Why it failed: No waterfall chart was created.