All AutosheetBench tasks

Chart and polish a sales report

ChartsMediumLLM judge scoringLatest run

Passed by 10 of 12 products on their best model. Failed: Gemini in Sheets and ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Create a chart showing monthly revenue trends

Make the spreadsheet look polished — proper currency formatting, bold headers, alternating row colors

Add a second chart comparing revenue vs expenses side by side

Starting spreadsheet

Sheet1
ABCDE
1MonthRevenueExpensesNet ProfitDeals Closed
2Jan 202598500712002730014
3Feb 2025104200748002940017
4Mar 2025117600795003810021
5Apr 2025112300764003590019
6May 2025128900821004680024
7Jun 2025135400856004980026
8Jul 2025121700832003850022
9Aug 2025118500809003760020
10Sep 2025143200887005450028
11Oct 2025151800913006050031
12Nov 2025168400965007190035
13Dec 20251847001012008350039

Expected result

How each AI configuration did

19 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • A trend chart of revenue by month
  • Currency formats, bold headers and banded rows
  • A second chart comparing revenue and expenses
  • That chart is a column or line chart

Passed 19

Autosheet in Excel Opus 5.5 · Medium

Passed37s · 14¢

Autosheet in Excel GPT-6 Astra · Low

Passed30s · 30¢

Autosheet in Sheets Opus 5.5 · Medium

Passed41s · 15¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed21s · 6¢

Claude in Excel Opus 5.5 · High

Passed47s · 28¢

Autosheet in Excel Haiku 5.5 · High

Passed23s · 0.5¢

Claude in Sheets Opus 5.5 · Medium

Passed59s · 19¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed1m 39s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed42s · 10¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed3m 37s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed2m 46s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed1m 18s · 0.8¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed56s · $1.56

Claude in Excel Haiku 5.5 · High

Passed30s · 1¢

Claude in Sheets Haiku 5.5 · High

Passed50s · 2¢

Autosheet in Excel GPT-6 Luna · High

Passed36s · 0.9¢

Copilot in Excel Auto

Passed1m 31s · N/A

ChatGPT + Drive MCP GPT-6 · Medium

Passed1m 36s · N/A

ChatGPT in Excel GPT-6 Luna · High

Passed2m 25s · 2¢

Failed 3

Gemini in Sheets Auto

Failed5m · N/A

Why it failed: Still working at the 5-minute time limit. The second chart containing revenue and expenses series was canceled and not added.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed3m 1s · $2.30

Why it failed: No native trend chart object was created; in-cell text bars were used instead.

ChatGPT in Sheets GPT-6 Luna · High

Failed5m · 3¢
Sheet1118 cells changed

G3=A2

ABCDEFGHIJKLMNO
1MonthRevenueExpensesNet ProfitDeals ClosedMonthly Revenue Trend ($)Monthly Revenue vs Expenses ($)
2Jan 2025$98,500$71,200$27,30014MonthRevenueTrendMonthRevenueExpensesRevenue BarExpense Bar
3Feb 2025$104,200$74,800$29,40017Jan 2025$98,500■■■■■■■■■■Jan 2025$98,500$71,200■■■■■■■■■■■■■■■■■
4Mar 2025$117,600$79,500$38,10021Feb 2025$104,200■■■■■■■■■■Feb 2025$104,200$74,800■■■■■■■■■■■■■■■■■
5Apr 2025$112,300$76,400$35,90019Mar 2025$117,600■■■■■■■■■■■■Mar 2025$117,600$79,500■■■■■■■■■■■■■■■■■■■■
6May 2025$128,900$82,100$46,80024Apr 2025$112,300■■■■■■■■■■■Apr 2025$112,300$76,400■■■■■■■■■■■■■■■■■■■
7Jun 2025$135,400$85,600$49,80026May 2025$128,900■■■■■■■■■■■■■May 2025$128,900$82,100■■■■■■■■■■■■■■■■■■■■■
8Jul 2025$121,700$83,200$38,50022Jun 2025$135,400■■■■■■■■■■■■■■Jun 2025$135,400$85,600■■■■■■■■■■■■■■■■■■■■■■■
9Aug 2025$118,500$80,900$37,60020Jul 2025$121,700■■■■■■■■■■■■Jul 2025$121,700$83,200■■■■■■■■■■■■■■■■■■■■
10Sep 2025$143,200$88,700$54,50028Aug 2025$118,500■■■■■■■■■■■■Aug 2025$118,500$80,900■■■■■■■■■■■■■■■■■■■■
11Oct 2025$151,800$91,300$60,50031Sep 2025$143,200■■■■■■■■■■■■■■Sep 2025$143,200$88,700■■■■■■■■■■■■■■■■■■■■■■■
12Nov 2025$168,400$96,500$71,90035Oct 2025$151,800■■■■■■■■■■■■■■■Oct 2025$151,800$91,300■■■■■■■■■■■■■■■■■■■■■■■■
13Dec 2025$184,700$101,200$83,50039Nov 2025$168,400■■■■■■■■■■■■■■■■■Nov 2025$168,400$96,500■■■■■■■■■■■■■■■■■■■■■■■■■■■
14Dec 2025$184,700■■■■■■■■■■■■■■■■■■Dec 2025$184,700$101,200■■■■■■■■■■■■■■■■■■■■■■■■■■■■

Why it failed: Still working at the 5-minute time limit. No chart was created: the trend is drawn with text formulas in cells instead.