All AutosheetBench tasks

Create and use a named range

FormulasEasyDeterministic scoringLatest run

Passed by 11 of 12 products on their best model. Failed: ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Create a named range called MonthlySales for B2:B5, then use that name in a formula in B6 to total the sales.

Starting spreadsheet

Sheet1
AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100

A passing output

Autosheet in Excel · Opus 5.5
Sheet12 cells changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
6Total5600

How each AI configuration did

20 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • B6 is 5,600
  • B6 uses a formula that refers to MonthlySales
  • A named range MonthlySales exists

Passed 20

Autosheet in Excel Opus 5.5 · Medium

Passed9s · 3¢
Sheet12 cells changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
6Total5600

Autosheet in Excel GPT-6 Astra · Low

Passed10s · 6¢
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Autosheet in Sheets Opus 5.5 · Medium

Passed10s · 2¢
Sheet12 cells changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
6Total5600

Autosheet in Excel Sonnet 5.5 · Medium

Passed4s · 0.8¢
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Claude in Excel Opus 5.5 · High

Passed16s · 11¢
Sheet12 cells changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
6Total5600

Autosheet in Excel Haiku 5.5 · High

Passed6s · 0.1¢
Sheet12 cells changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
6Total5600

Claude in Sheets Opus 5.5 · Medium

Passed17s · 4¢
Sheet12 cells changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
6Total5600

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed25s · N/A
Sheet12 cells changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
6Total5600

Autosheet in Excel GPT-6.1 Sol · Medium

Passed12s · 2¢
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed36s · N/A
Sheet12 cells changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
6Total5600

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed32s · N/A
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Autosheet in Sheets Haiku 5.5 · High

Passed18s · 0.1¢
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

ChatGPT in Excel GPT-6 Astra · Medium

Passed9s · 33¢
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Claude in Excel Haiku 5.5 · High

Passed9s · 0.4¢
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Claude in Sheets Haiku 5.5 · High

Passed19s · 0.5¢
Sheet12 cells changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
6Total5600

Autosheet in Excel GPT-6 Luna · High

Passed14s · 0.3¢
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Copilot in Excel Auto

Passed19s · N/A
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

ChatGPT + Drive MCP GPT-6 · Medium

Passed23s · N/A
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

ChatGPT in Excel GPT-6 Luna · High

Passed19s · 0.4¢
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Gemini in Sheets Auto

Passed1m 3s · N/A
Sheet11 cell changed

B6=SUM(MonthlySales)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Failed 2

ChatGPT in Sheets GPT-6 Astra · Medium

Failed22s · 31¢
Sheet11 cell changedWrong value

B6=SUM(B2:B5)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Why it failed: B6's formula doesn't use MonthlySales. No named range MonthlySales.

ChatGPT in Sheets GPT-6 Luna · High

Failed21s · 0.3¢
Sheet11 cell changedWrong value

B6=SUM(B2:B5)

AB
1MonthSales
2Jan1200
3Feb1500
4Mar1800
5Apr1100
65600

Why it failed: B6's formula doesn't use MonthlySales. No named range MonthlySales.