All AutosheetBench tasks

Compute a running total

FormulasEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Use formulas in G2:G8 to calculate cumulative Revenue in row order.

Starting spreadsheet

Orders
ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q172014400
3O-1002North America2026-01-17Q14508250
4O-1003Europe2026-02-09Q198018900
5O-1004Asia2026-02-17Q161011200
6O-1005Europe2026-03-03Q154016500
7O-1006Europe2026-04-12Q2125024800
8O-1007North America2026-05-06Q23207200

A passing output

Autosheet in Excel · Opus 5.5
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • G2:G8 hold the expected values, from formulas

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed8s · 2¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Autosheet in Excel GPT-6 Astra · Low

Passed6s · 5¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Autosheet in Sheets Opus 5.5 · Medium

Passed9s · 2¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Autosheet in Excel Sonnet 5.5 · Medium

Passed5s · 1¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Claude in Excel Opus 5.5 · High

Passed9s · 6¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Autosheet in Excel Haiku 5.5 · High

Passed9s · 0.1¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Claude in Sheets Opus 5.5 · Medium

Passed26s · 5¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014,400
3O-1002North America2026-01-17Q1450825022,650
4O-1003Europe2026-02-09Q19801890041,550
5O-1004Asia2026-02-17Q16101120052,750
6O-1005Europe2026-03-03Q15401650069,250
7O-1006Europe2026-04-12Q212502480094,050
8O-1007North America2026-05-06Q23207200101,250

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed28s · N/A
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Autosheet in Excel GPT-6.1 Sol · Medium

Passed11s · 2¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed25s · N/A
Orders7 cells changed

G2=F2

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed40s · N/A
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Autosheet in Sheets Haiku 5.5 · High

Passed15s · 0.1¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

ChatGPT in Excel GPT-6 Astra · Medium

Passed13s · 40¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Claude in Excel Haiku 5.5 · High

Passed6s · 0.4¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Claude in Sheets Haiku 5.5 · High

Passed17s · 0.3¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Autosheet in Excel GPT-6 Luna · High

Passed7s · 0.1¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Copilot in Excel Auto

Passed17s · N/A
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014,400
3O-1002North America2026-01-17Q1450825022,650
4O-1003Europe2026-02-09Q19801890041,550
5O-1004Asia2026-02-17Q16101120052,750
6O-1005Europe2026-03-03Q15401650069,250
7O-1006Europe2026-04-12Q212502480094,050
8O-1007North America2026-05-06Q23207200101,250

ChatGPT + Drive MCP GPT-6 · Medium

Passed20s · N/A
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

ChatGPT in Excel GPT-6 Luna · High

Passed14s · 0.4¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

Gemini in Sheets Auto

Passed1m 8s · N/A
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

ChatGPT in Sheets GPT-6 Astra · Medium

Passed19s · 31¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250

ChatGPT in Sheets GPT-6 Luna · High

Passed26s · 0.3¢
Orders7 cells changed

G2=SUM($F$2:F2)

ABCDEFGH
1Order IDRegionDateQuarterAmountRevenueCumulative Revenue% of Total
2O-1001Europe2026-01-08Q17201440014400
3O-1002North America2026-01-17Q1450825022650
4O-1003Europe2026-02-09Q19801890041550
5O-1004Asia2026-02-17Q16101120052750
6O-1005Europe2026-03-03Q15401650069250
7O-1006Europe2026-04-12Q212502480094050
8O-1007North America2026-05-06Q23207200101250