All AutosheetBench tasks

Strip a currency from amounts

Data operationsEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Remove the currency (EUR) from the amount column to only have numeric values.

Starting spreadsheet

Customers
AB
1Customer IDAmount
2C-100EUR 1,250.00
3C-101EUR 980.50
4C-101EUR 980.50
5C-102EUR 2,100.00
6C-103EUR 760.25
7C-102760 EUR
8C-103650eur
9C-100345 ERU
10C-100EUR 150
11C-1027140 EUR
12C-1032300 E
13C-101769.87 EUR
14C-1011792.70 EUR

A passing output

Autosheet in Excel · Opus 5.5
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • B2:B14 match the expected answers

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed12s · 4¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

Autosheet in Excel GPT-6 Astra · Low

Passed26s · 9¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001250.00
3C-101980.50
4C-101980.50
5C-1022100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027140.00
12C-1032300.00
13C-101769.87
14C-1011792.70

Autosheet in Sheets Opus 5.5 · Medium

Passed45s · 9¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

Autosheet in Excel Sonnet 5.5 · Medium

Passed16s · 2¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

Claude in Excel Opus 5.5 · High

Passed12s · 11¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

Autosheet in Excel Haiku 5.5 · High

Passed15s · 0.4¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

Claude in Sheets Opus 5.5 · Medium

Passed17s · 4¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed23s · N/A
Customers13 cells changed
AB
1Customer IDAmount
2C-1001250
3C-101980.5
4C-101980.5
5C-1022100
6C-103760.25
7C-102760
8C-103650
9C-100345
10C-100150
11C-1027140
12C-1032300
13C-101769.87
14C-1011792.7

Autosheet in Excel GPT-6.1 Sol · Medium

Passed21s · 3¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed1m 5s · N/A
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed45s · N/A
Customers13 cells changed
AB
1Customer IDAmount
2C-1001250.00
3C-101980.50
4C-101980.50
5C-1022100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027140.00
12C-1032300.00
13C-101769.87
14C-1011792.70

Autosheet in Sheets Haiku 5.5 · High

Passed47s · 0.5¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001250
3C-101980.5
4C-101980.5
5C-1022100
6C-103760.25
7C-102760
8C-103650
9C-100345
10C-100150
11C-1027140
12C-1032300
13C-101769.87
14C-1011792.7

ChatGPT in Excel GPT-6 Astra · Medium

Passed13s · 40¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001250
3C-101980.5
4C-101980.5
5C-1022100
6C-103760.25
7C-102760
8C-103650
9C-100345
10C-100150
11C-1027140
12C-1032300
13C-101769.87
14C-1011792.7

Claude in Excel Haiku 5.5 · High

Passed11s · 0.3¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

Claude in Sheets Haiku 5.5 · High

Passed26s · 0.9¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

Autosheet in Excel GPT-6 Luna · High

Passed33s · 0.7¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001250
3C-101980.5
4C-101980.5
5C-1022100
6C-103760.25
7C-102760
8C-103650
9C-100345
10C-100150
11C-1027140
12C-1032300
13C-101769.87
14C-1011792.7

Copilot in Excel Auto

Passed19s · N/A
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

ChatGPT + Drive MCP GPT-6 · Medium

Passed29s · N/A
Customers13 cells changed
AB
1Customer IDAmount
2C-1001250
3C-101980.5
4C-101980.5
5C-1022100
6C-103760.25
7C-102760
8C-103650
9C-100345
10C-100150
11C-1027140
12C-1032300
13C-101769.87
14C-1011792.7

ChatGPT in Excel GPT-6 Luna · High

Passed17s · 0.4¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001250
3C-101980.5
4C-101980.5
5C-1022100
6C-103760.25
7C-102760
8C-103650
9C-100345
10C-100150
11C-1027140
12C-1032300
13C-101769.87
14C-1011792.7

Gemini in Sheets Auto

Passed1m 13s · N/A
Customers13 cells changed
AB
1Customer IDAmount
2C-1001,250.00
3C-101980.50
4C-101980.50
5C-1022,100.00
6C-103760.25
7C-102760.00
8C-103650.00
9C-100345.00
10C-100150.00
11C-1027,140.00
12C-1032,300.00
13C-101769.87
14C-1011,792.70

ChatGPT in Sheets GPT-6 Astra · Medium

Passed21s · 32¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001250
3C-101980.5
4C-101980.5
5C-1022100
6C-103760.25
7C-102760
8C-103650
9C-100345
10C-100150
11C-1027140
12C-1032300
13C-101769.87
14C-1011792.7

ChatGPT in Sheets GPT-6 Luna · High

Passed25s · 0.3¢
Customers13 cells changed
AB
1Customer IDAmount
2C-1001250
3C-101980.5
4C-101980.5
5C-1022100
6C-103760.25
7C-102760
8C-103650
9C-100345
10C-100150
11C-1027140
12C-1032300
13C-101769.87
14C-1011792.7