All AutosheetBench tasks

Look up prices and compute totals

FormulasEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Use formulas in C2:D16 to pull prices from the catalog and calculate each total.

Orders

Starting sheet
ABCD
1ProductIDQuantityPriceTotal
2PRD-2043
3PRD-1171
4PRD-3085
5PRD-4522
6PRD-2047
7PRD-1174
8PRD-5616
9PRD-3082
10PRD-4523
11PRD-7891
12PRD-2048
13PRD-1172
14PRD-5615
15PRD-7894
16PRD-3083

Catalog

Starting sheet
AB
1ProductIDUnitPrice
2PRD-11712.5
3PRD-2048.75
4PRD-30822
5PRD-4525.4
6PRD-56131
7PRD-62318.25
8PRD-7899.99
9PRD-84444.5

A passing output

Autosheet in Excel · Opus 5.5
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A$9,Catalog!$B$2:$B$9,"Not found")

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • Orders!C2:D16 hold the expected values, from formulas

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed16s · 6¢
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A$9,Catalog!$B$2:$B$9,"Not found")

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

Autosheet in Excel GPT-6 Astra · Low

Passed8s · 7¢
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A$9,Catalog!$B$2:$B$9)

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

Autosheet in Sheets Opus 5.5 · Medium

Passed20s · 5¢
Orders30 cells changed

C2=XLOOKUP(A2, Catalog!$A$2:$A$9, Catalog!$B$2:$B$9, "Not found")

ABCD
1ProductIDQuantityPriceTotal
2PRD-2043$8.75$26.25
3PRD-1171$12.50$12.50
4PRD-3085$22.00$110.00
5PRD-4522$5.40$10.80
6PRD-2047$8.75$61.25
7PRD-1174$12.50$50.00
8PRD-5616$31.00$186.00
9PRD-3082$22.00$44.00
10PRD-4523$5.40$16.20
11PRD-7891$9.99$9.99
12PRD-2048$8.75$70.00
13PRD-1172$12.50$25.00
14PRD-5615$31.00$155.00
15PRD-7894$9.99$39.96
16PRD-3083$22.00$66.00

Autosheet in Excel Sonnet 5.5 · Medium

Passed6s · 1¢
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A$10,Catalog!$B$2:$B$10,"Not found")

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

Claude in Excel Opus 5.5 · High

Passed12s · 10¢
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A:$A,Catalog!$B:$B,"Not found")

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.5012.50
4PRD-308522.00110.00
5PRD-45225.4010.80
6PRD-20478.7561.25
7PRD-117412.5050.00
8PRD-561631.00186.00
9PRD-308222.0044.00
10PRD-45235.4016.20
11PRD-78919.999.99
12PRD-20488.7570.00
13PRD-117212.5025.00
14PRD-561531.00155.00
15PRD-78949.9939.96
16PRD-308322.0066.00

Autosheet in Excel Haiku 5.5 · High

Passed15s · 0.2¢
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A$9,Catalog!$B$2:$B$9)

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

Claude in Sheets Opus 5.5 · Medium

Passed30s · 6¢
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A1000,Catalog!$B$2:$B1000)

ABCD
1ProductIDQuantityPriceTotal
2PRD-2043$8.75$26.25
3PRD-1171$12.50$12.50
4PRD-3085$22.00$110.00
5PRD-4522$5.40$10.80
6PRD-2047$8.75$61.25
7PRD-1174$12.50$50.00
8PRD-5616$31.00$186.00
9PRD-3082$22.00$44.00
10PRD-4523$5.40$16.20
11PRD-7891$9.99$9.99
12PRD-2048$8.75$70.00
13PRD-1172$12.50$25.00
14PRD-5615$31.00$155.00
15PRD-7894$9.99$39.96
16PRD-3083$22.00$66.00

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed33s · N/A
Orders30 cells changed

C2=INDEX(Catalog!$B:$B,MATCH($A2,Catalog!$A:$A,0))

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

Autosheet in Excel GPT-6.1 Sol · Medium

Passed15s · 3¢
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A$9,Catalog!$B$2:$B$9)

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed32s · N/A
Orders30 cells changed

C2=IFERROR(XLOOKUP(TRIM(A2), Catalog!$A$2:$A$9, Catalog!$B$2:$B$9), "Not found")

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed28s · N/A
Orders30 cells changed

C2=XLOOKUP(TRIM($A2), Catalog!$A$2:$A$9, Catalog!$B$2:$B$9, "Not found", 0)

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

Autosheet in Sheets Haiku 5.5 · High

Passed19s · 0.2¢
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A:$A,Catalog!$B:$B,"Not found")

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

ChatGPT in Excel GPT-6 Astra · Medium

Passed20s · 45¢
Orders30 cells changed

C2=VLOOKUP(A2,Catalog!$A$2:$B$9,2,FALSE)

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

Claude in Excel Haiku 5.5 · High

Passed18s · 0.5¢
Orders30 cells changed

C2=INDEX(Catalog!$B$2:$B$9,MATCH(A2,Catalog!$A$2:$A$9,0))

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.5012.50
4PRD-308522.00110.00
5PRD-45225.4010.80
6PRD-20478.7561.25
7PRD-117412.5050.00
8PRD-561631.00186.00
9PRD-308222.0044.00
10PRD-45235.4016.20
11PRD-78919.999.99
12PRD-20488.7570.00
13PRD-117212.5025.00
14PRD-561531.00155.00
15PRD-78949.9939.96
16PRD-308322.0066.00

Claude in Sheets Haiku 5.5 · High

Passed20s · 0.6¢
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A$9,Catalog!$B$2:$B$9)

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.5012.50
4PRD-308522.00110.00
5PRD-45225.4010.80
6PRD-20478.7561.25
7PRD-117412.5050.00
8PRD-561631.00186.00
9PRD-308222.0044.00
10PRD-45235.4016.20
11PRD-78919.999.99
12PRD-20488.7570.00
13PRD-117212.5025.00
14PRD-561531.00155.00
15PRD-78949.9939.96
16PRD-308322.0066.00

Autosheet in Excel GPT-6 Luna · High

Passed12s · 0.3¢
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A$9,Catalog!$B$2:$B$9,"Not found")

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

Copilot in Excel Auto

Passed17s · N/A
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A$9,Catalog!$B$2:$B$9)

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.5012.50
4PRD-308522.00110.00
5PRD-45225.4010.80
6PRD-20478.7561.25
7PRD-117412.5050.00
8PRD-561631.00186.00
9PRD-308222.0044.00
10PRD-45235.4016.20
11PRD-78919.999.99
12PRD-20488.7570.00
13PRD-117212.5025.00
14PRD-561531.00155.00
15PRD-78949.9939.96
16PRD-308322.0066.00

ChatGPT + Drive MCP GPT-6 · Medium

Passed23s · N/A
Orders30 cells changed

C2=XLOOKUP(A2,Catalog!$A$2:$A$9,Catalog!$B$2:$B$9,"")

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

ChatGPT in Excel GPT-6 Luna · High

Passed25s · 0.4¢
Orders30 cells changed

C2=VLOOKUP(A2,Catalog!$A$2:$B$10,2,FALSE)

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

Gemini in Sheets Auto

Passed1m 20s · N/A
Orders30 cells changed

C2=XLOOKUP(A2, Catalog!$A$2:$A$9, Catalog!$B$2:$B$9)

ABCD
1ProductIDQuantityPriceTotal
2PRD-2043$8.75$26.25
3PRD-1171$12.50$12.50
4PRD-3085$22.00$110.00
5PRD-4522$5.40$10.80
6PRD-2047$8.75$61.25
7PRD-1174$12.50$50.00
8PRD-5616$31.00$186.00
9PRD-3082$22.00$44.00
10PRD-4523$5.40$16.20
11PRD-7891$9.99$9.99
12PRD-2048$8.75$70.00
13PRD-1172$12.50$25.00
14PRD-5615$31.00$155.00
15PRD-7894$9.99$39.96
16PRD-3083$22.00$66.00

ChatGPT in Sheets GPT-6 Astra · Medium

Passed37s · 35¢
Orders30 cells changed

C2=VLOOKUP(A2,Catalog!$A$2:$B$9,2,FALSE)

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266

ChatGPT in Sheets GPT-6 Luna · High

Passed26s · 0.4¢
Orders30 cells changed

C2=INDEX(Catalog!$B$2:$B$9,MATCH(A2,Catalog!$A$2:$A$9,0))

ABCD
1ProductIDQuantityPriceTotal
2PRD-20438.7526.25
3PRD-117112.512.5
4PRD-308522110
5PRD-45225.410.8
6PRD-20478.7561.25
7PRD-117412.550
8PRD-561631186
9PRD-30822244
10PRD-45235.416.2
11PRD-78919.999.99
12PRD-20488.7570
13PRD-117212.525
14PRD-561531155
15PRD-78949.9939.96
16PRD-30832266