All AutosheetBench tasks

Look up a value to the left

FormulasEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Use formulas in B2:B5 to bring in the category for each SKU.

Orders

Starting sheet
AB
1SKUCategory
2SKU-100
3SKU-200
4SKU-300
5SKU-400

Catalog

Starting sheet
AB
1CategorySKU
2HardwareSKU-100
3SoftwareSKU-200
4ServicesSKU-300
5AccessoriesSKU-400

A passing output

Autosheet in Excel · Opus 5.5
Orders4 cells changed

B2=IFERROR(INDEX(Catalog!$A$2:$A$6, MATCH(A2, Catalog!$B$2:$B$6, 0)), "Not found")

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • Orders!B2:B5 hold the expected values, from formulas

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed10s · 3¢
Orders4 cells changed

B2=IFERROR(INDEX(Catalog!$A$2:$A$6, MATCH(A2, Catalog!$B$2:$B$6, 0)), "Not found")

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Autosheet in Excel GPT-6 Astra · Low

Passed12s · 6¢
Orders4 cells changed

B2=XLOOKUP(A2,Catalog!$B$2:$B$5,Catalog!$A$2:$A$5,"Not found")

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Autosheet in Sheets Opus 5.5 · Medium

Passed12s · 3¢
Orders4 cells changed

B2=IFERROR(INDEX(Catalog!$A$2:$A$5, MATCH(A2, Catalog!$B$2:$B$5, 0)), "Not found")

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Autosheet in Excel Sonnet 5.5 · Medium

Passed5s · 1¢
Orders4 cells changed

B2=INDEX(Catalog!$A$2:$A$6,MATCH(A2,Catalog!$B$2:$B$6,0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Claude in Excel Opus 5.5 · High

Passed13s · 9¢
Orders4 cells changed

B2=INDEX(Catalog!$A:$A,MATCH(A2,Catalog!$B:$B,0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Autosheet in Excel Haiku 5.5 · High

Passed8s · 0.1¢
Orders4 cells changed

B2=XLOOKUP(A2,Catalog!$B:$B,Catalog!$A:$A,"Not found")

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Claude in Sheets Opus 5.5 · Medium

Passed30s · 7¢
Orders4 cells changed

B2=IFERROR(INDEX(Catalog!$A$2:$A$5,MATCH($A2,Catalog!$B$2:$B$5,0)),"Not found")

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed26s · N/A
Orders4 cells changed

B2=INDEX(Catalog!$A:$A, MATCH(A2, Catalog!$B:$B, 0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Autosheet in Excel GPT-6.1 Sol · Medium

Passed15s · 6¢
Orders4 cells changed

B2=XLOOKUP(A2,Catalog!$B$2:$B$5,Catalog!$A$2:$A$5,"")

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed32s · N/A
Orders4 cells changed

B2=XLOOKUP(A2, Catalog!$B$2:$B1000, Catalog!$A$2:$A1000, "Not found")

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed39s · N/A
Orders4 cells changed

B2=INDEX(Catalog!$A$2:$A$5, MATCH(A2, Catalog!$B$2:$B$5, 0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Autosheet in Sheets Haiku 5.5 · High

Passed17s · 0.1¢
Orders4 cells changed

B2=XLOOKUP(A2,Catalog!$B:$B,Catalog!$A:$A,"Not found")

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

ChatGPT in Excel GPT-6 Astra · Medium

Passed20s · 40¢
Orders4 cells changed

B2=INDEX(Catalog!$A$2:$A$5,MATCH(A2,Catalog!$B$2:$B$5,0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Claude in Excel Haiku 5.5 · High

Passed10s · 0.3¢
Orders4 cells changed

B2=INDEX(Catalog!$A:$A,MATCH(A2,Catalog!$B:$B,0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Claude in Sheets Haiku 5.5 · High

Passed13s · 0.4¢
Orders4 cells changed

B2=INDEX(Catalog!$A$2:$A$5, MATCH(A2, Catalog!$B$2:$B$5, 0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Autosheet in Excel GPT-6 Luna · High

Passed11s · 0.2¢
Orders4 cells changed

B2=INDEX(Catalog!$A:$A,MATCH(A2,Catalog!$B:$B,0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Copilot in Excel Auto

Passed21s · N/A
Orders4 cells changed

B2=XLOOKUP(A2,Catalog!$B$2:$B$5,Catalog!$A$2:$A$5,"Not found")

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

ChatGPT + Drive MCP GPT-6 · Medium

Passed26s · N/A
Orders4 cells changed

B2=INDEX(Catalog!$A$2:$A$5,MATCH(A2,Catalog!$B$2:$B$5,0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

ChatGPT in Excel GPT-6 Luna · High

Passed16s · 0.4¢
Orders4 cells changed

B2=XLOOKUP(A2,Catalog!$B$2:$B$5,Catalog!$A$2:$A$5)

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

Gemini in Sheets Auto

Passed58s · N/A
Orders4 cells changed

B2=INDEX(Catalog!$A$2:$A$5, MATCH(A2, Catalog!$B$2:$B$5, 0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

ChatGPT in Sheets GPT-6 Astra · Medium

Passed27s · 32¢
Orders4 cells changed

B2=INDEX(Catalog!$A$2:$A$5,MATCH(A2,Catalog!$B$2:$B$5,0))

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories

ChatGPT in Sheets GPT-6 Luna · High

Passed24s · 0.3¢
Orders4 cells changed

B2=XLOOKUP(A2,Catalog!$B$2:$B$5,Catalog!$A$2:$A$5)

AB
1SKUCategory
2SKU-100Hardware
3SKU-200Software
4SKU-300Services
5SKU-400Accessories