All AutosheetBench tasks

Sum a metric across monthly tabs

FormulasEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

On the Summary tab, use formulas in B2:B3 to total each metric's Amount across the Jan, Feb, and Mar tabs.

Jan

Starting sheet
AB
1MetricAmount
2Total Sales42000
3Total Cost31000

Feb

Starting sheet
AB
1MetricAmount
2Total Sales38000
3Total Cost29000

Mar

Starting sheet
AB
1MetricAmount
2Total Sales51000
3Total Cost33000

Summary

Starting sheet
AB
1MetricTotal
2Total Sales
3Total Cost

A passing output

Autosheet in Excel · Opus 5.5
Summary2 cells changed

B2=SUMIF(Jan!$A:$A,$A2,Jan!$B:$B)+SUMIF(Feb!$A:$A,$A2,Feb!$B:$B)+SUMIF(Mar!$A:$A,$A2,Mar!$B:$B)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • Summary!B2 is 131,000 and Summary!B3 is 93,000
  • Summary!B2:B3 use formulas

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed21s · 5¢
Summary2 cells changed

B2=SUMIF(Jan!$A:$A,$A2,Jan!$B:$B)+SUMIF(Feb!$A:$A,$A2,Feb!$B:$B)+SUMIF(Mar!$A:$A,$A2,Mar!$B:$B)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Autosheet in Excel GPT-6 Astra · Low

Passed8s · 6¢
Summary2 cells changed

B2=SUM(Jan!B2,Feb!B2,Mar!B2)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Autosheet in Sheets Opus 5.5 · Medium

Passed15s · 4¢
Summary2 cells changed

B2=SUMIF(Jan!$A:$A, $A2, Jan!$B:$B) + SUMIF(Feb!$A:$A, $A2, Feb!$B:$B) + SUMIF(Mar!$A:$A, $A2, Mar!$B:$B)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Autosheet in Excel Sonnet 5.5 · Medium

Passed6s · 2¢
Summary2 cells changed

B2=SUMIF(Jan!$A$2:$A$3,$A2,Jan!$B$2:$B$3)+SUMIF(Feb!$A$2:$A$3,$A2,Feb!$B$2:$B$3)+SUMIF(Mar!$A$2:$A$3,$A2,Mar!$B$2:$B$3)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Claude in Excel Opus 5.5 · High

Passed15s · 11¢
Summary2 cells changed

B2=SUMIF(Jan!$A:$A,$A2,Jan!$B:$B)+SUMIF(Feb!$A:$A,$A2,Feb!$B:$B)+SUMIF(Mar!$A:$A,$A2,Mar!$B:$B)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Autosheet in Excel Haiku 5.5 · High

Passed8s · 0.1¢
Summary2 cells changed

B2=SUMIF(Jan!$A:$A,$A2,Jan!$B:$B)+SUMIF(Feb!$A:$A,$A2,Feb!$B:$B)+SUMIF(Mar!$A:$A,$A2,Mar!$B:$B)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Claude in Sheets Opus 5.5 · Medium

Passed21s · 6¢
Summary2 cells changed

B2=SUMIF(Jan!$A$2:$A1000,$A2,Jan!$B$2:$B1000)+SUMIF(Feb!$A$2:$A1000,$A2,Feb!$B$2:$B1000)+SUMIF(Mar!$A$2:$A1000,$A2,Mar!$B$2:$B1000)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed29s · N/A
Summary2 cells changed

B2=SUMIF(Jan!$A:$A,$A2,Jan!$B:$B)+SUMIF(Feb!$A:$A,$A2,Feb!$B:$B)+SUMIF(Mar!$A:$A,$A2,Mar!$B:$B)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Autosheet in Excel GPT-6.1 Sol · Medium

Passed13s · 2¢
Summary2 cells changed

B2=SUM(Jan!B2,Feb!B2,Mar!B2)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed32s · N/A
Summary2 cells changed

B2=SUMIF(Jan!$A:$A, $A2, Jan!$B:$B) + SUMIF(Feb!$A:$A, $A2, Feb!$B:$B) + SUMIF(Mar!$A:$A, $A2, Mar!$B:$B)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed31s · N/A
Summary2 cells changed

B2=SUMIF(Jan!$A:$A,$A2,Jan!$B:$B)+SUMIF(Feb!$A:$A,$A2,Feb!$B:$B)+SUMIF(Mar!$A:$A,$A2,Mar!$B:$B)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Autosheet in Sheets Haiku 5.5 · High

Passed14s · 0.1¢
Summary2 cells changed

B2=Jan!B2+Feb!B2+Mar!B2

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

ChatGPT in Excel GPT-6 Astra · Medium

Passed16s · 39¢
Summary2 cells changed

B2=SUM(Jan!B2,Feb!B2,Mar!B2)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Claude in Excel Haiku 5.5 · High

Passed8s · 0.4¢
Summary2 cells changed

B2=Jan!B2+Feb!B2+Mar!B2

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Claude in Sheets Haiku 5.5 · High

Passed16s · 0.3¢
Summary2 cells changed

B2=Jan!B2+Feb!B2+Mar!B2

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Autosheet in Excel GPT-6 Luna · High

Passed14s · 0.2¢
Summary2 cells changed

B2=SUM(Jan!B2,Feb!B2,Mar!B2)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Copilot in Excel Auto

Passed17s · N/A
Summary2 cells changed

B2=SUM(Jan!B2,Feb!B2,Mar!B2)

AB
1MetricTotal
2Total Sales131,000
3Total Cost93,000

ChatGPT + Drive MCP GPT-6 · Medium

Passed51s · N/A
Summary2 cells changed

B2=SUM(SUMIF(Jan!A:A,A2,Jan!B:B),SUMIF(Feb!A:A,A2,Feb!B:B),SUMIF(Mar!A:A,A2,Mar!B:B))

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

ChatGPT in Excel GPT-6 Luna · High

Passed22s · 0.4¢
Summary2 cells changed

B2=SUM(Jan!B2,Feb!B2,Mar!B2)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

Gemini in Sheets Auto

Passed58s · N/A
Summary2 cells changed

B2=Jan!B2+Feb!B2+Mar!B2

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

ChatGPT in Sheets GPT-6 Astra · Medium

Passed31s · 32¢
Summary2 cells changed

B2=SUM(Jan!B2,Feb!B2,Mar!B2)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000

ChatGPT in Sheets GPT-6 Luna · High

Passed23s · 0.3¢
Summary2 cells changed

B2=SUM(Jan!B2,Feb!B2,Mar!B2)

AB
1MetricTotal
2Total Sales131000
3Total Cost93000