All AutosheetBench tasks

Remove duplicate rows

Data operationsEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Get rid of the duplicate rows. Keep 1st occurence.

Starting spreadsheet

Sheet1
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41001AcmeWidget120
51003InitechWidget75
61002GlobexGadget90
71004UmbrellaGizmo200
81003InitechWidget75
91005HooliThing55
101006StarkDevice310
111004UmbrellaGizmo200

A passing output

Autosheet in Excel · Opus 5.5
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • A1:D11 match the expected answers

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed6s · 2¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

Autosheet in Excel GPT-6 Astra · Low

Passed5s · 4¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

Autosheet in Sheets Opus 5.5 · Medium

Passed12s · 2¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11

Autosheet in Excel Sonnet 5.5 · Medium

Passed4s · 1¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

Claude in Excel Opus 5.5 · High

Passed9s · 6¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

Autosheet in Excel Haiku 5.5 · High

Passed12s · 0.2¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

Claude in Sheets Opus 5.5 · Medium

Passed16s · 8¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed18s · N/A
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11

Autosheet in Excel GPT-6.1 Sol · Medium

Passed11s · 2¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed28s · N/A
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed53s · N/A
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11

Autosheet in Sheets Haiku 5.5 · High

Passed16s · 0.1¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11

ChatGPT in Excel GPT-6 Astra · Medium

Passed21s · 41¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

Claude in Excel Haiku 5.5 · High

Passed8s · 0.4¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

Claude in Sheets Haiku 5.5 · High

Passed22s · 0.6¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11

Autosheet in Excel GPT-6 Luna · High

Passed14s · 0.3¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

Copilot in Excel Auto

Passed14s · N/A
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

ChatGPT + Drive MCP GPT-6 · Medium

Passed33s · N/A
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11

ChatGPT in Excel GPT-6 Luna · High

Passed21s · 0.5¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310

Gemini in Sheets Auto

Passed56s · N/A
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11

ChatGPT in Sheets GPT-6 Astra · Medium

Passed31s · 38¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11

ChatGPT in Sheets GPT-6 Luna · High

Passed26s · 0.4¢
Sheet131 cells changed
ABCD
1Order IDCustomerProductAmount
21001AcmeWidget120
31002GlobexGadget90
41003InitechWidget75
51004UmbrellaGizmo200
61005HooliThing55
71006StarkDevice310
8
9
10
11