All AutosheetBench tasks

Copy matching rows into a second table

Spreadsheet manipulationEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Copy all MT and PT timezone rows into a second table starting at A9, including the header row. Leave the original table unchanged.

Starting spreadsheet

Coverage
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13

A passing output

Autosheet in Excel · Opus 5.5
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • A1:C13 hold the expected values

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed12s · 3¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Autosheet in Excel GPT-6 Astra · Low

Passed7s · 5¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Autosheet in Sheets Opus 5.5 · Medium

Passed15s · 3¢
Coverage15 cells changed

A10=IFERROR(__xludf.DUMMYFUNCTION("FILTER(A2:C7, (B2:B7=""MT"")+(B2:B7=""PT""))"),"Marc")

ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Autosheet in Excel Sonnet 5.5 · Medium

Passed6s · 2¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Claude in Excel Opus 5.5 · High

Passed16s · 11¢
Coverage15 cells changed

A9=A1

ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Autosheet in Excel Haiku 5.5 · High

Passed8s · 0.1¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Claude in Sheets Opus 5.5 · Medium

Passed50s · 9¢
Coverage15 cells changed

A9=A1

ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed31s · N/A
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Autosheet in Excel GPT-6.1 Sol · Medium

Passed18s · 3¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed29s · N/A
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed30s · N/A
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Autosheet in Sheets Haiku 5.5 · High

Passed16s · 0.1¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

ChatGPT in Excel GPT-6 Astra · Medium

Passed18s · 37¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Claude in Excel Haiku 5.5 · High

Passed9s · 0.3¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Claude in Sheets Haiku 5.5 · High

Passed28s · 0.7¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Autosheet in Excel GPT-6 Luna · High

Passed12s · 0.3¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Copilot in Excel Auto

Passed17s · N/A
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

ChatGPT + Drive MCP GPT-6 · Medium

Passed31s · N/A
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

ChatGPT in Excel GPT-6 Luna · High

Passed13s · 0.4¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

Gemini in Sheets Auto

Passed57s · N/A
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

ChatGPT in Sheets GPT-6 Astra · Medium

Passed37s · 33¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13

ChatGPT in Sheets GPT-6 Luna · High

Passed27s · 0.3¢
Coverage15 cells changed
ABC
1RepTimezoneCapacity
2AnaET12
3MarcMT10
4PriyaPT14
5JonCT9
6SofiaMT11
7NoraPT13
8
9RepTimezoneCapacity
10MarcMT10
11PriyaPT14
12SofiaMT11
13NoraPT13