All AutosheetBench tasks

Move booked rows to their own tab

Spreadsheet manipulationEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Keep the Not booked rows on Bookings and move the Booked rows to a new tab named Booked. Keep one header row on both tabs.

Starting spreadsheet

Bookings · rows 1–21 of 51
ABCD
1IDCustomerStatusAmount
2B-1NorthwindBooked1200
3B-2ContosoNot booked850
4B-3FabrikamBooked1475
5B-4Adventure WorksBooked620
6B-5Tailspin ToysBooked980
7B-6ProsewareNot booked1110
8B-7Lucerne PublishingBooked1325
9B-8Alpine Ski HouseNot booked760
10B-9Blue YonderBooked1540
11B-10Coho WineryNot booked905
12B-11Consolidated MessengerBooked1180
13B-12Fourth CoffeeNot booked690
14B-13Humongous InsuranceBooked1680
15B-14LitwareNot booked1045
16B-15Margie's TravelBooked1275
17B-16Wide World ImportersNot booked830
18B-17A DatumBooked1420
19B-18Graphic Design InstituteNot booked975
20B-19School of Fine ArtBooked1095
21B-20Trey ResearchNot booked640

A passing output

Autosheet in Excel · Opus 5.5
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • A1:D24 hold the expected values
  • Booked!A1:D30 hold the expected values
  • A Booked sheet exists

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed19s · 5¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Autosheet in Excel GPT-6 Astra · Low

Passed9s · 6¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Autosheet in Sheets Opus 5.5 · Medium

Passed41s · 13¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Autosheet in Excel Sonnet 5.5 · Medium

Passed6s · 1¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Claude in Excel Opus 5.5 · High

Passed35s · 21¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Autosheet in Excel Haiku 5.5 · High

Passed16s · 0.3¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Claude in Sheets Opus 5.5 · Medium

Passed35s · 10¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed52s · N/A
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Autosheet in Excel GPT-6.1 Sol · Medium

Passed12s · 2¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed1m 32s · N/A
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed1m 13s · N/A
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Autosheet in Sheets Haiku 5.5 · High

Passed46s · 0.6¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

ChatGPT in Excel GPT-6 Astra · Medium

Passed26s · 40¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Claude in Excel Haiku 5.5 · High

Passed12s · 0.5¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Claude in Sheets Haiku 5.5 · High

Passed45s · 0.9¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Autosheet in Excel GPT-6 Luna · High

Passed21s · 0.4¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Copilot in Excel Auto

Passed27s · N/A
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

ChatGPT + Drive MCP GPT-6 · Medium

Passed1m 2s · N/A
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

ChatGPT in Excel GPT-6 Luna · High

Passed52s · 0.8¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

Gemini in Sheets Auto

Passed2m 21s · N/A
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

ChatGPT in Sheets GPT-6 Astra · Medium

Passed1m 1s · 65¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735

ChatGPT in Sheets GPT-6 Luna · High

Passed1m 25s · 0.8¢
Bookings189 cells changed · 1 other sheet changed
ABCD
1IDCustomerStatusAmount
2B-2ContosoNot booked850
3B-6ProsewareNot booked1110
4B-8Alpine Ski HouseNot booked760
5B-10Coho WineryNot booked905
6B-12Fourth CoffeeNot booked690
7B-14LitwareNot booked1045
8B-16Wide World ImportersNot booked830
9B-18Graphic Design InstituteNot booked975
10B-20Trey ResearchNot booked640
11B-22Woodgrove BankNot booked1185
12B-24The Phone CompanyNot booked715
13B-28NorthwindNot booked780
14B-29Adventure WorksNot booked1490
15B-32Lucerne PublishingNot booked845
16B-34Blue YonderNot booked920
17B-36Fourth CoffeeNot booked675
18B-37LitwareNot booked1290
19B-40A DatumNot booked805
20B-42School of Fine ArtNot booked995
21B-44Wingtip ToysNot booked735