All AutosheetBench tasks

Fill empty discounts with zero

Data operationsEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Fill the empty cells in the Discount column with 0, and leave the discounts that already have a value unchanged.

Starting spreadsheet

Orders · rows 1–21 of 31
ABCD
1Order IDCustomerAmountDiscount
2O-1Northwind120050
3O-2Contoso850
4O-3Fabrikam1475
5O-4Adventure Works62025
6O-5Wingtip990
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger1680
12O-11Fourth Coffee925
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery1560
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel735
19O-18Nod Publishers1425
20O-19North/South Traders101055
21O-20Pacific Retail127580

A passing output

Autosheet in Excel · Opus 5.5
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • D3:D31 match the expected answers

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed8s · 2¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Autosheet in Excel GPT-6 Astra · Low

Passed9s · 7¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Autosheet in Sheets Opus 5.5 · Medium

Passed11s · 2¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Autosheet in Excel Sonnet 5.5 · Medium

Passed3s · 0.8¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Claude in Excel Opus 5.5 · High

Passed9s · 6¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Autosheet in Excel Haiku 5.5 · High

Passed5s · 0.1¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Claude in Sheets Opus 5.5 · Medium

Passed22s · 6¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed26s · N/A
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Autosheet in Excel GPT-6.1 Sol · Medium

Passed13s · 2¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed25s · N/A
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed33s · N/A
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Autosheet in Sheets Haiku 5.5 · High

Passed16s · 0.3¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

ChatGPT in Excel GPT-6 Astra · Medium

Passed13s · 36¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Claude in Excel Haiku 5.5 · High

Passed10s · 0.3¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Claude in Sheets Haiku 5.5 · High

Passed27s · 1¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Autosheet in Excel GPT-6 Luna · High

Passed14s · 0.3¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Copilot in Excel Auto

Passed17s · N/A
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

ChatGPT + Drive MCP GPT-6 · Medium

Passed42s · N/A
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

ChatGPT in Excel GPT-6 Luna · High

Passed16s · 0.4¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

Gemini in Sheets Auto

Passed58s · N/A
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

ChatGPT in Sheets GPT-6 Astra · Medium

Passed21s · 34¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015

ChatGPT in Sheets GPT-6 Luna · High

Passed16s · 0.3¢
Orders10 cells changed
ABCD
1Order IDCustomerAmountDiscount
3O-2Contoso8500
4O-3Fabrikam14750
5O-4Adventure Works62025
6O-5Wingtip9900
7O-6Litware1340100
8O-7Tailspin Toys78030
9O-8Proseware112575
10O-9Humongous Insurance54020
11O-10Consolidated Messenger16800
12O-11Fourth Coffee9250
13O-12Blue Yonder131090
14O-13Alpine Ski House69035
15O-14Coho Winery15600
16O-15Graphic Design Institute84540
17O-16Lucerne Publishing118060
18O-17Margie's Travel7350
19O-18Nod Publishers14250
20O-19North/South Traders101055
21O-20Pacific Retail127580
22O-21Research Station61015