All AutosheetBench tasks

Find each company's headquarters

Bulk data processingMediumWhole-set scoringLatest run

Passed by 8 of 12 products on their best model. Failed: Claude in Excel, ChatGPT in Excel, Copilot in Excel and ChatGPT + Autosheet MCP.

Prompt and starting spreadsheet

Task files

Prompt

For each company, find the current company Headquarters as "City, State"

Starting spreadsheet

Sheet1 · rows 1–21 of 501
ABC
1SymbolNameSector
2MMM3M Co.Industrials
3ACEACE LimitedFinancials
4ABTAbbott LaboratoriesHealth Care
5ANFAbercrombie & Fitch Company AConsumer Discretionary
6ACNAccentureInformation Technology
7ADBEAdobe Systems IncInformation Technology
8AMDAdvanced Micro DevicesInformation Technology
9AESAES CorpUtilities
10AETAetna IncHealth Care
11AFLAFLAC IncFinancials
12AAgilent Technologies IncHealth Care
13GASAGL Resources Inc.Utilities
14APDAir Products & Chemicals IncMaterials
15ARGAirgas IncMaterials
16AKAMAkamai Technologies IncInformation Technology
17AAAlcoa IncMaterials
18ALXNAlexion PharmaceuticalsHealth Care
19ATIAllegheny Technologies IncMaterials
20AGNAllergan IncHealth Care
21ALLAllstate CorpFinancials

A passing output

Autosheet in Excel · Opus 5.5
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSaint Paul, MN
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OH
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareWoonsocket, RI

10 of 501 rows

How each AI configuration did

15 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

Each must be met on at least 98% of rows.
  • D2:D501: filled with text, each one concise City, State/Country location, matching each row's reviewed reference

Passed 15

Autosheet in Excel Opus 5.5 · Medium

Passed1m 32s · $2.08
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSaint Paul, MN
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OH
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareWoonsocket, RI

10 of 501 rows

Autosheet in Excel GPT-6 Astra · Low

Passed1m 41s · $2.29
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSt. Paul, Minnesota
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, Illinois
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, Ohio
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, California
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, California
9AESAES CorpUtilitiesArlington, Virginia
10AETAetna IncHealth CareHartford, Connecticut

10 of 501 rows

Autosheet in Sheets Opus 5.5 · Medium

Passed1m 44s · $2.22
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSaint Paul, MN
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OH
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareWoonsocket, RI

10 of 1,000 rows

Autosheet in Excel Sonnet 5.5 · Medium

Passed1m 4s · $1.91
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSt. Paul, MN
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OH
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareHartford, CT

10 of 501 rows

Autosheet in Excel Haiku 5.5 · High

Passed56s · $1.88
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSt. Paul, MN
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OH
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareHartford, CT

10 of 501 rows

Claude in Sheets Opus 5.5 · Medium

Passed5m 18s · $1.06
Sheet1704 cells changed
ABCDE
1SymbolNameSectorHeadquartersStatus / Notes
2MMM3M Co.IndustrialsSt. Paul, MN
3ACEACE LimitedFinancialsZurich, SwitzerlandRenamed Chubb Limited after acquiring Chubb Corp (2016)
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OH
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareHartford, CTAcquired by CVS Health (2018); last HQ shown

10 of 1,000 rows

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed4m 31s · N/A
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSaint Paul, MN
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OH
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareHartford, CT

10 of 1,000 rows

Autosheet in Excel GPT-6.1 Sol · Medium

Passed1m 9s · $2.03
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSt. Paul, Minnesota
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, Illinois
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, Ohio
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, California
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, California
9AESAES CorpUtilitiesArlington, Virginia
10AETAetna IncHealth CareWoonsocket, Rhode Island

10 of 501 rows

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed1m 59s · N/A
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSt. Paul, MN
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OH
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareHartford, CT

10 of 1,000 rows

Autosheet in Sheets Haiku 5.5 · High

Passed1m 32s · $2.46
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSaint Paul, MN
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, Ohio
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareHartford, CT

10 of 1,000 rows

Claude in Excel Haiku 5.5 · High

Passed10m · 49¢
Sheet11,503 cells changed
ABCDEF
1SymbolNameSectorHQ (City, State)Status / noteVerification
2MMM3M Co.IndustrialsSt. Paul, MNCurrentModel knowledge
3ACEACE LimitedFinancialsZurich, SwitzerlandTicker retired; now Chubb Ltd (CB)Model knowledge
4ABTAbbott LaboratoriesHealth CareAbbott Park, ILCurrentModel knowledge
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OHCurrentModel knowledge
6ACNAccentureInformation TechnologyDublin, IrelandCurrentModel knowledge
7ADBEAdobe Systems IncInformation TechnologySan Jose, CACurrentModel knowledge
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CACurrentModel knowledge
9AESAES CorpUtilitiesArlington, VACurrentModel knowledge
10AETAetna IncHealth CareWoonsocket, RIAcquired by CVS Health (2018); HQ shown is CVS Health'sModel knowledge

10 of 501 rows

Autosheet in Excel GPT-6 Luna · High

Passed1m 25s · $2.05
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSt. Paul, Minnesota
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, Illinois
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, Ohio
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, California
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, California
9AESAES CorpUtilitiesArlington, Virginia
10AETAetna IncHealth CareHartford, Connecticut

10 of 501 rows

ChatGPT + Drive MCP GPT-6 · Medium

Passed2m 11s · N/A
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsMaplewood, MN
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OH
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareHartford, CT

10 of 1,000 rows

Gemini in Sheets Auto

Passed4m 6s · N/A
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSaint Paul, Minnesota
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareNorth Chicago, Illinois
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, Ohio
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, California
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, California
9AESAES CorpUtilitiesArlington, Virginia
10AETAetna IncHealth CareHartford, Connecticut

10 of 1,000 rows

ChatGPT in Sheets GPT-6 Astra · Medium

Passed10m · $4.55
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSaint Paul, Minnesota
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, Illinois
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, Ohio
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, California
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, California
9AESAES CorpUtilitiesArlington, Virginia
10AETAetna IncHealth CareHartford, Connecticut

10 of 1,000 rows

Failed 7

Claude in Excel Opus 5.5 · High

Failed10m · 45¢
Sheet1No cell changed
ABC
1SymbolNameSector
2MMM3M Co.Industrials
3ACEACE LimitedFinancials
4ABTAbbott LaboratoriesHealth Care
5ANFAbercrombie & Fitch Com…Consumer Discretionary
6ACNAccentureInformation Technology
7ADBEAdobe Systems IncInformation Technology
8AMDAdvanced Micro DevicesInformation Technology
9AESAES CorpUtilities
10AETAetna IncHealth Care

10 of 501 rows

Why it failed: Still working at the 10-minute time limit. All cells were left empty.

ChatGPT + Autosheet MCP GPT-6 · Medium

Failed3m 13s · N/A
Sheet1501 cells changedWrong value
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSaint Paul, MN
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareAbbott Park, IL
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OH
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, CA
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CA
9AESAES CorpUtilitiesArlington, VA
10AETAetna IncHealth CareWoonsocket, RI (acquired by CVS Health)
35APCAnadarko Petroleum CorpEnergyHouston, TX (acquired by Occidental Petroleum Corporation)
40APOLApollo Group IncConsumer DiscretionaryPhoenix, AZ (acquired by a consortium including The Vistria Group and Apollo Global Management)

12 of 1,000 rows

Why it failed: 28 cells aren't a concise City, State/Country location.

  • Row 35
    Written
    Houston, TX (acquired by Occidental Petroleum Corporation)
    Expected
    One concise City, State/Country location
  • Row 40
    Written
    Phoenix, AZ (acquired by a consortium including The Vistria Group and Apollo Global Management)
    Expected
    One concise City, State/Country location

ChatGPT in Excel GPT-6 Astra · Medium

Failed10m · $2.71
Sheet11,386 cells changed
ABCDEF
1SymbolNameSectorHeadquarters (City, State)Entity / Location NoteSource
2MMM3M Co.IndustrialsSt. Paul, MinnesotaCorporate postal address; campus in Maplewood.https://investors.3m.com/financials/sec-filings/content/0000066740-26-000155/0000066740-26-000155.pdf
3ACEACE LimitedFinancialsZurich, ZurichSwitzerland; ACE Limited renamed Chubb Limited.https://www.chubb.com/content/dam/chubb-sites/chubb-com/uk-en/about-us/europe-financial-information/documents/pdf/2023-cle_se_sfcr-english.pdf
4ABTAbbott LaboratoriesHealth CareAbbott Park, IllinoisCorporate headquarters.https://www.abbott.com/en-us/about-abbott/faqs
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, OhioCorporate headquarters.https://corporate.abercrombie.com/contact-us/
6ACNAccentureInformation TechnologyDublin, County DublinIreland; global headquarters.https://raw.githubusercontent.com/datasets/s-and-p-500-companies/main/data/constituents.csv
7ADBEAdobe Systems IncInformation TechnologySan Jose, CaliforniaHeadquarters listed in current public company dataset.https://raw.githubusercontent.com/datasets/s-and-p-500-companies/main/data/constituents.csv
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, CaliforniaHeadquarters listed in current public company dataset.https://raw.githubusercontent.com/datasets/s-and-p-500-companies/main/data/constituents.csv
9AESAES CorpUtilitiesArlington, VirginiaHeadquarters listed in current public company dataset.https://raw.githubusercontent.com/datasets/s-and-p-500-companies/main/data/constituents.csv
10AETAetna IncHealth CareHartford, ConnecticutAetna operating company headquarters; CVS Health subsidiary.https://www.aetna.com/about-us/contact-aetna.html

10 of 501 rows

Why it failed: Still working at the 10-minute time limit. 39 cells were left empty.

Claude in Sheets Haiku 5.5 · High

Failed3m 24s · 5¢
Sheet1No cell changed
ABC
1SymbolNameSector
2MMM3M Co.Industrials
3ACEACE LimitedFinancials
4ABTAbbott LaboratoriesHealth Care
5ANFAbercrombie & Fitch Com…Consumer Discretionary
6ACNAccentureInformation Technology
7ADBEAdobe Systems IncInformation Technology
8AMDAdvanced Micro DevicesInformation Technology
9AESAES CorpUtilities
10AETAetna IncHealth Care

10 of 1,000 rows

Why it failed: All cells were left empty.

Copilot in Excel Auto

Failed5m 42s · N/A
Sheet1501 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSaint Paul, Minnesota
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareNorth Chicago, Illinois
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, Ohio
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, California
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, California
9AESAES CorpUtilitiesArlington, Virginia
10AETAetna IncHealth CareHartford, Connecticut

10 of 501 rows

Why it failed: 6 cells didn't match the expected value.

  • Row 54
    Written
    Broomfield, Colorado
    Expected
    Westminster, Colorado
  • Row 96
    Written
    Deerfield, Illinois
    Expected
    Northbrook, Illinois

ChatGPT in Excel GPT-6 Luna · High

Failed3m 52s · 7¢
Sheet11 cell changedWrong or missing value
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.Industrials
3ACEACE LimitedFinancials
4ABTAbbott LaboratoriesHealth Care
5ANFAbercrombie & Fitch Com…Consumer Discretionary
6ACNAccentureInformation Technology
7ADBEAdobe Systems IncInformation Technology
8AMDAdvanced Micro DevicesInformation Technology
9AESAES CorpUtilities
10AETAetna IncHealth Care
11AFLAFLAC IncFinancials
12AAgilent Technologies IncHealth Care
13GASAGL Resources Inc.Utilities
14APDAir Products & Chemical…Materials
15ARGAirgas IncMaterials

15 of 501 rows

Why it failed: All cells were left empty.

ChatGPT in Sheets GPT-6 Luna · High

Failed10m · 5¢
Sheet1317 cells changed
ABCD
1SymbolNameSectorHeadquarters
2MMM3M Co.IndustrialsSaint Paul, Minnesota
3ACEACE LimitedFinancialsZurich, Switzerland
4ABTAbbott LaboratoriesHealth CareNorth Chicago, Illinois
5ANFAbercrombie & Fitch Com…Consumer DiscretionaryNew Albany, Ohio
6ACNAccentureInformation TechnologyDublin, Ireland
7ADBEAdobe Systems IncInformation TechnologySan Jose, California
8AMDAdvanced Micro DevicesInformation TechnologySanta Clara, California
9AESAES CorpUtilitiesArlington, Virginia
10AETAetna IncHealth CareHartford, Connecticut

10 of 1,000 rows

Why it failed: Still working at the 10-minute time limit. 184 cells were left empty. 25 of 50 checked cells didn't match the expected value.

  • Row 54
    Written
    Broomfield, Colorado
    Expected
    Westminster, Colorado
  • Row 96
    Written
    Deerfield, Illinois
    Expected
    Northbrook, Illinois