All AutosheetBench tasks

Find the top-selling product

FormulasEasyLLM judge scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Which product had the highest sales?

Starting spreadsheet

Analysis
ABCDEFGHI
1ProductSalesCalculationTotalCountryCommitted CapitalLookup ProductLookup Value
2Alpha10Germany1250000Alpha100
3Bravo48199638France2500000Bravo200
4Charlie250Germany1750000Charlie300
5Delta900#DIV/0!5000Germany500000Delta400
6Echo1200Spain900000Echo500
7Foxtrot775#DIV/0!Italy650000

A passing output

Autosheet in Excel · Opus 5.5
Transcript excerptExpected answer
I'll read the product and sales data to find the highest value. Bravo had the highest sales, at 4,819 (B3). Echo was next with 1,200.

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • Answers Bravo, with 4,819 in sales

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed5s · 2¢
Transcript excerptExpected answer
I'll read the product and sales data to find the highest value. Bravo had the highest sales, at 4,819 (B3). Echo was next with 1,200.

Autosheet in Excel GPT-6 Astra · Low

Passed5s · 4¢
Transcript excerptExpected answer
I’ll check the sales values and identify the product with the highest sales. Find highest sales product Bravo had the highest sales, with 4,819.

Autosheet in Sheets Opus 5.5 · Medium

Passed6s · 1¢
Transcript excerptExpected answer
Bravo had the highest sales, at 4,819 (B3). That's about four times the next highest, Echo at 1,200.

Autosheet in Excel Sonnet 5.5 · Medium

Passed3s · 0.8¢
Transcript excerptExpected answer
Bravo had the highest sales, at 4,819 ( B3 ). Echo was next with 1,200.

Claude in Excel Opus 5.5 · High

Passed7s · 4¢
Transcript excerptExpected answer
Bravo had the highest sales, at 4,819 (B3). Echo came second with 1,200 (B6). I used only the Sales column (B2:B7). I didn't use the Calculation and Total columns because they have problems: - C5 and D7 show #DIV/0!, and C7 shows #N/A (Foxtrot isn't in the lookup table). - D3 and D5 are typed-in numbers, not formulas. - The Total formulas add up different ranges on each row, so they can't be compared. Let me know if you want me to fix those.

Autosheet in Excel Haiku 5.5 · High

Passed5s · 0.1¢
Transcript excerptExpected answer
Bravo had the highest sales, at 4,819.

Claude in Sheets Opus 5.5 · Medium

Passed14s · 4¢
Transcript excerptExpected answer
Bravo had the highest sales at 4,819 (B3). That's about four times the next highest, Echo at 1,200 (B6). This comes from the Sales column (B2:B7), which is the only range I used. I didn't change anything. The Calculation and Total columns have problems, so I wouldn't use them for this question: - Error cells: C5 and D7 show #DIV/0!, and C7 shows #N/A because Foxtrot isn't in the lookup table. - Typed-in numbers: D3 and D5 hold plain numbers instead of formulas. - Inconsistent formulas: the formulas in column D don't follow the same pattern from row to row.

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed14s · N/A
Transcript excerptExpected answer
Bravo had the highest sales, at 4,819. That figure comes from the Sales column (column B) of the Analysis tab. Here are all six products: Product Sales Bravo 4,819 Bravo 4,819 Echo 1,200 Delta 900 Foxtrot 775 Charlie 250 Alpha 10 Bravo is also highest by the Total column (9,638), so the answer is the same either way. Some other cells on the sheet show errors: #DIV/0! in C5 and D7, and #N/A in C7. None of them are in the Sales column, so they don't change the answer.

Autosheet in Excel GPT-6.1 Sol · Medium

Passed7s · 6¢
Transcript excerptExpected answer
I’ll check the sales figures and identify the product with the highest value. Find product with highest sales Bravo had the highest sales, with 4,819.

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed31s · N/A
Transcript excerptExpected answer
Bravo had the highest sales, at 4,819. Echo came second with 1,200. The data is on the Analysis tab, the only tab in the spreadsheet. Product names are in A2:A7 and sales are in B2:B7. Each of the six products appears once, so there was nothing to add up. Rank Product Sales 1 Bravo 4,819 2 Echo 1,200 3 Delta 900 4 Foxtrot 775 5 Charlie 250 6 Alpha 10 Things to check: Bravo may be a typo. Its figure is about four times the next one, so it could be a mistyped 481 or 481.9. No units. The Sales column doesn't say whether these are units sold or revenue. Don't rank by the "Total" column (D). Its cells work differently: some add up several rows, some are typed-in numbers, and D7 shows a #DIV/0! error. The "Calculation" column (C) has errors. C5 shows #DIV/0!. C7 shows #N/A because Foxtrot isn't in the lookup list. I didn't change anything in the spreadsheet.

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed23s · N/A
Transcript excerptExpected answer
Bravo had the highest sales in the spreadsheet. Highest sales 4,819 Product: Bravo · Cell B3 The second-highest product was Echo, with 1,200 sales. I verified this using column A (Product) and column B (Sales) in the Analysis sheet. No currency or unit was specified, and the spreadsheet was not modified.

Autosheet in Sheets Haiku 5.5 · High

Passed9s · 0.1¢
Transcript excerptExpected answer
Bravo had the highest sales, at 4819 (cell Analysis!B3).

ChatGPT in Excel GPT-6 Astra · Medium

Passed8s · 34¢
Transcript excerptExpected answer
I’ll check the product sales figures in your sheet. Bravo had the highest sales, with 4,819. (Analysis!A3:B3)

Claude in Excel Haiku 5.5 · High

Passed8s · 0.2¢
Transcript excerptExpected answer
Bravo had the highest sales, at 4,819 (B3). The next highest is Echo at 1,200 (B6). The sheet has some errors that don't affect this answer but may matter elsewhere. C5 shows #DIV/0!, C7 shows #N/A, and D3 and D5 are typed numbers instead of formulas. I haven't changed anything. If you want, I can fix those or add a formula that returns the top product's name automatically.

Claude in Sheets Haiku 5.5 · High

Passed13s · 0.2¢
Transcript excerptExpected answer
Bravo had the highest sales, at 4,819 (B3). The next highest is Echo at 1,200 (B6). I didn't change anything. While reading the sheet, I noticed some issues in the Calculation and Total columns that you may want to look at. D3 and D5 are typed-in numbers rather than formulas, and C5 and D7 show #DIV/0! errors.

Autosheet in Excel GPT-6 Luna · High

Passed5s · 0.1¢
Transcript excerptExpected answer
I’m checking all product and sales entries to identify the maximum. Bravo had the highest sales, with 4,819.

Copilot in Excel Auto

Passed13s · N/A
Transcript excerptExpected answer
Bravo had the highest sales: 4,819, shown in Analysis!A3:B3. Bravo had the highest sales: 4,819, shown in Analysis!A3:B3.

ChatGPT + Drive MCP GPT-6 · Medium

Passed17s · N/A
Transcript excerptExpected answer
Bravo had the highest sales, with 4,819. This is the highest value in the Sales column (cell B3) of the Analysis sheet. View the Google Spreadsheet

ChatGPT in Excel GPT-6 Luna · High

Passed11s · 0.3¢
Transcript excerptExpected answer
Bravo had the highest sales, at 4,819. (Analysis!A3:B3)

Gemini in Sheets Auto

Passed14s · N/A
Transcript excerptExpected answer
Based on the data in your sheet, Bravo had the highest sales with 4,819. Sales by Product Bravo: 4,819 Echo: 1,200 Delta: 900 Foxtrot: 775 Charlie: 250 Alpha: 10 Assumptions: The Sales column represents the total sales volume or revenue figure for each corresponding product.

ChatGPT in Sheets GPT-6 Astra · Medium

Passed10s · 26¢
Transcript excerptExpected answer
I’ll check the sales data and identify the top product. Check product names and sales totals Bravo had the highest sales at 4,819. AnalysisA3:B3

ChatGPT in Sheets GPT-6 Luna · High

Passed9s · 0.3¢
Transcript excerptExpected answer
Bravo had the highest sales, at 4,819. AnalysisA3:B3