All AutosheetBench tasks

List the #DIV/0! errors

Data operationsEasyLLM judge scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Are there any #DIV/0! errors on this sheet? List the exact cells.

Starting spreadsheet

Analysis
ABCDEFGHI
1ProductSalesCalculationTotalCountryCommitted CapitalLookup ProductLookup Value
2Alpha10Germany1250000Alpha100
3Bravo48199638France2500000Bravo200
4Charlie250Germany1750000Charlie300
5Delta900#DIV/0!5000Germany500000Delta400
6Echo1200Spain900000Echo500
7Foxtrot775#DIV/0!Italy650000

A passing output

Autosheet in Excel · Opus 5.5
Transcript excerptExpected answer
I'll scan the used range for #DIV/0! errors and check whether each one is a real error or just typed text. Scan for #DIV/0! errors Yes, two cells show #DIV/0!: C5 and D7. I checked the whole used range, A1:I8. Neither is a real formula error. Both cells contain the text "#DIV/0!" typed in as a value, with no formula behind it. So there are no actual divide-by-zero errors on the sheet. Because they're text, these cells won't break other formulas the way a real error would, but they don't hold real numbers either.

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • Lists Analysis!C5 and Analysis!D7

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed9s · 3¢
Transcript excerptExpected answer
I'll scan the used range for #DIV/0! errors and check whether each one is a real error or just typed text. Scan for #DIV/0! errors Yes, two cells show #DIV/0!: C5 and D7. I checked the whole used range, A1:I8. Neither is a real formula error. Both cells contain the text "#DIV/0!" typed in as a value, with no formula behind it. So there are no actual divide-by-zero errors on the sheet. Because they're text, these cells won't break other formulas the way a real error would, but they don't hold real numbers either.

Autosheet in Excel GPT-6 Astra · Low

Passed11s · 7¢
Transcript excerptExpected answer
I’ll check Analysis for #DIV/0! errors and list their exact cell addresses. Row count: approximately 8. Find division-by-zero errors Check displayed division-by-zero values Analysis!C5 and Analysis!D7 contain #DIV/0!. Both are stored as text, not active Excel formula errors.

Autosheet in Sheets Opus 5.5 · Medium

Passed21s · 4¢
Transcript excerptExpected answer
No, there are no real #DIV/0! errors on this sheet. Two cells show "#DIV/0!", but it's typed text, not the result of a formula: - C5: plain text "#DIV/0!" (no formula) - D7: plain text "#DIV/0!" (no formula) To confirm this, I put a temporary check in K1. It showed that neither cell counts as an error, and both count as text. I then cleared K1. There is one real formula error, but it's a different type. C7 returns #N/A because its VLOOKUP can't find "Foxtrot" in the lookup table in H2:I6.

Autosheet in Excel Sonnet 5.5 · Medium

Passed4s · 1¢
Transcript excerptExpected answer
Find #DIV/0! cells Yes, the Analysis sheet has 2 #DIV/0! errors, in these cells: C5 D7 I scanned the full used range, A1:I8.

Claude in Excel Opus 5.5 · High

Passed8s · 5¢
Transcript excerptExpected answer
The sheet has no real #DIV/0! errors, but two cells show "#DIV/0!" as typed text: - C5 (Delta, Calculation column) - D7 (Foxtrot, Total column) Neither cell has a formula. Someone typed the text in, so no calculation is actually dividing by zero. That also means Excel's error checks won't flag them, and ISERROR won't catch them. If anything depends on these cells, you'll probably want to put the real formulas back. Other error: C7 has a real #N/A. The lookup can't find "Foxtrot" because the lookup list in H2:I6 stops at Echo. I checked everything in use on the Analysis sheet (A1:I8) and didn't change anything.

Autosheet in Excel Haiku 5.5 · High

Passed7s · 0.1¢
Transcript excerptExpected answer
I'll read the full sheet to check every cell for #DIV/0!, since the overview only shows a sample. Yes, two cells on the Analysis sheet show C5 D7 Neither cell has a formula, so they may be typed or pasted text rather than live errors. C7 also shows #N/A from its VLOOKUP, but that is not a.

Claude in Sheets Opus 5.5 · Medium

Passed13s · 4¢
Transcript excerptExpected answer
Two cells show #DIV/0!, C5 and D7. Neither one is a real formula error, though. Both cells hold the text "#DIV/0!" typed in as a value, so no division is happening. They won't respond to error checks like ISERROR or IFERROR the way a real error would, but formulas that point at them may still go wrong. I checked every non-empty cell in A1:I7, and no formula on the sheet returns #DIV/0!. There is one real error of another type: C7 returns #N/A. Its lookup searches for "Foxtrot", which isn't in the lookup table at H2:I6.

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed19s · N/A
Transcript excerptExpected answer
Two cells on the Analysis sheet show #DIV/0!: C5 (Delta, Calculation column) and D7 (Foxtrot, Total column). Neither is a real division error, though. Both cells contain the text "#DIV/0!" typed in as a value, with no formula behind it. So functions like ISERROR or IFERROR won't treat them as errors, and the sheet's error checking won't flag them. F7 has a real formula error, but it's #N/A, not #DIV/0!. =VLOOKUP(A7,$H$2:$I$6,2,FALSE) can't find "Foxtrot" in the lookup table in H2:I6.

Autosheet in Excel GPT-6.1 Sol · Medium

Passed17s · 2¢
Transcript excerptExpected answer
I’ll scan Analysis for division-by-zero errors and report the exact cell addresses. Row count: ~8. Find division-by-zero error cells The scan found no native Excel error values. I’ll also check for cells containing the text “#DIV/0!”, which appears in the preview. Locate displayed division-by-zero errors Two cells display #DIV/0!: Analysis!C5 and Analysis!D7. Both contain error text rather than native Excel error values.

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed30s · N/A
Transcript excerptExpected answer
Two cells on the Analysis tab (the only tab) show #DIV/0!: Analysis!C5 Analysis!D7 Neither is a real formula error. Both cells contain no formula, just the text "#DIV/0!" typed in. So nothing in the sheet is actually dividing by zero, but anything that reads those two cells will get text where it may expect a number. Separately, Analysis!C7 has a real formula error, but it's #N/A, not #DIV/0!. Its formula is =VLOOKUP(A7,$H$2:$I$6,2,FALSE), and it fails because "Foxtrot" isn't in the lookup list in H2:I6. I only read the sheet and didn't change anything.

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed32s · N/A
Transcript excerptExpected answer
No actual #DIV/0! formula errors were found in the Google spreadsheet. Autosheet checked all populated cells in the Analysis tab (A1:I7). However, two cells contain the literal text #DIV/0!: Exact cell Content Actual error? Analysis!C5 #DIV/0! No — plain text Analysis!D7 #DIV/0! No — plain text Another error found: - Analysis!C7 — #N/A (lookup for "Foxtrot" failed). Summary: 0 actual #DIV/0! errors, 2 text occurrences, and 1 #N/A error. The spreadsheet was not modified.

Autosheet in Sheets Haiku 5.5 · High

Passed10s · 0.1¢
Transcript excerptExpected answer
Yes, there are two #DIV/0! errors on the Analysis sheet: - C5 - D7 Neither cell returned a formula in the data read, so they appear to be static error text rather than live formulas. I didn't change anything. Separately, C7 shows a #N/A error from its VLOOKUP, because "Foxtrot" isn't in the lookup table at H2:H6.

ChatGPT in Excel GPT-6 Astra · Medium

Passed9s · 32¢
Transcript excerptExpected answer
I’ll check the sheet for #DIV/0! errors. Yes—there are 2 #DIV/0! errors on the Analysis sheet: - C5 (Analysis!C5) - D7 (Analysis!D7)

Claude in Excel Haiku 5.5 · High

Passed10s · 0.3¢
Transcript excerptExpected answer
Two cells on the Analysis sheet display #DIV/0!: C5 and D7. Neither is a live error. Both contain the typed text "#DIV/0!", not a formula, so they won't update if the inputs change. No formula on the sheet currently produces #DIV/0!. The sheet also has other problems you may want to check: - C7 shows #N/A from a VLOOKUP that finds no match for "Foxtrot" in H2:I6. - D3 and D5 are hardcoded numbers (9638 and 5000), not SUM formulas like the other Total cells. - D4 sums B2:B4 and D6 sums B2:B5, while D2 sums B2:C2. The ranges are inconsistent. I haven't changed anything. I can replace C5 and D7 with real formulas, restore the hardcoded totals, and fix the inconsistent ranges if you'd like. I checked A1:I8 on the Analysis sheet, which is the only sheet in this workbook.

Claude in Sheets Haiku 5.5 · High

Passed23s · 0.5¢
Transcript excerptExpected answer
Yes, two cells display #DIV/0!: C5 and D7 on the Analysis sheet. Neither is a live error. Both contain the text "#DIV/0!" typed or pasted in as a value, with no formula behind them, so they won't update if the inputs change. I haven't changed anything. If you tell me what the calculations should be, I can replace them with formulas. Two related things I noticed while checking: - C7 shows #N/A (a VLOOKUP for "Foxtrot", which isn't in the H:I lookup table), not #DIV/0!. - D3 (9638) and D5 (5000) are hardcoded numbers in the Total column, while the other totals are formulas. D3 also doesn't match its inputs: B3 + C3 is 9,648. I checked C5, D7, C7, D3 and D5 directly; the rest of A1:I7 came from a single read.

Autosheet in Excel GPT-6 Luna · High

Passed6s · 0.1¢
Transcript excerptExpected answer
I’ll check the populated range for every #DIV/0! entry and report the exact cell addresses. Yes. The #DIV/0! errors are in C5 and D7.

Copilot in Excel Auto

Passed13s · N/A
Transcript excerptExpected answer
Yes. Analysis!C5 and Analysis!D7 contain #DIV/0! errors. Yes. Analysis!C5 and Analysis!D7 contain #DIV/0! errors.

ChatGPT + Drive MCP GPT-6 · Medium

Passed15s · N/A
Transcript excerptExpected answer
Yes. I checked the Analysis tab and found 2 cells containing #DIV/0! errors. Sheet Exact cell Error Analysis C5 #DIV/0! Analysis D7 #DIV/0! Both errors indicate a division-by-zero issue. Total: 2 errors found. The spreadsheet was not modified.

ChatGPT in Excel GPT-6 Luna · High

Passed7s · 0.3¢
Transcript excerptExpected answer
Yes—there are #DIV/0! errors in Analysis!C5 and Analysis!D7.

Gemini in Sheets Auto

Passed15s · N/A
Transcript excerptExpected answer
Yes, there are 2 #DIV/0! errors on the sheet: C5 (in the Calculation column, row for Delta) D7 (in the Total column, row for Foxtrot)

ChatGPT in Sheets GPT-6 Astra · Medium

Passed11s · 25¢
Transcript excerptExpected answer
Find division errors on active sheet Yes—there are 2 #DIV/0! errors on Analysis: ‌ C5 AnalysisC5 ‌ D7 AnalysisD7

ChatGPT in Sheets GPT-6 Luna · High

Passed8s · 0.3¢
Transcript excerptExpected answer
Yes—there are two #DIV/0! errors: Analysis!C5 and Analysis!D7.