All AutosheetBench tasks

Find the cells holding a value

Data operationsEasyLLM judge scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Which cells contain 4819?

Operations

Starting sheet
ABCDEF
1Case IDOwner CodeRegionManual EstimateStandard RateAdjusted Total
2OP-1001O-01North1,6001251,725
3OP-1002O-02West2,7502102,960
4OP-1003O-03Central4,8191754,994
5OP-1004O-04East9202601,180
6OP-1005O-05South1,4001901,590
7OP-1006O-06North3,1202253,345
8OP-1007O-07West2,5601502,710
9OP-1008O-08Central1,8753102,185
10OP-1009O-09East4,3202054,525
11OP-1010O-10South1,1002401,340
12OP-1011O-11North9801801,160
13OP-1012O-12West3,6502753,925
14OP-1013O-04Central2,1402602,400
15OP-1014O-07East2,8901503,040
16OP-1015O-10South730240970

Metrics

Starting sheet
ABC
1MetricComponentResult
2Open cases2448
3Average response3752
4Backlog score8442
5Escalations1320
6Coverage index220200
7Resolution points1957
8Satisfaction base7687
9Quality sample14436
10Capacity score350450
11Risk reserve415365
12Composite index2,4004,819
13Secondary component2,4192,400
14Audit points63126
15Review queue2833
16Closure base9045

Reference

Starting sheet
ABC
1Owner CodeTeamStandard Rate
2O-01Alpha125
3O-02Bravo210
4O-03Charlie175
5O-04Delta260
6O-05Echo190
7O-06Foxtrot225
8O-07Golf150
9O-08Hotel310
10O-09India205
11O-10Juliet240
12O-11Kilo180
13O-12Lima275

A passing output

Autosheet in Excel · Opus 5.5
Transcript excerptExpected answer
I'll search every sheet for 4819, checking both numbers and text. Find cells containing 4819 Two cells contain 4819: Operations!D4 has 4819 typed in as a number. It's the Manual Estimate for case OP-1003. Metrics!C12 shows 4819 as the result of a formula: =B12+B13 I checked every sheet, including Reference, for 4819 as a number, as text, or inside a formula.

How each AI configuration did

20 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • Names Operations!D4, typed in, and Metrics!C12, a formula

Passed 20

Autosheet in Excel Opus 5.5 · Medium

Passed10s · 3¢
Transcript excerptExpected answer
I'll search every sheet for 4819, checking both numbers and text. Find cells containing 4819 Two cells contain 4819: Operations!D4 has 4819 typed in as a number. It's the Manual Estimate for case OP-1003. Metrics!C12 shows 4819 as the result of a formula: =B12+B13 I checked every sheet, including Reference, for 4819 as a number, as text, or inside a formula.

Autosheet in Excel GPT-6 Astra · Low

Passed7s · 5¢
Transcript excerptExpected answer
I’ll check all three sheets for cells with the value 4819. Find cells with value 4819 appears in: Operations!D4 Metrics!C12

Autosheet in Sheets Opus 5.5 · Medium

Passed13s · 4¢
Transcript excerptExpected answer
Two cells contain 4819: - Operations!D4: typed in by hand as the Manual Estimate for case OP-1003. - Metrics!C12: the result of a formula for Composite index: Formula =B12+B13 That's 2,400 + 2,419. No other cell in Operations, Metrics or Reference has this value.

Autosheet in Excel Sonnet 5.5 · Medium

Passed4s · 1¢
Transcript excerptExpected answer
Find cells with 4819 The value 4819 appears in two cells: Operations!D4 and Metrics!C12. I searched every sheet for an exact match on the value. Cells that only show a different number, such as formula results like 4994, were not counted.

Claude in Excel Opus 5.5 · High

Passed9s · 5¢
Transcript excerptExpected answer
Two cells contain 4819. I searched every used cell on all three sheets. - Operations!D4 has 4819 typed in directly. - Metrics!C12 shows 4819 as the result of its formula =B12+B13. Reference has no cells with that value.

Autosheet in Excel Haiku 5.5 · High

Passed9s · 0.2¢
Transcript excerptExpected answer
Sheet analyzed The value 4819 appears in two cells: Operations!D4 a hard-coded "Manual Estimate" value for case OP-1003. Metrics!C12 a formula result, =B12+B13, for the "Composite index" row. I checked all three sheets, and no other cell contains 4819.

Claude in Sheets Opus 5.5 · Medium

Passed12s · 4¢
Transcript excerptExpected answer
I searched all three sheets, and two cells contain 4819: - Operations!D4 has 4819 typed in as a number. It shows as "4,819". - Metrics!C12 gets 4819 from the formula =B12+B13. If B12 or B13 changes, this cell will no longer show 4819. Nothing in the Reference sheet contains 4819. I also checked for 4819 inside longer numbers, text and formulas, and found no other matches.

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed18s · N/A
Transcript excerptExpected answer
Two cells show 4819, both formatted as 4,819: Sheet Cell Context Operations D4 Manual Estimate for case OP-1003 (O-03, Central) Operations D4 Metrics C12 Result for "Composite index" Metrics C12 I searched all three tabs (Operations, Metrics, Reference). No other cell shows 4819. I checked displayed values only, so I didn't look at whether either cell is a formula or a typed-in number.

Autosheet in Excel GPT-6.1 Sol · Medium

Passed9s · 2¢
Transcript excerptExpected answer
I’ll search all sheets for 4819, including formula results. Find cells containing 4819 appears in two cells: Operations!D4 and Metrics!C12.

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed23s · N/A
Transcript excerptExpected answer
Two cells contain 4819. I searched every used cell on all three tabs (Operations, Metrics and Reference) and didn't change anything. Tab Cell Value How it got there Operations D4 4,819 Typed in by hand. It's the manual estimate for OP-1003. D4 Metrics C12 4,819 Formula =B12+B13 (2,400 + 2,419). It's the "Composite index" result. C12 Formula =B12+B13 (2,400 + 2,419). It's the "Composite index" result. 4819 doesn't appear inside any text, ID or code. Operations!F4 uses D4 in its calculation, but it shows 4,994, so I didn't count it as a match.

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed30s · N/A
Transcript excerptExpected answer
Found 2 cells containing the exact value 4819 in your Google spreadsheet. Sheet Cell Details Operations D4 Manually entered value: 4819 Metrics C12 Formula =B12+B13 evaluates to 4819 The Reference sheet contains no matches. All three tabs were checked using Autosheet. No changes were made to the spreadsheet.

ChatGPT in Excel GPT-6 Astra · Medium

Passed10s · 32¢
Transcript excerptExpected answer
4819 appears in two cells: - (Operations!D4) - (Metrics!C12)

Claude in Excel Haiku 5.5 · High

Passed6s · 0.2¢
Transcript excerptExpected answer
The value 4819 appears in two cells in this workbook: - D4 on the Operations sheet - C12 on the Metrics sheet I scanned the used range of all three sheets (Operations, Metrics, Reference), and both matches are stored as numbers. I didn't search the two other connected files (Book1-recovered and chart_histogram_output), since your question was about this workbook. Tell me if you want me to check them too.

Autosheet in Excel GPT-6 Luna · High

Passed12s · 0.2¢
Transcript excerptExpected answer
I’ll check the active sheet and the other listed sheets for an exact match to 4819. Sheet analyzed The previews show Operations!D4, but they don’t expose every value. I’m checking the full used ranges to confirm there are no additional matches. Operations!D4 and Metrics!C12 contain 4 819.

Copilot in Excel Auto

Passed13s · N/A
Transcript excerptExpected answer
The value 4,819 appears in: Operations!D4 Metrics!C12 The value 4,819 appears in: - Operations!D4 - Metrics!C12

ChatGPT + Drive MCP GPT-6 · Medium

Passed23s · N/A
Transcript excerptExpected answer
I found 2 cells containing the value 4819 in your Google spreadsheet. Sheet Cell Column Operations D4 Manual Estimate Metrics C12 Result Both cells display 4,819 (with a thousands separator). You can open them directly: Operations!D4 Metrics!C12 The spreadsheet was not modified.

ChatGPT in Excel GPT-6 Luna · High

Passed8s · 0.3¢
Transcript excerptExpected answer
4819 appears in Operations!D4 and Metrics!C12.

Gemini in Sheets Auto

Passed19s · N/A
Transcript excerptExpected answer
There are 2 cells in your spreadsheet that contain the value 4819: Operations sheet: Cell D4 (Column: Manual Estimate) Row Details: Case ID OP-1003, Owner Code O-03, Region Central, Manual Estimate 4819, Standard Rate 175, Adjusted Total 4994. Metrics sheet: Cell C12 (Column: Result) Row Details: Metric Composite index, Component 2400, Result 4819.

ChatGPT in Sheets GPT-6 Astra · Medium

Passed11s · 25¢
Transcript excerptExpected answer
Find cells containing 4819 Two cells contain 4819: ‌ OperationsD4 ‌ MetricsC12

ChatGPT in Sheets GPT-6 Luna · High

Passed8s · 0.3¢
Transcript excerptExpected answer
Find exact 4819 matches 4819 appears in Operations!D4 and Metrics!C12.

Failed 2

Autosheet in Sheets Haiku 5.5 · High

Failed9s · 0.1¢
Transcript excerptExpected answer
D4 on the Operations sheet is the only cell that contains 4,819 (in the Manual Estimate column). I didn't check the Metrics or Reference sheets.

Why it failed: The assistant only identified Operations!D4 and failed to identify Metrics!C12.

Claude in Sheets Haiku 5.5 · High

Failed34s · 1¢
Transcript excerptExpected answer
Two cells contain 4819: - D4 on the Operations sheet, displayed as 4,819 - C12 on the Metrics sheet, displayed as 4,819 I checked the stored numeric values, displayed values, and formulas across all three sheets (Operations, Metrics, Reference). The Reference sheet has no matches. Both hits are plain numbers, not formulas. I didn't check whether either cell is part of a total or lookup.

Why it failed: The assistant failed to identify Metrics!C12 as a formula cell whose displayed value is 4819, explicitly stating instead that 'Both hits are plain numbers, not formulas.'