All AutosheetBench tasks

Add a cover page to an annual report

Spreadsheet manipulationMediumLLM judge scoringLatest run

Passed by 9 of 12 products on their best model. Failed: ChatGPT + Drive MCP, Gemini in Sheets and ChatGPT in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Add a professional cover page for this annual report

Add a confidentiality notice at the bottom and mark it as Draft

Starting spreadsheet

Financials
ABCD
1Metric20242025YoY Change
2Revenue14250000016830000018.1%
3Gross Profit684000008320000021.6%
4Operating Income312000003970000027.2%
5Net Income221000002840000028.5%
6EPS4.425.6828.5%
7Headcount1240138711.9%
8CapEx186000002140000015.1%
9R&D Spend243000003010000023.9%

Expected result

How each AI configuration did

17 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • A separate annual-report cover with a title and report details
  • A visibly formatted cover with clear typography and spacing
  • A readable Draft label and confidentiality notice at the bottom
  • Readable text and metrics: no ####, clipping, overlap or invisible content
  • The Financials sheet is untouched

Passed 17

Autosheet in Excel Opus 5.5 · Medium

Passed1m 56s · 41¢

Autosheet in Excel GPT-6 Astra · Low

Passed28s · 16¢

Autosheet in Sheets Opus 5.5 · Medium

Passed1m 30s · 31¢

Claude in Excel Opus 5.5 · High

Passed1m 9s · 32¢

Autosheet in Excel Haiku 5.5 · High

Passed31s · 0.6¢

Claude in Sheets Opus 5.5 · Medium

Passed1m 7s · 18¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed2m 30s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed50s · 14¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed3m 39s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed2m 37s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed1m 23s · 1¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed1m 2s · $1.22

Claude in Excel Haiku 5.5 · High

Passed34s · 1¢

Claude in Sheets Haiku 5.5 · High

Passed1m 42s · 3¢

Copilot in Excel Auto

Passed1m 9s · N/A

ChatGPT in Excel GPT-6 Luna · High

Passed3m 8s · 2¢

ChatGPT in Sheets GPT-6 Luna · High

Passed2m 51s · 1¢

Failed 5

Autosheet in Excel Sonnet 5.5 · Medium

Failed26s · 6¢

Why it failed: Important content authored on the cover—specifically cell B4 ('[Company Name]') and cell B6 ('Fiscal Year Ended December 31, 2025')—is completely invisible/unreadable in the final rendered…

Autosheet in Excel GPT-6 Luna · High

Failed40s · 1¢

Why it failed: The cover sheet fails to function as a professional presentation cover because text is severely clipped, columns are unformatted/unwidened, and metric values display as '###'.

ChatGPT + Drive MCP GPT-6 · Medium

Failed1m 10s · N/A

Why it failed: The cover sheet lacks a prominent readable title; the header area displays blank white horizontal bars obscuring the title and year.

Gemini in Sheets Auto

Failed5m · N/A

Why it failed: Still working at the 5-minute time limit. Neither a DRAFT label nor a confidentiality notice ('confidential' or 'internal use only') was included on the cover sheet; the status field reads 'Audited Final'.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed1m 46s · $1.24

Why it failed: The cover sheet does not visibly function as a professional annual-report cover because the title header section is collapsed into an unreadable narrow sliver with clipped text.