All AutosheetBench tasks

Build a cover sheet for a project plan

Spreadsheet manipulationEasyLLM judge scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Create a cover sheet for this project plan — include formulas that pull the earliest start and latest end date from the Tasks sheet

Starting spreadsheet

Tasks
ABCDEF
1TaskOwnerStart DateEnd DateStatusPriority
2Discovery & RequirementsSarah Kim2024-01-082024-01-19CompleteHigh
3Architecture DesignDavid Patel2024-01-152024-02-02CompleteHigh
4Database SchemaRaj Nguyen2024-01-222024-02-09CompleteMedium
5API DevelopmentMarcus Osei2024-02-052024-03-15In ProgressHigh
6Frontend BuildPriya Lam2024-02-122024-03-29In ProgressHigh
7QA Test PlanningSarah Kim2024-02-192024-03-08CompleteMedium
8Integration TestingRaj Nguyen2024-03-112024-04-05Not StartedHigh
9Performance TuningDavid Patel2024-03-252024-04-12Not StartedMedium
10User Acceptance TestingMarcus Osei2024-04-082024-04-26Not StartedHigh
11Deployment & HandoffPriya Lam2024-04-222024-05-03Not StartedCritical

Expected result

How each AI configuration did

19 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • A new cover sheet with a title and date labels
  • Working formulas pull the earliest start and latest end from Tasks
  • A visibly formatted, readable project overview
  • Correct dates and metrics: no raw date serials, zero dates or ####
  • The Tasks sheet is untouched

Passed 19

Autosheet in Excel Opus 5.5 · Medium

Passed31s · 10¢

Autosheet in Sheets Opus 5.5 · Medium

Passed50s · 15¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed19s · 4¢

Claude in Excel Opus 5.5 · High

Passed54s · 37¢

Autosheet in Excel Haiku 5.5 · High

Passed25s · 0.4¢

Claude in Sheets Opus 5.5 · Medium

Passed48s · 16¢

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed1m 18s · N/A

Autosheet in Excel GPT-6.1 Sol · Medium

Passed49s · 8¢

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed1m 40s · N/A

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed1m 40s · N/A

Autosheet in Sheets Haiku 5.5 · High

Passed46s · 0.5¢

ChatGPT in Excel GPT-6 Astra · Medium

Passed56s · 70¢

Claude in Excel Haiku 5.5 · High

Passed20s · 0.6¢

Claude in Sheets Haiku 5.5 · High

Passed50s · 2¢

Copilot in Excel Auto

Passed52s · N/A

ChatGPT + Drive MCP GPT-6 · Medium

Passed42s · N/A

Gemini in Sheets Auto

Passed5m · N/A

ChatGPT in Sheets GPT-6 Astra · Medium

Passed1m 28s · 70¢

ChatGPT in Sheets GPT-6 Luna · High

Passed1m 2s · 0.7¢

Failed 3

Autosheet in Excel GPT-6 Astra · Low

Failed18s · 12¢

Why it failed: While the dates display correctly as 'Jan 8, 2024' and 'May 3, 2024', the optional summary metrics are not source-consistent: 'Total tasks' displays 11 instead of 10, resulting in an…

Autosheet in Excel GPT-6 Luna · High

Failed48s · 0.8¢

Why it failed: The dates are displayed as raw Excel serial numbers (45299 and 45415) rather than human-readable formatted dates, which is an explicit failure condition.

ChatGPT in Excel GPT-6 Luna · High

Failed1m 55s · 1¢

Why it failed: The earliest start date displays as '##########' overflow rather than the readable date '8 January 2024', which is an explicit failure condition.