Pivot hotel rates and nights by room
Pivot tablesEasyLLM judge scoringLatest run
Passed by 11 of 12 products on their best model. Failed: ChatGPT in Sheets.
Prompt
I need to see average nightly rate and total nights by room type in a pivot table. Anchor it in J2
Starting spreadsheet
Sheet1 · rows 1–21 of 32| A | B | C | D | E | F | G | |
|---|---|---|---|---|---|---|---|
| 1 | BookingID | GuestName | RoomType | CheckIn | CheckOut | NightlyRate | Nights |
| 2 | BKG-001 | Sarah Connor | Standard | 2024-01-05 | 2024-01-07 | 120 | 2 |
| 3 | BKG-002 | John Carter | Deluxe | 2024-01-06 | 2024-01-10 | 185 | 4 |
| 4 | BKG-003 | Emily Clarke | Suite | 2024-01-08 | 2024-01-11 | 320 | 3 |
| 5 | BKG-004 | Michael Fox | Penthouse | 2024-01-10 | 2024-01-14 | 550 | 4 |
| 6 | BKG-005 | Rachel Adams | Standard | 2024-01-12 | 2024-01-13 | 120 | 1 |
| 7 | BKG-006 | Tom Hughes | Deluxe | 2024-01-14 | 2024-01-17 | 195 | 3 |
| 8 | BKG-007 | Linda Park | Suite | 2024-01-15 | 2024-01-20 | 340 | 5 |
| 9 | BKG-008 | Kevin Moore | Standard | 2024-01-18 | 2024-01-21 | 115 | 3 |
| 10 | BKG-009 | Amy Scott | Penthouse | 2024-01-20 | 2024-01-23 | 580 | 3 |
| 11 | BKG-010 | Brian Walsh | Deluxe | 2024-01-22 | 2024-01-25 | 185 | 3 |
| 12 | BKG-011 | Carla Diaz | Standard | 2024-01-24 | 2024-01-26 | 120 | 2 |
| 13 | BKG-012 | David Kim | Suite | 2024-01-25 | 2024-01-29 | 310 | 4 |
| 14 | BKG-013 | Nancy Lee | Deluxe | 2024-01-27 | 2024-01-30 | 190 | 3 |
| 15 | BKG-014 | Oscar Ruiz | Standard | 2024-01-28 | 2024-02-01 | 125 | 4 |
| 16 | BKG-015 | Patricia Chen | Penthouse | 2024-01-30 | 2024-02-03 | 560 | 4 |
| 17 | BKG-016 | Quentin Bell | Suite | 2024-02-02 | 2024-02-05 | 325 | 3 |
| 18 | BKG-017 | Rebecca Young | Standard | 2024-02-04 | 2024-02-06 | 115 | 2 |
| 19 | BKG-018 | Steven Hill | Deluxe | 2024-02-06 | 2024-02-09 | 180 | 3 |
| 20 | BKG-019 | Tanya Brooks | Suite | 2024-02-08 | 2024-02-13 | 330 | 5 |
| 21 | BKG-020 | Ulrich Bauer | Standard | 2024-02-10 | 2024-02-14 | 120 | 4 |
Expected result
Excel and Sheets · All types · All models · All outputs
Pass criteria
All must be met, checked by an LLM judge.- A real pivot table of the bookings
- Rows by room type
- Average nightly rate and total nights
- The source data is unchanged
Passed 20
Autosheet in Excel Opus 5.5 · Medium
Passed15s · 5¢
Autosheet in Excel GPT-6 Astra · Low
Passed10s · 8¢
Autosheet in Sheets Opus 5.5 · Medium
Passed17s · 4¢
Autosheet in Excel Sonnet 5.5 · Medium
Passed11s · 3¢
Claude in Excel Opus 5.5 · High
Passed37s · 29¢
Autosheet in Excel Haiku 5.5 · High
Passed17s · 0.3¢
Claude in Sheets Opus 5.5 · Medium
Passed19s · 4¢
Claude Code + Sheets MCP Opus 5.5 · Medium
Passed39s · N/A
Autosheet in Excel GPT-6.1 Sol · Medium
Passed22s · 4¢
Claude Code + Autosheet MCP Opus 5.5 · Medium
Passed32s · N/A
ChatGPT + Autosheet MCP GPT-6 · Medium
Passed31s · N/A
Autosheet in Sheets Haiku 5.5 · High
Passed19s · 0.1¢
ChatGPT in Excel GPT-6 Astra · Medium
Passed17s · 45¢
Claude in Excel Haiku 5.5 · High
Passed28s · 2¢
Claude in Sheets Haiku 5.5 · High
Passed42s · 2¢
Autosheet in Excel GPT-6 Luna · High
Passed22s · 0.4¢
Copilot in Excel Auto
Passed39s · N/A
ChatGPT + Drive MCP GPT-6 · Medium
Passed29s · N/A
ChatGPT in Excel GPT-6 Luna · High
Passed1m 37s · 1¢
Gemini in Sheets Auto
Passed1m 4s · N/A
Failed 2
ChatGPT in Sheets GPT-6 Astra · Medium
Failed41s · 50¢
Why it failed: No native pivot table object was created in the workbook; the agent created a formula-based summary table.
ChatGPT in Sheets GPT-6 Luna · High
Failed55s · 0.6¢
Why it failed: No pivot table: the summary is built with AVERAGEIF and SUMIF formulas instead.