Group transactions by month and quarter
Pivot tablesEasyLLM judge scoringLatest run
Passed by 11 of 12 products on their best model. Failed: ChatGPT in Sheets.
Prompt
In a new
Pivotsheet atA3, group the transaction data into months and quarters in a pivot table.
Data
Starting sheet| A | B | C | D | |
|---|---|---|---|---|
| 1 | Transaction Date | Quarter | Month | Revenue |
| 2 | 2024-01-03 | Q1 | Jan | 3200 |
| 3 | 2024-02-08 | Q1 | Feb | 4100 |
| 4 | 2024-03-11 | Q1 | Mar | 3800 |
| 5 | 2024-04-05 | Q2 | Apr | 4600 |
| 6 | 2024-05-09 | Q2 | May | 5100 |
| 7 | 2024-06-12 | Q2 | Jun | 4900 |
| 8 | 2024-07-07 | Q3 | Jul | 5400 |
| 9 | 2024-08-15 | Q3 | Aug | 5600 |
| 10 | 2024-09-18 | Q3 | Sep | 6000 |
| 11 | 2024-10-10 | Q4 | Oct | 6200 |
| 12 | 2024-11-14 | Q4 | Nov | 6400 |
| 13 | 2024-12-19 | Q4 | Dec | 6800 |
| 14 | 2025-01-06 | Q1 | Jan | 3500 |
| 15 | 2025-02-13 | Q1 | Feb | 4200 |
| 16 | 2025-03-20 | Q1 | Mar | 4500 |
Pivot
Starting sheet| A | |
|---|---|
| 1 |
Expected result
Excel and Sheets · All types · All models · All outputs
Pass criteria
All must be met, checked by an LLM judge.- A real pivot table on Pivot!A3
- Revenue summed by quarter, then month
- The groups and sums match the data
Passed 20
Autosheet in Excel Opus 5.5 · Medium
Passed13s · 5¢
Autosheet in Excel GPT-6 Astra · Low
Passed12s · 10¢
Autosheet in Sheets Opus 5.5 · Medium
Passed38s · 10¢
Autosheet in Excel Sonnet 5.5 · Medium
Passed8s · 2¢
Claude in Excel Opus 5.5 · High
Passed39s · 27¢
Autosheet in Excel Haiku 5.5 · High
Passed38s · 0.6¢
Claude in Sheets Opus 5.5 · Medium
Passed59s · 22¢
Claude Code + Sheets MCP Opus 5.5 · Medium
Passed1m 13s · N/A
Autosheet in Excel GPT-6.1 Sol · Medium
Passed23s · 4¢
Claude Code + Autosheet MCP Opus 5.5 · Medium
Passed54s · N/A
ChatGPT + Autosheet MCP GPT-6 · Medium
Passed1m 8s · N/A
Autosheet in Sheets Haiku 5.5 · High
Passed50s · 0.6¢
ChatGPT in Excel GPT-6 Astra · Medium
Passed45s · 64¢
Claude in Excel Haiku 5.5 · High
Passed28s · 0.7¢
Claude in Sheets Haiku 5.5 · High
Passed56s · 2¢
Autosheet in Excel GPT-6 Luna · High
Passed27s · 0.5¢
Copilot in Excel Auto
Passed46s · N/A
ChatGPT + Drive MCP GPT-6 · Medium
Passed33s · N/A
ChatGPT in Excel GPT-6 Luna · High
Passed1m 11s · 0.9¢
Gemini in Sheets Auto
Passed1m 34s · N/A
Failed 2
ChatGPT in Sheets GPT-6 Astra · Medium
Failed1m 1s · 60¢
Why it failed: No real pivot table was created.
ChatGPT in Sheets GPT-6 Luna · High
Failed1m 50s · 0.9¢
Why it failed: No real pivot table was created; a formula-driven summary table was created instead.