Pivot revenue by region, then filter it
Pivot tablesMediumLLM judge scoringLatest run
Passed by 11 of 12 products on their best model. Failed: ChatGPT in Sheets.
Prompt
Break down our revenue by region in a pivot at I2
Now filter it to just North and East — those are our focus markets
Starting spreadsheet
Sheet1 · rows 1–21 of 42| A | B | C | D | E | F | |
|---|---|---|---|---|---|---|
| 1 | OrderID | SalesRep | Region | Product | Quantity | Revenue |
| 2 | ORD-001 | Alice Chen | North | Widget Pro | 12 | 1440 |
| 3 | ORD-002 | Bob Smith | South | Gadget Plus | 5 | 625 |
| 4 | ORD-003 | Carol White | East | Widget Pro | 8 | 960 |
| 5 | ORD-004 | David Lee | West | DataHub | 3 | 1050 |
| 6 | ORD-005 | Alice Chen | North | Gadget Plus | 10 | 1250 |
| 7 | ORD-006 | Eve Johnson | South | SyncBox | 7 | 910 |
| 8 | ORD-007 | Frank Brown | East | DataHub | 4 | 1400 |
| 9 | ORD-008 | Grace Kim | West | Widget Pro | 6 | 720 |
| 10 | ORD-009 | Bob Smith | North | SyncBox | 9 | 1170 |
| 11 | ORD-010 | Carol White | South | PanelKit | 11 | 1540 |
| 12 | ORD-011 | David Lee | East | Widget Pro | 14 | 1680 |
| 13 | ORD-012 | Eve Johnson | West | Gadget Plus | 3 | 375 |
| 14 | ORD-013 | Frank Brown | North | PanelKit | 8 | 1120 |
| 15 | ORD-014 | Grace Kim | South | DataHub | 6 | 2100 |
| 16 | ORD-015 | Alice Chen | East | SyncBox | 5 | 650 |
| 17 | ORD-016 | Bob Smith | West | Widget Pro | 10 | 1200 |
| 18 | ORD-017 | Carol White | North | Gadget Plus | 7 | 875 |
| 19 | ORD-018 | David Lee | South | PanelKit | 4 | 560 |
| 20 | ORD-019 | Eve Johnson | East | DataHub | 9 | 3150 |
| 21 | ORD-020 | Frank Brown | West | SyncBox | 2 | 260 |
Expected result
Excel and Sheets · All types · All models · All outputs
Pass criteria
All must be met, checked by an LLM judge.- A real pivot table of revenue by region
- Then filtered to North and East
- The source data is unchanged
Passed 19
Autosheet in Excel Opus 5.5 · Medium
Passed19s · 7¢
Autosheet in Excel GPT-6 Astra · Low
Passed15s · 14¢
Autosheet in Sheets Opus 5.5 · Medium
Passed20s · 6¢
Autosheet in Excel Sonnet 5.5 · Medium
Passed10s · 3¢
Claude in Excel Opus 5.5 · High
Passed16s · 18¢
Autosheet in Excel Haiku 5.5 · High
Passed16s · 0.3¢
Claude in Sheets Opus 5.5 · Medium
Passed37s · 9¢
Claude Code + Sheets MCP Opus 5.5 · Medium
Passed44s · N/A
Autosheet in Excel GPT-6.1 Sol · Medium
Passed34s · 7¢
Claude Code + Autosheet MCP Opus 5.5 · Medium
Passed1m 5s · N/A
ChatGPT + Autosheet MCP GPT-6 · Medium
Passed51s · N/A
Autosheet in Sheets Haiku 5.5 · High
Passed34s · 0.3¢
ChatGPT in Excel GPT-6 Astra · Medium
Passed32s · 80¢
Claude in Excel Haiku 5.5 · High
Passed23s · 2¢
Claude in Sheets Haiku 5.5 · High
Passed42s · 2¢
Autosheet in Excel GPT-6 Luna · High
Passed33s · 0.8¢
Copilot in Excel Auto
Passed57s · N/A
| A | B | C | D | E | F | G | H | I | J | |
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | OrderID | SalesRep | Region | Product | Quantity | Revenue | ||||
| 2 | ORD-001 | Alice Chen | North | Widget Pro | 12 | 1440 | Region | Total Revenue | ||
| 3 | ORD-002 | Bob Smith | South | Gadget Plus | 5 | 625 | East | 11,600 | ||
| 4 | ORD-003 | Carol White | East | Widget Pro | 8 | 960 | North | 12,700 | ||
| 5 | ORD-004 | David Lee | West | DataHub | 3 | 1050 | Grand Total | 24,300 | ||
| 6 | ORD-005 | Alice Chen | North | Gadget Plus | 10 | 1250 | ||||
| 7 | ORD-006 | Eve Johnson | South | SyncBox | 7 | 910 | ||||
| 8 | ORD-007 | Frank Brown | East | DataHub | 4 | 1400 | ||||
| 9 | ORD-008 | Grace Kim | West | Widget Pro | 6 | 720 | ||||
| 10 | ORD-009 | Bob Smith | North | SyncBox | 9 | 1170 | ||||
| 11 | ORD-010 | Carol White | South | PanelKit | 11 | 1540 | ||||
| 12 | ORD-011 | David Lee | East | Widget Pro | 14 | 1680 | ||||
| 13 | ORD-012 | Eve Johnson | West | Gadget Plus | 3 | 375 | ||||
| 14 | ORD-013 | Frank Brown | North | PanelKit | 8 | 1120 | ||||
| 15 | ORD-014 | Grace Kim | South | DataHub | 6 | 2100 | ||||
| 16 | ORD-015 | Alice Chen | East | SyncBox | 5 | 650 | ||||
| 17 | ORD-016 | Bob Smith | West | Widget Pro | 10 | 1200 | ||||
| 18 | ORD-017 | Carol White | North | Gadget Plus | 7 | 875 | ||||
| 19 | ORD-018 | David Lee | South | PanelKit | 4 | 560 | ||||
| 20 | ORD-019 | Eve Johnson | East | DataHub | 9 | 3150 | ||||
| 21 | ORD-020 | Frank Brown | West | SyncBox | 2 | 260 |
ChatGPT + Drive MCP GPT-6 · Medium
Passed55s · N/A
Gemini in Sheets Auto
Passed2m 1s · N/A
Failed 3
ChatGPT in Excel GPT-6 Luna · High
Failed4m 57s · 7¢
Why it failed: Still working at the 5-minute time limit. Workbook metadata confirms no native pivot table exists (pivotTableCount is 0); cells I2:J5 were populated with manual text and SUMIF formulas.
ChatGPT in Sheets GPT-6 Astra · Medium
Failed59s · 96¢
Why it failed: No pivot table: the summary is built with SUMIF formulas instead.
ChatGPT in Sheets GPT-6 Luna · High
Failed1m 2s · 1¢
Why it failed: No pivot table: the summary is built with SUMIF formulas instead.