Pivot revenue, cost and margin
Pivot tablesMediumLLM judge scoringLatest run
Passed by 8 of 12 products on their best model. Failed: Autosheet in Excel, Claude in Excel, ChatGPT in Excel and ChatGPT in Sheets.
Prompt
In a new
Pivotsheet atA3, create a pivot table with revenue, cost, and profit margin percentage.
Data
Starting sheet| A | B | C | |
|---|---|---|---|
| 1 | Product | Revenue | Cost |
| 2 | Alpha | 18200 | 12400 |
| 3 | Beta | 13400 | 9100 |
| 4 | Gamma | 9900 | 6200 |
| 5 | Delta | 22100 | 14600 |
| 6 | Epsilon | 11800 | 7800 |
Pivot
Starting sheet| A | |
|---|---|
| 1 |
Expected result
Pass criteria
All must be met, checked by an LLM judge.- A real pivot table on Pivot!A3
- Products as rows, revenue and cost summed
- Margin % as a field inside the pivot
Passed 11
Autosheet in Sheets Opus 5.5 · Medium
Autosheet in Excel Haiku 5.5 · High
Claude in Sheets Opus 5.5 · Medium
Claude Code + Sheets MCP Opus 5.5 · Medium
Claude Code + Autosheet MCP Opus 5.5 · Medium
ChatGPT + Autosheet MCP GPT-6 · Medium
Autosheet in Sheets Haiku 5.5 · High
Copilot in Excel Auto
ChatGPT + Drive MCP GPT-6 · Medium
ChatGPT in Excel GPT-6 Luna · High
Gemini in Sheets Auto
Failed 11
Autosheet in Excel Opus 5.5 · Medium
Why it failed: Profit margin percentage is an external worksheet formula column outside the pivot definition.
Autosheet in Excel GPT-6 Astra · Low
Why it failed: Profit margin percentage was placed in column D outside the pivot table using worksheet formulas (=IFERROR((B4-C4)/B4,0)) instead of being included as a value field inside the pivot table.
Autosheet in Excel Sonnet 5.5 · Medium
Why it failed: Profit margin percentage was not included as a value field inside the pivot table; it was placed in column E outside the pivot range (A3:D9) using regular worksheet formulas.
Claude in Excel Opus 5.5 · High
Why it failed: The margin sits in cells beside the pivot, computed with GETPIVOTDATA formulas, not as a field of the pivot.
Autosheet in Excel GPT-6.1 Sol · Medium
Why it failed: Profit margin percentage was placed in column D outside the pivot table using worksheet formulas (=IFERROR((B4-C4)/B4,0)) rather than as a calculated field inside the pivot table.
ChatGPT in Excel GPT-6 Astra · Medium
Why it failed: The margin sits in formulas beside the pivot, in column D, not as a field of the pivot.
Claude in Excel Haiku 5.5 · High
Why it failed: Profit margin percentage was written as worksheet formulas in column D (D3:D9) outside the pivot table rather than being included as a value field inside the pivot table.
Claude in Sheets Haiku 5.5 · High
Why it failed: Profit margin percentage was added as external worksheet formulas in column D (cells D4:D9) outside the pivot table rather than as a value field inside the pivot itself.
Autosheet in Excel GPT-6 Luna · High
Why it failed: Profit margin percentage was placed in column D outside the pivot table as regular worksheet formulas, directly violating the requirement that it be included as a value field inside the…
ChatGPT in Sheets GPT-6 Astra · Medium
Why it failed: A real pivot table was not created; a manual summary table using SUMIF formulas was built instead.
ChatGPT in Sheets GPT-6 Luna · High
Why it failed: No pivot table: the summary is built with SUMIF formulas instead.