Use a log scale on data with zeros
ChartsHardLLM judge scoringLatest run
Passed by 4 of 12 products on their best model: Autosheet in Excel, Claude in Excel, ChatGPT in Excel and Copilot in Excel.
Prompt
Create a chart with log scale for y
Data
Starting sheet| A | B | |
|---|---|---|
| 1 | Category | Value |
| 2 | A | 0 |
| 3 | B | 1 |
| 4 | C | 5 |
| 5 | D | 50 |
| 6 | E | 500 |
| 7 | F | 5000 |
| 8 | G | 50000 |
| 9 | H | 250000 |
Chart
Starting sheet| A | |
|---|---|
| 1 |
Expected result
Pass criteria
All must be met, checked by an LLM judge.- A chart with a log y-axis
- Every non-zero point shows; zeros don't break it
- A clear title; any legend at the top
Passed 10
Autosheet in Excel Opus 5.5 · Medium
Autosheet in Excel GPT-6 Astra · Low
Autosheet in Excel Sonnet 5.5 · Medium
Claude in Excel Opus 5.5 · High
Autosheet in Excel Haiku 5.5 · High
Autosheet in Excel GPT-6.1 Sol · Medium
ChatGPT in Excel GPT-6 Astra · Medium
Claude in Sheets Haiku 5.5 · High
Autosheet in Excel GPT-6 Luna · High
Copilot in Excel Auto
Failed 12
Autosheet in Sheets Opus 5.5 · Medium
Why it failed: The y-axis does not have a log scale applied; it is a linear axis (ticks 0.00, 2.00, 4.00, 6.00) plotting helper log10 values.
Claude in Sheets Opus 5.5 · Medium
Why it failed: Zero is handled as a gap, but non-zero category B (value 1) has zero bar height and is invisible.
Claude Code + Sheets MCP Opus 5.5 · Medium
Why it failed: The y-axis is linear (intervals of 50,000 up to 250,000) rather than logarithmic, confirmed by hasLogarithmicValueAxis being false.
Claude Code + Autosheet MCP Opus 5.5 · Medium
Why it failed: The chart uses a standard linear axis plotting log-transformed helper data rather than an actual log scale axis.
ChatGPT + Autosheet MCP GPT-6 · Medium
Why it failed: Y-axis remains linear with equal increments of 50,000; native feature inventory confirms hasLogarithmicValueAxis is false.
Autosheet in Sheets Haiku 5.5 · High
Why it failed: A log scale was not applied to the y-axis; the chart features a linear axis from 0 to 300,000 and hasLogarithmicValueAxis is false.
Claude in Excel Haiku 5.5 · High
Why it failed: Category B has value 1 and is not visible against the axis baseline.
ChatGPT + Drive MCP GPT-6 · Medium
Why it failed: The y-axis does not have logarithmic scaling enabled; it is a linear axis (ticks 0, 2, 4, 6) plotting pre-computed log10 values.
ChatGPT in Excel GPT-6 Luna · High
Why it failed: Data series are not plotted and data points are absent from the chart.
Gemini in Sheets Auto
Why it failed: The y-axis is on a linear scale (0 to 300,000 in increments of 50,000), and workbook metadata confirms hasLogarithmicValueAxis is false with logBase: null.
ChatGPT in Sheets GPT-6 Astra · Medium
Why it failed: No chart was created.
ChatGPT in Sheets GPT-6 Luna · High
Why it failed: No chart was created.