All AutosheetBench tasks

Format amounts as US dollars

FormattingHardLLM judge scoringLatest run

Passed by 3 of 12 products on their best model: Autosheet in Excel, Copilot in Excel and Gemini in Sheets.

Prompt and starting spreadsheet

Task files

Prompt

Show the amounts as US dollars ($) with two decimal places, regardless of the workbook or system locale.

Starting spreadsheet

Orders
ABC
1OrderCustomerAmount
2O-1001Northwind1250
3O-1002Contoso980.5
4O-1003Fabrikam2100
5O-1004Adventure Works-175.25

A passing output

Autosheet in Excel · Opus 5.5

How each AI configuration did

5 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked by an LLM judge.
  • All amounts in C2:C5 use a US-dollar currency format rather than the workbook or system locale's default currency.
  • Currency symbols, thousands separators, and exactly two decimal places are visible.
  • The underlying numeric values remain unchanged and remain numbers rather than being rewritten as text.
  • The actual final spreadsheet images clearly show all four amounts in Orders!C2:C5 in full within column C, including the dollar symbol, all digits, the sign where applicable, and both decimal places. Fail if any target amount is replaced by hash marks (#####), clipped, truncated, abbreviated, shown in scientific notation, or otherwise not fully readable. Correct stored values or number-format codes alone do not satisfy this checkpoint.

Passed 5

Autosheet in Excel Opus 5.5 · Medium

Passed8s · 2¢

Autosheet in Excel Sonnet 5.5 · Medium

Passed4s · 0.9¢

Autosheet in Sheets Haiku 5.5 · High

Passed27s · 0.1¢

Copilot in Excel Auto

Passed19s · N/A

Gemini in Sheets Auto

Passed1m 2s · N/A

Failed 17

Autosheet in Excel GPT-6 Astra · Low

Failed8s · 16¢

Why it failed: Currency symbols, thousands separators, and decimal places are not visible because the cells display hash marks (######).

Autosheet in Sheets Opus 5.5 · Medium

Failed15s · 3¢

Why it failed: Two decimal places are not fully visible due to column truncation; C2 and C4 are cut off right after the decimal point, and C5 is cut off after the first decimal digit.

Claude in Excel Opus 5.5 · High

Failed24s · 9¢

Why it failed: The dollar format is applied, but the column is too narrow: the amounts show as ######.

Autosheet in Excel Haiku 5.5 · High

Failed5s · 0.1¢

Why it failed: In the final rendered spreadsheet image (Document 1), all four values in Orders!C2:C5 are replaced by hash marks (######) due to insufficient column width.

Claude in Sheets Opus 5.5 · Medium

Failed19s · 4¢

Why it failed: Exactly two decimal places are not fully visible in C2, C4, and C5 due to clipping at the column boundary.

Claude Code + Sheets MCP Opus 5.5 · Medium

Failed30s · N/A

Why it failed: Exactly two decimal places are not visible for all amounts; C2 and C4 only display one decimal place due to column clipping.

Autosheet in Excel GPT-6.1 Sol · Medium

Failed6s · 1¢

Why it failed: The currency symbols, thousands separators, and decimal places are not visible because the cells render as '######'.

Claude Code + Autosheet MCP Opus 5.5 · Medium

Failed42s · N/A

Why it failed: Exactly two decimal places are not visible for C2 and C4, which display as '$1,250.0' and '$2,100.0' due to clipping.

ChatGPT + Autosheet MCP GPT-6 · Medium

Failed42s · N/A

Why it failed: Exactly two decimal places are not visible for all amounts; C2 and C4 only display one decimal place due to column clipping.

ChatGPT in Excel GPT-6 Astra · Medium

Failed20s · 39¢

Why it failed: The dollar format is applied, but column C is too narrow: the amounts show as ######.

Claude in Excel Haiku 5.5 · High

Failed7s · 0.3¢

Why it failed: The number format applied used Euro ("€"#,##0.00) rather than a US-dollar currency format.

Claude in Sheets Haiku 5.5 · High

Failed20s · 0.4¢

Why it failed: In the final rendered sheet image, the amounts in C2, C4, and C5 are clipped/truncated at the right edge of column C (e.g., '$1,250.', '$2,100.', and '($175.2').

Autosheet in Excel GPT-6 Luna · High

Failed6s · 0.4¢

Why it failed: Currency symbols, thousands separators, and decimal places are not visible because the cells display hash marks (######).

ChatGPT + Drive MCP GPT-6 · Medium

Failed27s · N/A

Why it failed: Exactly two decimal places are not visible for all amounts; C2 and C4 only display one decimal place ($1,250.0 and $2,100.0) due to truncation.

ChatGPT in Excel GPT-6 Luna · High

Failed1m 40s · 3¢

Why it failed: In the actual document image, all four values in Orders!C2:C5 are replaced by hash marks ('######') because column C is too narrow.

ChatGPT in Sheets GPT-6 Astra · Medium

Failed26s · 31¢

Why it failed: Two decimal places are not visible across all cells; C2 and C4 are cut off at the decimal point ('$1,250.' and '$2,100.') and C5 is cut off after the first decimal digit ('-$175.2').

ChatGPT in Sheets GPT-6 Luna · High

Failed23s · 0.3¢

Why it failed: The actual final spreadsheet screenshot shows C2, C4, and C5 clipped by the column boundary (showing '$1,250.', '$2,100.', and '($175.2' respectively), failing readability requirements.