All AutosheetBench tasks

Transpose a table in place

Spreadsheet manipulationEasyDeterministic scoringLatest run

Passed by all 12 products on their best model.

Prompt and starting spreadsheet

Task files

Prompt

Transpose the table in place.

Starting spreadsheet

Monthly
ABCDE
1MetricJanFebMarApr
2Revenue120135148162
3Cost76829198
4Profit44535764

A passing output

Autosheet in Excel · Opus 5.5
Monthly20 cells changed
ABCDE
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

How each AI configuration did

22 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

All must be met, checked automatically.
  • A1:D5 hold the expected values

Passed 22

Autosheet in Excel Opus 5.5 · Medium

Passed15s · 3¢
Monthly20 cells changed
ABCDE
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Autosheet in Excel GPT-6 Astra · Low

Passed6s · 4¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Autosheet in Sheets Opus 5.5 · Medium

Passed25s · 12¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Autosheet in Excel Sonnet 5.5 · Medium

Passed7s · 1¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Claude in Excel Opus 5.5 · High

Passed8s · 11¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Autosheet in Excel Haiku 5.5 · High

Passed7s · 0.1¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Claude in Sheets Opus 5.5 · Medium

Passed33s · 14¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed33s · N/A
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Autosheet in Excel GPT-6.1 Sol · Medium

Passed18s · 2¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Claude Code + Autosheet MCP Opus 5.5 · Medium

Passed1m 5s · N/A
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed45s · N/A
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Autosheet in Sheets Haiku 5.5 · High

Passed30s · 0.3¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

ChatGPT in Excel GPT-6 Astra · Medium

Passed14s · 37¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Claude in Excel Haiku 5.5 · High

Passed10s · 0.4¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Claude in Sheets Haiku 5.5 · High

Passed27s · 0.8¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Autosheet in Excel GPT-6 Luna · High

Passed10s · 0.2¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Copilot in Excel Auto

Passed21s · N/A
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

ChatGPT + Drive MCP GPT-6 · Medium

Passed35s · N/A
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

ChatGPT in Excel GPT-6 Luna · High

Passed22s · 0.4¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

Gemini in Sheets Auto

Passed1m 3s · N/A
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

ChatGPT in Sheets GPT-6 Astra · Medium

Passed23s · 32¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864

ChatGPT in Sheets GPT-6 Luna · High

Passed27s · 0.4¢
Monthly20 cells changed
ABCD
1MetricRevenueCostProfit
2Jan1207644
3Feb1358253
4Mar1489157
5Apr1629864