All AutosheetBench tasks

Normalize ticket priorities

Bulk data processingMediumWhole-set scoringLatest run

Passed by 9 of 12 products on their best model. Failed: Autosheet in Excel, Autosheet in Sheets and Claude Code + Autosheet MCP.

Prompt and starting spreadsheet

Task files

Prompt

Create a new priority_clean in column E. Priority should be one of Low, Medium, High, Urgent.

Starting spreadsheet

Sheet1 · rows 1–21 of 1,001
ABCD
1idpriority_rawstatus_rawdate_raw
218285highPending,2026-08-28
318190HIGHAwaiting action08/28/2026
418249p2In queue28.08.2026
518234High priorityAwaiting resolution.Aug 28, 2026
618263medIn progress2026-08-28
718284LOWClosed08/28/2026
818247p2Successfully concluded.28.08.2026
918261High priorityIn review.Aug 28, 2026
1018262medAwaiting resolution2026-08-28
1118245MEDIUMReferred upward.08/28/2026
1218260p3In progress28.08.2026
1318283Low priorityNo further action requiredAug 28, 2026
1418238highAwaiting resolution,2026-08-28
1518281LOWIn progress.08/28/2026
1618280p2Closed28.08.2026
1718282Low priorityAwaiting resolutionAug 28, 2026
1818203lowYet to commence,2026-08-27
1918204LOWClosed.08/27/2026
2018140p3Resolved27.08.2026
2118138Low priorityIn progressAug 27, 2026

A passing output

Claude in Excel · Opus 5.5
Sheet11,001 cells changed

E2=IF(OR(LOWER(TRIM(B2))={"p0","urgent","critical"}),"Urgent",IF(OR(LOWER(TRIM(B2))="p1",LEFT(LOWER(TRIM(B2)),4)="high"),"High",IF(OR(LOWER(TRIM(B2))="p2",LEFT(LOWER(TRIM(B2)),3)="med"),"Medium",IF(OR(LOWER(TRIM(B2))="p3",LEFT(LOWER(TRIM(B2)),3)="low"),"Low","Unmapped"))))

ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

How each AI configuration did

13 of 22 passRun files
Excel and Sheets · All types · All models · All outputs

Pass criteria

Each must be met on at least 98% of rows.
  • E2:E1001: filled with text, matching the expected answers

Passed 13

Claude in Excel Opus 5.5 · High

Passed36s · 22¢
Sheet11,001 cells changed

E2=IF(OR(LOWER(TRIM(B2))={"p0","urgent","critical"}),"Urgent",IF(OR(LOWER(TRIM(B2))="p1",LEFT(LOWER(TRIM(B2)),4)="high"),"High",IF(OR(LOWER(TRIM(B2))="p2",LEFT(LOWER(TRIM(B2)),3)="med"),"Medium",IF(OR(LOWER(TRIM(B2))="p3",LEFT(LOWER(TRIM(B2)),3)="low"),"Low","Unmapped"))))

ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

Claude in Sheets Opus 5.5 · Medium

Passed26s · 10¢
Sheet11,001 cells changed

E2=IFERROR(__xludf.DUMMYFUNCTION("ARRAYFORMULA(IF(B2:B1001="""",,IFERROR(VLOOKUP(TRIM(REGEXREPLACE(LOWER(B2:B1001),""priority"","""")),{""p0"",""Urgent"";""urgent"",""Urgent"";""critical"",""Urgent"";""p1"",""High"";""high"",""High"";""p2"",""Medium"";""medium"",""Medium"";""med"",""Mediu"&"m"";""p3"",""Low"";""low"",""Low""},2,FALSE),""UNMAPPED"")))"),"High")

ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

Claude Code + Sheets MCP Opus 5.5 · Medium

Passed37s · N/A
Sheet11,001 cells changed

E2=IFERROR(__xludf.DUMMYFUNCTION("ARRAYFORMULA(IF(B2:B1001="""","""",IFNA(VLOOKUP(LOWER(TRIM(REGEXREPLACE(B2:B1001,""(?i)\s*priority\s*$"",""""))),{""low"",""Low"";""p3"",""Low"";""med"",""Medium"";""medium"",""Medium"";""p2"",""Medium"";""high"",""High"";""p1"",""High"";""urgent"",""Urge"&"nt"";""critical"",""Urgent"";""p0"",""Urgent""},2,FALSE),""Unmapped"")))"),"High")

ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

ChatGPT + Autosheet MCP GPT-6 · Medium

Passed2m 21s · N/A
Sheet11,001 cells changed
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

ChatGPT in Excel GPT-6 Astra · Medium

Passed24s · 42¢
Sheet11,001 cells changed

E2=SWITCH(LOWER(TRIM(B2)),"low","Low","low priority","Low","p3","Low","med","Medium","medium","Medium","medium priority","Medium","p2","Medium","high","High","high priority","High","p1","High","critical","Urgent","urgent","Urgent","p0","Urgent")

ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

Claude in Excel Haiku 5.5 · High

Passed43s · 2¢
Sheet11,029 cells changed

E2=IFERROR(INDEX($H$2:$H$14,MATCH(TRIM(B2),$G$2:$G$14,0)),"Unmapped")

ABCDEFGH
1idpriority_rawstatus_rawdate_rawpriority_cleanpriority_rawpriority_clean
218285highPending,2026-08-28HighhighHigh
318190HIGHAwaiting action08/28/2026Highhigh priorityHigh
418249p2In queue28.08.2026Mediump1High
518234High priorityAwaiting resolution.Aug 28, 2026HighmedMedium
618263medIn progress2026-08-28Mediummedium priorityMedium
718284LOWClosed08/28/2026Lowp2Medium
818247p2Successfully concluded.28.08.2026MediumlowLow
918261High priorityIn review.Aug 28, 2026Highlow priorityLow
1018262medAwaiting resolution2026-08-28Mediump3Low

10 of 1,001 rows

Claude in Sheets Haiku 5.5 · High

Passed35s · 2¢
Sheet11,029 cells changed

E2=IFERROR(XLOOKUP(TRIM(B2),$G$2:$G$14,$H$2:$H$14),"Unmapped")

ABCDEFGH
1idpriority_rawstatus_rawdate_rawpriority_cleanpriority_raw (lookup key)priority_clean
218285highPending,2026-08-28HighlowLow
318190HIGHAwaiting action08/28/2026Highlow priorityLow
418249p2In queue28.08.2026Mediump3Low
518234High priorityAwaiting resolution.Aug 28, 2026HighmedMedium
618263medIn progress2026-08-28MediummediumMedium
718284LOWClosed08/28/2026Lowmedium priorityMedium
818247p2Successfully concluded.28.08.2026Mediump2Medium
918261High priorityIn review.Aug 28, 2026HighhighHigh
1018262medAwaiting resolution2026-08-28Mediumhigh priorityHigh

10 of 1,001 rows

Copilot in Excel Auto

Passed52s · N/A
Sheet11,001 cells changed

E2=SWITCH(LOWER(TRIM(B2)),"low","Low","low priority","Low","p3","Low","medium","Medium","medium priority","Medium","med","Medium","p2","Medium","high","High","high priority","High","p1","High","urgent","Urgent","critical","Urgent","p0","Urgent","")

ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

ChatGPT + Drive MCP GPT-6 · Medium

Passed41s · N/A
Sheet11,001 cells changed
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

ChatGPT in Excel GPT-6 Luna · High

Passed43s · 0.8¢
Sheet11,001 cells changed

E2=IF(OR(LOWER(TRIM(B2))="urgent",LOWER(TRIM(B2))="critical",LOWER(TRIM(B2))="p0"),"Urgent",IF(OR(LOWER(TRIM(B2))="high",LOWER(TRIM(B2))="high priority",LOWER(TRIM(B2))="p1"),"High",IF(OR(LOWER(TRIM(B2))="medium",LOWER(TRIM(B2))="med",LOWER(TRIM(B2))="medium priority",LOWER(TRIM(B2))="p2"),"Medium",IF(OR(LOWER(TRIM(B2))="low",LOWER(TRIM(B2))="low priority",LOWER(TRIM(B2))="p3"),"Low",""))))

ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

Gemini in Sheets Auto

Passed2m 58s · N/A
Sheet11,001 cells changed

E2=SWITCH(LOWER(TRIM(B2)),"p0","Urgent","urgent","Urgent","critical","Urgent","p1","High","high","High","high priority","High","p2","Medium","med","Medium","medium","Medium","medium priority","Medium","p3","Low","low","Low","low priority","Low","")

ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

ChatGPT in Sheets GPT-6 Astra · Medium

Passed1m 1s · 55¢
Sheet11,001 cells changed

E2=LET(p,LOWER(TRIM(SUBSTITUTE(SUBSTITUTE(SUBSTITUTE(CLEAN(B2),CHAR(160)," "),".",""),",",""))),SWITCH(p,"low","Low","low priority","Low","p3","Low","p4","Low","medium","Medium","med","Medium","medium priority","Medium","p2","Medium","high","High","high priority","High","p1","High","urgent","Urgent","urgent priority","Urgent","critical","Urgent","p0","Urgent",""))

ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

ChatGPT in Sheets GPT-6 Luna · High

Passed46s · 0.8¢
Sheet11,001 cells changed

E2=SWITCH(LOWER(TRIM(B2)),"urgent","Urgent","critical","Urgent","p0","Urgent","high","High","high priority","High","p1","High","medium","Medium","med","Medium","medium priority","Medium","p2","Medium","low","Low","low priority","Low","p3","Low","")

ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026Medium
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026Medium
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium

10 of 1,001 rows

Failed 9

Autosheet in Excel Opus 5.5 · Medium

Failed1m 6s · 20¢
Sheet11,001 cells changedWrong value
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026High
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026High
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium
1218260p3In progress28.08.2026Medium
1618280p2Closed28.08.2026High
2018140p3Resolved27.08.2026Medium
2418216p1Resolved27.08.2026Urgent
2818085p2In review27.08.2026High

15 of 1,001 rows

Why it failed: 242 cells are wrong: it read each p-code one level too high. p0 is Urgent, p1 High, p2 Medium and p3 Low.

Autosheet in Excel GPT-6 Astra · Low

Failed1m 4s · 21¢
Sheet11,001 cells changedWrong value
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026High
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026High
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium
1218260p3In progress28.08.2026Medium
1618280p2Closed28.08.2026High
2018140p3Resolved27.08.2026Medium
2418216p1Resolved27.08.2026Urgent
2818085p2In review27.08.2026High

15 of 1,001 rows

Why it failed: 242 cells are wrong: it read each p-code one level too high. p0 is Urgent, p1 High, p2 Medium and p3 Low.

Autosheet in Sheets Opus 5.5 · Medium

Failed1m 32s · 14¢
Sheet11,001 cells changedWrong value
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026High
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026High
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium
1218260p3In progress28.08.2026Medium
1618280p2Closed28.08.2026High
2018140p3Resolved27.08.2026Medium
2418216p1Resolved27.08.2026Urgent
2818085p2In review27.08.2026High

15 of 1,001 rows

Why it failed: 242 cells are wrong: it read each p-code one level too high. p0 is Urgent, p1 High, p2 Medium and p3 Low.

Autosheet in Excel Sonnet 5.5 · Medium

Failed54s · 11¢
Sheet11,001 cells changedWrong value
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026High
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026High
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium
1218260p3In progress28.08.2026Medium
1618280p2Closed28.08.2026High
2018140p3Resolved27.08.2026Medium
2418216p1Resolved27.08.2026Urgent
2818085p2In review27.08.2026High

15 of 1,001 rows

Why it failed: 243 cells are wrong: it read each p-code one level too high. p0 is Urgent, p1 High, p2 Medium and p3 Low.

Autosheet in Excel Haiku 5.5 · High

Failed1m 1s · 10¢
Sheet11,001 cells changedWrong value
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026High
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026High
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium
1218260p3In progress28.08.2026Medium
1618280p2Closed28.08.2026High
2018140p3Resolved27.08.2026Medium
2418216p1Resolved27.08.2026Urgent
2818085p2In review27.08.2026High

15 of 1,001 rows

Why it failed: 242 cells are wrong: it read each p-code one level too high. p0 is Urgent, p1 High, p2 Medium and p3 Low.

Autosheet in Excel GPT-6.1 Sol · Medium

Failed1m 3s · 13¢
Sheet11,001 cells changedWrong value
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026High
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026High
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium
1218260p3In progress28.08.2026Medium
1618280p2Closed28.08.2026High
2018140p3Resolved27.08.2026Medium
2418216p1Resolved27.08.2026Urgent
2818085p2In review27.08.2026High

15 of 1,001 rows

Why it failed: 242 cells are wrong: it read each p-code one level too high. p0 is Urgent, p1 High, p2 Medium and p3 Low.

Claude Code + Autosheet MCP Opus 5.5 · Medium

Failed2m 24s · N/A
Sheet11,001 cells changedWrong value
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026High
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026High
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium
1218260p3In progress28.08.2026Medium
1618280p2Closed28.08.2026High
2018140p3Resolved27.08.2026Medium
2418216p1Resolved27.08.2026Urgent
2818085p2In review27.08.2026High

15 of 1,001 rows

Why it failed: 242 cells are wrong: it read each p-code one level too high. p0 is Urgent, p1 High, p2 Medium and p3 Low.

Autosheet in Sheets Haiku 5.5 · High

Failed1m 36s · 9¢
Sheet11,001 cells changedWrong value
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026High
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026High
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium
1218260p3In progress28.08.2026Medium
1618280p2Closed28.08.2026High
2018140p3Resolved27.08.2026Medium
2418216p1Resolved27.08.2026Urgent
2818085p2In review27.08.2026High

15 of 1,001 rows

Why it failed: 242 cells are wrong: it read each p-code one level too high. p0 is Urgent, p1 High, p2 Medium and p3 Low.

Autosheet in Excel GPT-6 Luna · High

Failed1m 7s · 19¢
Sheet11,001 cells changedWrong value
ABCDE
1idpriority_rawstatus_rawdate_rawpriority_clean
218285highPending,2026-08-28High
318190HIGHAwaiting action08/28/2026High
418249p2In queue28.08.2026High
518234High priorityAwaiting resolution.Aug 28, 2026High
618263medIn progress2026-08-28Medium
718284LOWClosed08/28/2026Low
818247p2Successfully concluded.28.08.2026High
918261High priorityIn review.Aug 28, 2026High
1018262medAwaiting resolution2026-08-28Medium
1218260p3In progress28.08.2026Medium
1618280p2Closed28.08.2026High
2018140p3Resolved27.08.2026Medium
2418216p1Resolved27.08.2026Urgent
2818085p2In review27.08.2026High

15 of 1,001 rows

Why it failed: 248 cells are wrong, 242 of them a p-code read one level too high. p0 is Urgent, p1 High, p2 Medium and p3 Low.