Scorecard

71 assistants, 15 dimensions, one scale. Overall is a running mean until an assistant is fully tested.

Benchmark v0.215 tasks180 runslast test Sep 14, 2026updated Sep 14, 2026

Scored 1–10 after real use. Overall is the mean of the dimensions scored so far.

AssistantTested
Completed0None yet. An assistant lands here once every applicable dimension is scored.
In progress21Some dimensions scored. Overall is a partial mean and will move as tests land.
Muse7s9.17/159791010109
Instinct18s8.411/15810999898598
szn39s8.011/158878877101078
Pally7.613/157898887847979
Ollie7.613/159778887849879
Tomo11s7.610/1479888776N/A79
Asaply7.52/11N/A78N/AN/AN/A
Shuffle55s7.411/147.599887764N/A79
Grok Bot10s7.37/158789388
Caddy32s7.210/14887777103N/A78
Catch48s6.52/1567
Poke12s6.310/153887778582
Wajo / Fo33s6.26/15277678
Asmi6.213/156575856843879
Boba6.18/1565858647
Folk6.03/15666
Boski9s5.34/153468
tinyNature9s5.06/15456753
Brea7s5.04/153764
Town12s3.33/15622
OpenInstinct23s1.01/151
Pending23On the roster, not tested yet. No score.

9 6 2 score11s median reply not testedN/A doesn't applyHow scoring works

Latest

New tests and quotes.

AsaplyTestedSep 14, 2026
8Purchasing a product · Partial · test · Staged a Stumptown pickup at 18 W 29th and stopped before purchase with nothing charged.
AsaplyTestedSep 14, 2026
N/AResponding to emails · N/A · test · Declined email replies as outside its coffee, food, and local-spots scope.
AsaplyTestedSep 14, 2026
7Recommendation quality · Partial · test · Recommended Paper Coffee, The Coffee Shop, and Small Space Coffee near 800 6th under $20 and independent after chain noise.
AsaplyTestedSep 14, 2026
N/APhone calls · N/A · test · Declined outbound calling as outside its coffee, food, and local-spots scope.
Grok BotUse caseSep 14, 2026

@grokbot is getting more useful by the day... For example, I just had it scan my email for anything that looks like a bill. Then I gave it a CSV from my bank account and credit…

@unclebobmartinOpen on X
Grok BotUse caseSep 14, 2026

Grok Bot just spun up the army of four: Research, Options, Book, Killer. One finds ideas. One builds tickets. One watches the money. One tries to kill bad trades before I click.

@tinykenjiOpen on X
InstinctUse caseSep 14, 2026

Instinct giving contextual product updates is one of the coolest things I've ever seen > knew I was looking for US Open tickets last week > used that info to tell me next time it will be able to coordinate with my friends' agent to handle it Amazing touch @noahrshinn

@tarekarafat_Open on X
InstinctUse caseSep 14, 2026

The 11 Instinct AI @noahrshinn prompts I've found most helpful - steal than, and comment with any you recommend. 𝟭. 𝗠𝗲𝗱𝗶𝗰𝗮𝗹 𝗯𝗶𝗹𝗹𝘀. "I have [insurer]. Pull my EOBs and annual statement, reconcile every claim, flag anything denied or billed above patient responsibility, and draft the appeals. Send nothing without my approval." 𝟮. 𝗔𝗺𝗮𝘇𝗼𝗻 𝗮𝘂𝗱𝗶𝘁. "Audit my full order history for refunds I never received, price drops, and double charges. Recover what you can." 𝟯. 𝗙𝗹𝗶𝗴𝗵𝘁 𝗱𝗲𝗹𝗮𝘆 𝗺𝗼𝗻𝗲𝘆. "Flight [number] on [date] was delayed [X] hours. Check whether I'm owed compensation through the airline, travel insurance, or my credit card, and file for everyone on the booking." (This one alone was $1,200.) 𝟰. 𝗦𝘂𝗯𝘀𝗰𝗿𝗶𝗽𝘁𝗶𝗼𝗻 𝗰𝗹𝗲𝗮𝗻𝘂𝗽. "Audit my card statements for every recurring charge, check last use date, and give me a cancel/downgrade list before touching anything." 𝟱. 𝗠𝗶𝘀𝘀𝗶𝗻𝗴 𝗺𝗶𝗹𝗲𝘀. "Check my [airline] account for miles from past flights that never posted and file the claims." 𝟲. 𝗦𝗽𝗮𝗺 𝗰𝗮𝗹𝗹𝘀. "Register me on the national and state Do Not Call lists, set up every spam blocker my carrier and iPhone offer, then find my personal info on people-search and data broker sites and get it removed." 𝟳. 𝗥𝗲𝘀𝘁𝗮𝘂𝗿𝗮𝗻𝘁 𝘄𝗮𝘁𝗰𝗵. "Watch [restaurant] for a table for [party size] Friday or Saturday and book anything between 8 and 9pm." 𝟴. 𝗣𝗿𝗶𝗰𝗲 𝗵𝘂𝗻𝘁𝗶𝗻𝗴. "Find [exact product] at the cheapest delivered price to my home. Take it to the checkout screen so I can see the real total, then text me to confirm." 𝟵. 𝗕𝗶𝗹𝗹 𝗿𝗲𝘁𝗲𝗻𝘁𝗶𝗼𝗻. "Audit my [internet/wireless] bill, find the fees and rate increases, then run the retention play — threaten to cancel, push until you've got their best offer, and bring it to me before accepting. Do not cancel." 𝟭𝟬. 𝗟𝘂𝗻𝗰𝗵. "Book me 1pm at the highest-rated place within walking distance with availability, [$$-$$$]." 𝟭𝟭. 𝗨𝗻𝗰𝗹𝗮𝗶𝗺𝗲𝗱 𝗽𝗿𝗼𝗽𝗲𝗿𝘁𝘆. "Search every state's unclaimed property database for me and my family — old accounts, refunds, deposits. My prior addresses are [X, Y]. File the claims."

@gabenavarroOpen on X