David Pawlan
Runs the benchmark
Tests the assistants from his own accounts, sets every score, and writes the tasks. The runs here are his actual threads: the flights booked, the flowers ordered, the routines that never fired.
About
A free scorecard for the assistants you can text.
Every assistant promises to run your life by text, and none of them can be compared, because everyone demos a different task. So we wrote the tasks down, published them, and run the same ones against every product we can get into.
Every score comes from a real conversation on a real account, and links to its own evidence. Untested means blank, never a guess.
Free, and staying that way
This is free and it is for the people using these products, not the people selling them. No sponsors, no paid placements, no affiliate links, no pay-to-be-tested. Not now and not later. Vendors can request a test and submit a use case like anyone else, and their submissions are labelled so you know who sent them.
Who
Autumn Moulder
Testing and scores
Around twenty years building technology outside the big-tech bubble, most recently at Cohere. In her words: “I have thoughts…and had to live with the consequences.”
Think a score is wrong, or shipped something since we tested? Say so and we will retest. The tasks and the runs are public so they can be argued with. How scoring works.