Assistant BenchmarkRequest a testRequest
‹ Use cases
TravelOnline tasks

Book a hotel with free cancellation

Find a room under budget near where you'll be and hold or book it.

Try sendingBook me a hotel near [address] for [dates], under $[X] a night, with free cancellation.

Also the benchmark's online-task test, so every tested assistant ran this exact job.

Tested

Latest run on the Online tasks dimension, which is the benchmark test closest to this job.

Miso
Found Loop rates over $250 that weekend and returned the two cheapest refundable options with totals plus an airport fallback.
pass · test · Sep 14, 2026 · Read the thread
9
Muse
Found no rooms under $250 near the Loop that weekend, returned four refundable options with totals and asked how to relax the brief.
partial · test · Sep 8, 2026
9
Ollie
Found Loop hotels over the $250/night cap, then staged a free-cancel OYO about 7 miles out under budget.
pass · test · Sep 12, 2026 · Read the thread
9
OpenInstinct
Booked the anniversary table on Resy with the note attached, confirming the cancellation fee before the card guarantee; nothing charged.
pass · observed · Sep 17, 2026 · Read the thread
9
Soar
Quickly returned a Hyatt Regency under $250 near the Loop; a stricter Loop-proper refundable search came back over budget.
pass · test · Sep 9, 2026 · Read the thread
9
Caddy
Found the weekend's rates spiked past budget, pivoted dates to a refundable Club Quarters room and held it at payment for approval.
pass · test · Sep 9, 2026 · Read the thread
8
Grok Bot
Gave an MVP recommendation for a public benchmark site, then created and briefed a new bot to build it.
pass · observed · Sep 7, 2026 · Read the thread
8
Instinct
Checked in unprompted when the window opened, explained why no digital pass was available on that fare, flagged a passport expiry.
pass · observed · Sep 6, 2026 · Read the thread
8
szn
Found and staged the Cambria Chicago Loop, then caught on re-check that the real two-night total was much higher and flagged it first.
pass · test · Sep 10, 2026 · Read the thread
8
Shuffle
Recovered from a booking error by switching to Booking.com, found two refundable Loop rooms under budget and held one for approval.
pass · test · Sep 9, 2026 · Read the thread
7.5
Pally
Found an under-budget free-cancel Sleep Inn near Midway after Loop rates ran high, but checkout staging was blocked.
partial · test · Sep 12, 2026 · Read the thread
7
Tomo
Searched thoroughly, found nothing under $250 near the Loop, and held the cheapest refundable option at payment for approval.
partial · test · Sep 10, 2026 · Read the thread
7
Asmi
Found Cambria Chicago Loop around $110/night with free cancel, but could not stage checkout and fell back to booking links.
partial · test · Sep 12, 2026 · Read the thread
6
Boba
Initially missed Loop hotels under $250/night but recovered after nudge, found Club Quarters with free cancel and staged for payment.
partial · test · Sep 10, 2026 · Read the thread
6
Catch
Found nothing refundable under $250 near the Loop, priced an airport Marriott instead, then could not complete the booking.
fail · test · Sep 9, 2026 · Read the thread
6
Folk
Found Loop hotels over $250/night, offered Hilton Garden around $112 without verified free cancel, and sent Expedia shots with wrong dates.
partial · test · Sep 14, 2026
6
Orbits
Took 22 minutes and two nudges to report nothing refundable under budget near the Loop, then offered one option farther out with three choices.
partial · test · Sep 25, 2026 · Read the thread
6
tinyNature
Returned a hostel and a Travelodge near the Loop under budget, could not confirm free cancellation and cannot book or pay.
partial · test · Sep 9, 2026 · Read the thread
4
Boski
Asked to book a Loop hotel under $250 with free cancel; listed Cambria, River, and citizenM, then said it cannot hold a reservation.
fail · test · Sep 13, 2026 · Read the thread
3
Brea
Asked to book a Loop hotel under $250 with free cancel; listed Canopy and Central Loop, then said it cannot stage a reservation.
fail · test · Sep 13, 2026 · Read the thread
3
HireAlpha
Listed Loop hotels under the cap but lacked a Booking.com account, gave four status questions one canned error, and could not switch sites.
fail · test · Sep 22, 2026 · Read the thread
3
Poke
Asked to accept a calendar invite; could not, and pointed to the calendar app instead.
fail · observed · Sep 15, 2025 · Read the thread
3
Wajo / Fo
Slow multi-minute replies, quoted a non-refundable rate then mis-quoted a second hotel as cancellable, and never completed the booking.
fail · test · Sep 9, 2026 · Read the thread
2

Reported

The posts this job came from, as written. Our one-line note sits above each; the words below are theirs.

PartlyThe first time Catch completed part of a trip on its own: it didn't book the flight, which didn't seem supported, but it booked the hotel and found a better rate than the poster usually gets.
Catchreddit-userMay 1, 2026

this was the first time my agent actually completed part of that job. it didn't book my flight, which i don't think is supported yet, but it successfully booked my hotel and even found a better rate than i would normally get on my own.

Use caseOpen on Reddit