AI agent benchmark · November 2026

The AI agent benchmark for customer service and ecommerce

8 AI agent vendors, tested on 55 live storefronts with the same scripted conversations. Every conversation is captured from the production chat widget and scored blind by an AI judge, with quoted evidence.

Vendors scored
8
Live stores
55
Conversations judged
518

The numbers

Every vendor, scored the same way

Shopping and Support are blind-judged rubric scores out of 100; Overall is their average.

VendorOverallShoppingSupport
Chatbase84.48385.8
Gorgias81.876.487.2
Decagon77.873.881.8
Sierra76.666.986.2
Fin73.774.472.9
Botpress70.064.475.5
Ada64.768.960.5
Zendesk48.840.856.7

Where Chatbase lands

We put ourselves through the same test

Chatbase ranks #1 overall of 8 vendors, #1 on Shopping and #3 on Support, and is the only vendor in the photo test that found the product from a shopper's photo and put it in the store's cart.

Overall
#1 of 8
Shopping
#1 of 8
Support
#3 of 8
Photo to cart
#1
Reply speed
#4 of 8