Should we add live chat or an AI shopping assistant to the site?
Our answer
Add an AI chat assistant if shoppers ask questions before buying. Feed it accurate product and policy content, label it as AI and pass order problems and requests for a person to staff. Keep it if revenue per visitor holds.
- Confidence
- Medium
- Strongest proof
- 4 official rules
- 1 dataset, 3 practitioners, 1 opinion or claim
- Sources
- 6 sources
- 9 statements
BINNCI1
New here? Take the 1-minute tour
Why this is the answer
3 reasons and our judgmentShoppers want AI for research and a person for problems. In a survey of 2,273 US shoppers, 63% preferred AI chatbots for comparing features, but 69% wanted a person when an item arrived damaged or wrong (Baymard Institute, ecommerce UX research firm).
Bad chat is worse than none. Many site chatbots get abandoned, and a bot should hand off to a human the moment one is asked for (Nielsen Norman Group, UX research firm). Charle (Shopify agency) argues understaffed chat is worse than no chat.
The only measured sales result for an AI chat assistant comes from Intercom, which sells one. Intercom quotes a brand's preliminary A/B test that found 3.4% more revenue per visitor from its Fin agent.
Our judgment
- Point the assistant at pre-purchase questions. Send order problems and any request for a person to staff or email, as Baymard's findings and Nielsen Norman Group's advice suggest. Shopify's Inbox agent already offers that handoff.
- On Shopify, start with the free Inbox app. Set its agent to cover the hours when no one can answer before paying for another tool. Shopify lists Inbox as free and Charle calls it fine for a small team.
- Keep the assistant only if revenue per visitor holds up. Test where traffic allows, as in Intercom's customer example, because the conversion gaps vendors quote compare shoppers who chose to chat.
- Protect page speed and the buy button. Load the chat script after the page is interactive, as 1Digital advises, and keep the launcher clear of Add to cart.
Our judgment, built from Baymard Institute, Nielsen Norman Group, Shopify, Charle, Intercom and 1Digital: our reading of these sources, not a finding from any one of them.
What the sources say
9 statements from 6 sourcesShopify Inbox's AI agent can answer product questions, recommend items and look up orders in store chat, for all chats or after hours. Merchants are responsible for its accuracy.
“You're responsible for the accuracy of the information that the Inbox agent provides to your customers.”
Shopify says Inbox is set to always available by default. When the AI agent handles chats, a customer asking for a person goes to staff during set hours, and gets the store's email outside them.
“Outside of your availability hours, the customer receives your store's sender email address and can contact you by email.”
Shopify's free Inbox app adds an optional AI sales agent and live chat to a storefront, connected to the catalog, inventory and policies, with analytics on assisted orders. It is rated 4.6 from 5,807 reviews.
“Inbox puts an AI-powered sales associate on your storefront.”
Baymard's survey of 2,273 US shoppers found 63% prefer AI chatbots for comparing features, but about two-thirds want a human for damaged, late or wrong orders. These are stated preferences.
“While 63% of shoppers prefer AI chatbots for product research tasks like comparing features, roughly two-thirds favor human representatives when resolving order errors.”
Charle, a Shopify agency, says understaffed live chat is worse than none, chat pays off most for considered purchases, and the widget must never cover the Add to cart button. No data of its own.
“Understaffing is worse than absence.”
1Digital, which sells ecommerce development, says many mid-tier Shopify stores load in 3 to 5 seconds on mobile, and advises fixing LCP first, then INP, then CLS.
“treat every new app install as a potential performance regression”
Nielsen Norman Group's qualitative research says site chatbots are often abandoned. They should hand off to a human when asked, stay in scope, link products directly, and disclose that they are AI.
“Never gatekeep when the user explicitly asks to be connected to a human.”
Shopify's Spring '26 release adds an AI sales associate to Inbox that answers buyer questions, suggests products and handles order inquiries from store data, with merchant control over tone and handoff.
“It lives on your storefront, where it can answer buyer questions, suggest products, and handle order inquiries using the data already in your admin”
Intercom, which sells the Fin AI agent, quotes one brand's preliminary test of a 3.4% revenue per visitor lift from Fin on product pages, with no sample size. Its 3x to 4x claim compares self-selected chatters.
“In a preliminary A/B test, the addition of Fin on our product pages drove a 3.4% uplift in revenue per visitor, with CSAT scores reaching 100%.”
In the full answer
For readers who sign in- What to do this week3 steps
- The numbers behind it3 figures from cited sources
- Where each source standsA chart placing each source on the question
- The strongest disagreementThe best case against the answer, from a cited source
- How sure we areWhat its confidence rests on, and what would change the answer