How to Evaluate an AI Receptionist for Your Branch
What to test, what to ask vendors, and how to run a two-week trial of an AI receptionist at a roofing, siding, or HVAC distribution branch.
Decide which calls it should take
Start by listing the calls you want help with. A typical branch list:
- Pickup orders placed after hours
- Overflow during the morning rush
- Stock and color availability questions
- Delivery ETA questions
- Quote requests
- Calls for a specific counter person or rep
Then decide what the agent should do with each. Some calls it can complete, like taking down a pickup order for the counter to confirm. Others it should capture and route, like a stock check that needs someone to look at the system. Write this down. It becomes your test plan.
Watch for made-up answers
The biggest risk with any phone agent at a branch is a confident wrong answer. An agent that tells a contractor a color is in stock, or that a truck will arrive by noon, when it cannot see that information, creates a bigger problem than a missed call.
Ask every vendor how the agent handles questions it cannot answer. The right answer is that it takes the details, tells the caller who will follow up, and routes the call by your rules. It should not guess.
What to test
- Fast product talk. Rattle off a shingle line, color, and quantity the way a busy roofer would.
- Part and model numbers. Read an HVAC model number aloud and check the transcript.
- Job site noise. Call from a truck or a noisy yard.
- A Spanish-speaking contractor. Have a fluent speaker place a full order.
- An urgent call. A crew is standing on a roof waiting for material. Confirm it transfers to the right person.
- A failed transfer. Let the transfer ring out. See what the caller hears and what you receive.
- A request for a specific person. Ask for a named counter rep and check the routing.
Read every summary. Check the account, product, color, quantity, and pickup time.
Questions to ask vendors
- How do I edit questions and rules, and how fast do changes go live?
- What does the agent say when it does not know an answer?
- What happens when a transfer is not answered?
- Where do summaries go: email, our existing system, or both?
- Is pricing flat or per minute? Is there a long-term contract?
- How long does setup take?
Run a two-week trial
Week one: practice calls. Have counter staff, outside reps, and a few friendly contractors call in with real order scenarios. Review every transcript. Tighten the questions daily.
Week two: nights and weekends. Route after-hours calls to the agent. Each morning, have the counter open by working through the overnight summaries. Track how many orders came in complete and how many needed a callback.
Add rush-hour overflow once nights and weekends run clean.
Make the call with real results
At the end of the trial, look at orders captured after hours, callbacks needed, and transfers that reached the right person.
Stockton answers 24/7, including nights, weekends, and overflow. It follows your questions and rules, transfers urgent calls to the right person, handles English and Spanish, and records every call with a transcript and summary sent by email or into your existing system. It goes live in one business day at a flat monthly price, with no per-minute charges or long-term contract. Start a free two-week trial of Stockton.