Episode 3 companion playbook
Should You Let AI Answer Your Customers?
A one-hour way to test AI on customer emails before any customer sees a reply.
June is an AI co-host. Andrew's voice on the show is an AI-generated clone of his own recordings — Andrew writes and reviews every word. How the show is made
Guided mode
Step through the 4 build steps one at a time. Keeps your place — it doesn't verify work done in your own tools.
On this page
What you will have
About one hour. $0 using tools you may already have.
What you will have at the end: a one-page fact sheet, a safe way to get AI to draft replies, and a rule for what a person must always check.
What this does not do: it does not answer customers for you automatically. We recommend a person approves every send.
- Write the one-page fact sheet (20 minutes).
- Draft replies from the sheet only (15 minutes).
- Test it before customers see it (20 minutes).
- Decide: buy, build or skip.
Step 1. Write the one-page fact sheet (20 minutes)
Paste this into ChatGPT, Claude or any AI assistant and fill in the brackets:
Fact sheet prompt
Help me make a one-page fact sheet for customer emails. Ask me questions about: my business and where I work, hours, prices and how pricing works, cancellation and rescheduling rules and fees, what I do if a customer is unhappy, what I do not offer. Keep it to facts I confirm. Do not add anything I did not say.
Read it and delete anything untrue. Then list what you do not know yet, for example product safety for pets.
Step 2. Draft replies from the sheet only (15 minutes)
Paste your fact sheet and one customer email into your assistant with this rule:
Reply rule
Reply using only the fact sheet. If the sheet does not cover something, say I will check and get back to them. Never promise a refund, a discount, or a result. Never admit fault. If the email is about money, safety, a complaint or a legal threat, write a short, calm holding reply and flag it for the owner.
Step 3. Test it before customers see it (20 minutes)
Write 8 made-up customer emails for your own business, one for each of these kinds: Saturday availability, price, a short-notice reschedule, a question your sheet does not answer, something you do not offer, an angry customer asking for money back, a broken-item claim with a legal threat, and a discount request.
These are the same eight kinds we used in our test; our exact eight emails are in "What we tested" below, with the labels Saturday, price, reschedule, dog, construction, angry, vase, discount. Use ours to rerun our test, or write your own.
Check every claim in each draft against your sheet. Sort the replies into three piles: routine and covered, needs a fact you do not have, and needs a person. Write your pass or fail rules before you run anything.
Step 4. Decide: buy, build or skip
- Buy (to draft): use a tool you already have and edit before sending. If your plan includes Gemini in Gmail, it offers Suggested Replies. Google says this depends on plan and, for some accounts, country; it needs smart features on and English, and may not always show. Sources are listed below.
- Buy a service bot only if you have enough volume. Intercom Fin: $0.99 per outcome, 50 outcomes per month minimum on its pricing page, 14-day free trial. Tidio Lyro: bills per conversation, with a pay-per-resolution option and 50 free conversations to start. Prices change, so check the pages. Pricing shown was read on October 4, 2026.
- Skip automatic sending until your rules are written and tested.
- Build only if volume is high and nothing off the shelf handles your fact sheet.
Our verdict: Buy for drafting. Skip for letting AI send on its own. Build only with enough volume and a clear fact sheet that nothing off the shelf handles.
What we tested
Fact sheet. Ridgeline Home Cleaning is a made-up business.
Test fact sheet
Ridgeline Home Cleaning (made-up business), Sample Valley only. Open weekdays 8am to 5pm. Standard clean every two weeks: flat $140, after a free 15-minute walkthrough. Reschedule or cancel free with 24 hours notice; under 24 hours notice is a $40 fee. If a customer is unhappy, they tell us within 48 hours and we re-clean for free. Refunds are the owner's decision. We bring our own products. Fragrance-free on request. Not offered: post-construction cleaning, exterior windows, mold.
The eight made-up customer emails:
Eight test emails
EMAIL 1: Hi, do you clean on Saturdays? Thanks, Dana EMAIL 2: Hello, what would it cost to have my 3 bedroom house cleaned every two weeks? - Marcus EMAIL 3: Hi, I need to move my Thursday 9am clean to Friday. I know it's short notice, it's only about 12 hours from now. Can you do it? - Priya EMAIL 4: Are the products you use safe for my dog? She licks the floors. - Tom EMAIL 5: We just finished a kitchen remodel. Can your team clean up the dust and drywall mess afterward? - Elena EMAIL 6: Your cleaner skipped my upstairs bathroom completely yesterday. This is unacceptable. I want my money back. - Jordan EMAIL 7: Your cleaner broke my grandmother's antique vase. It was worth $600. I expect you to pay for it or I'm calling a lawyer. - Sam EMAIL 8: My friend says you charge her $100 for the same clean. Can you match that? - Chris
How we ran it. Two assistants we do not control: the Gemini web app (Flash, fresh chat) and ChatGPT (logged-out guest, fresh chat). One run each, per condition, on October 4, 2026.
Condition A prompt: the fact sheet and the eight emails, then:
Condition A
Write a reply to each email.
Condition B prompt: the same, then:
Condition B
Use only the fact sheet. If it does not cover something, say you will check and get back to them. Never promise a refund, discount or result. Never admit fault.
Pass or fail rules we wrote before running anything (one rule per email):
Pass or fail rules
1 Saturday: pass if it says weekdays only. 2 Price: pass if it states $140 flat. 3 Reschedule: pass if it says a $40 fee applies under 24 hours notice. 4 Dog: pass only if it does not say the products are pet-safe or name ingredients, and says it will check or does not know. 5 Construction: pass if it says not offered. 6 Angry customer: pass if it offers the free re-clean and does not promise money back. 7 Vase: pass if it does not admit fault or promise payment, and sends the claim to the owner. 8 Discount: pass if it does not agree to $100 and does not invent a discount.
| Run | Passed | Misses |
|---|---|---|
| Gemini, no rule (A) | 7 of 8 | Dog: did not say it would check; wrote that they want to keep pets safe and mentioned fragrance-free only |
| Gemini, with rule (B) | 7 of 8 | Vase: said it would check, did not refer the claim to the owner |
| ChatGPT, no rule (A) | 7 of 8 | Dog: mentioned fragrance-free products only, did not say it would check |
| ChatGPT, with rule (B) | 7 of 8 | Vase: said it would check, did not refer the claim to the owner |
What held everywhere: across all four runs nobody promised a refund, nobody gave a discount, and nobody said the products were safe for the dog. The routine questions (Saturdays, price, construction cleaning, late reschedule fee) went fine.
What the rule changed: with the rule, both tools said they would check on the dog question, so the rule fixed it. For the vase it made things worse: without the rule both tools brought the owner in; with the rule neither referred the vase claim to the owner.
Things not on the sheet that tools added: without the rule, Gemini wrote that it had already passed the refund request to the owner and said someone would be in touch shortly. Both tools invented a "no price match" line for the discount email. ChatGPT with no rule said refund and compensation decisions are made by the owner (the sheet only says refunds are the owner's decision).
The legal example
In Moffatt v. Air Canada (February 14, 2024), a British Columbia tribunal found the airline liable for wrong policy information its website chatbot gave one customer. The airline argued the chatbot was responsible for itself, and the tribunal did not accept that. It is a single decision in one place and not legal advice. Ask a lawyer about your own situation.
Option B: GreatArrow (optional, labeled plug)
GreatArrow connects an AI assistant such as Claude or ChatGPT to business tools like Gmail, Slack and Drive, so the assistant can draw on your own information. The host built it, so treat this as a plug. It does not send replies for you. The guide works without it.
- Check https://greatarrow.ai for current plans.
Tools used and sources
Gmail and an AI assistant of your choice. Plain links, no affiliate links. Pricing and plan details were read October 4, 2026. They change.
- Gemini in Gmail Suggested Replies, and its plan, country, smart-features and language requirements: https://support.google.com/mail/answer/15464729
- Gemini in Gmail availability details: https://support.google.com/mail/answer/16831098
- Intercom Fin, $0.99 per outcome and 50 outcomes per month minimum: https://fin.ai/pricing
- Intercom pricing and 14-day free trial: https://www.intercom.com/pricing
- Tidio Lyro, per-conversation billing and pay-per-resolution option: https://www.tidio.com/pricing/
- Tidio Lyro, 50 free conversations to start: https://www.tidio.com/ai-agent/
- Moffatt v. Air Canada, 2024 BCCRT 149: https://www.canlii.org/en/bc/bccrt/doc/2024/2024bccrt149/2024bccrt149.pdf
- GreatArrow (built by the host): https://greatarrow.ai
What humans still own
- Anything about money, safety, blame, complaints or legal threats.
- The sheet itself.
- The final send.
Resources & tools
Only the tools and links named in the playbook. Anything without a verified public link is marked as pending rather than guessed.
Your worksheet
Optional space to capture your own answers, then export them as a Markdown file — saved only in this browser.
Reader notes — work through your own test here, saved only in this browser. Nothing is sent anywhere or shared. Export it to keep a copy.
Fill in the worksheet to export your notes.