- Focus
- Software and automation
- Main tools
- TypeScript, Vitest, Anthropic API
- Headline result
- Live evaluation cases: 43
- Status
- Built and tested, pilot not started
- 01Problem
Small businesses answer the same WhatsApp questions all day: prices, hours, do you have a slot.
- 02What I built
An input guard, an approved fact sheet, a prompt, and an output validator that blocks any reply containing a fact that is not in the sheet.
- 03Result
Safety was tested live on 43 cases across four runs.
- 04Next
Owner sign-off on the fact sheet, then a free pilot with one local business.
A safe-by-design assistant that answers routine customer questions from an approved fact sheet and hands anything uncertain, or any booking, to a person.
Problem
Small businesses answer the same WhatsApp questions all day: prices, hours, do you have a slot. An AI can answer these, but it must never invent a price or confirm a booking it cannot confirm.
What I built
- An input guard, an approved fact sheet, a prompt, and an output validator that blocks any reply containing a fact that is not in the sheet.
- A lead store and a rule that bookings are never confirmed by the bot; they go to a person.
- An offline evaluation plus a live evaluation against the model API.
- A demo and a one-page handout for the first business pilot, using Vintage Click as case study zero.
Tools and standards
- TypeScript
- Vitest
- Anthropic API
Result
Safety was tested live on 43 cases across four runs. No invented facts and no false confirmations remained in the final run.
| Metric | Value | Source |
|---|---|---|
| Live evaluation cases | 43 | Author's project documentation and test runs |
| Automated tests | 2,892 | Author's project documentation and test runs |
Try the assistant (scripted demo)
A scripted walk-through of how the assistant behaves. The business is made up and the replies are pre-written to show the safety rules; no AI model or real customer is involved. Pick a question or type your own.
The moving demo needs JavaScript; see the screenshots below.
Visuals
Sources
- Author's project documentation and test runs