Go-live checklist
Everything to verify before sending real customer traffic to Jake
Go-live checklist
TL;DR: Test the real channel (not just Playground). Decide who owns what. Launch one channel, narrow scope. Monitor daily.
Verify end to end
- Agent version is active
- Common question answered from the correct source
- Permitted operation reports verified success
- Risky operation requests approval
- Missing info produces a clarifying question
- Adversarial requests stop safely
- Customer can reach a person
- Application secret is server-only
- Sign-out clears the session
- Push delivery verified on a real device (if promised)
Decide ownership
- Who owns Inbox triage?
- What's the SLA for approval requests?
- Who can publish behavior changes?
- How do you disable the channel or rollback?
Launch gradually
One channel. Narrow outcomes. Monitor Inbox, Activity, and feedback daily.
Rollback
| Channel | How |
|---|---|
| Web widget | Remove the script |
| iOS / Android | Remote flag on the entry point |
| Intercom migration | Return new conversations to Intercom |
Never split an in-progress conversation.
Keep improving
Track: handoff rate, approval time, grounded-answer failures, customer feedback, regressions per version. Turn production misses into scenarios before the next publish.