name: echo-testing description: >- Echo launch and regression testing — automated headless gates plus Xcode/Mac manual E2E. Use when preparing TestFlight, running regression before release, validating Phase 1/2/3 flows, or when the user asks for testing checklists, E2E on simulator/device, or make regression.
Echo testing (launch + regression)
| Doc | Use |
|---|---|
docs/E2E_QUICK_START.md |
Default — setup, daily regression by milestone, rebuild, iOS smoke |
docs/E2E_LAUNCH_AND_TESTING.md |
Feature matrix, full E2E procedures, TestFlight, sign-off |
Agent workflow (iOS testing help)
When the user struggles with iOS E2E, run in order:
make dev(or confirmhealth_backend)make ios-preflight— or MCPrun_ios_preflight- If iOS code changed:
make ios-preflight BUILD=1 TESTS=1 - If onboarding/API fails: MCP
smoke_ios_backend - Point user to E2E_QUICK_START §2 (15 min Xcode checklist) — agents cannot tap Simulator UI
Do not dump the full E2E doc — use the quick start.
Do not suggest redesigning onboarding/login from the design prototype — those iOS flows are frozen (ECHO_IOS_UI_IMPLEMENTATION_SPEC.md §0).
When to run what
| Cadence | Automated | Manual (Mac + Xcode) |
|---|---|---|
| Every PR / push | CI: Go + iOS SPM | — |
| Pre-merge / weekly | make regression |
Spot-check quick start §2 |
| Before Xcode session | make ios-preflight BUILD=1 |
Quick start §2 |
| Pre-TestFlight | make regression-with-phase1 |
Quick start + device + §9 sign-off |
Commands
make ios-preflight # backend + Xcode + scheme (agents run this)
make ios-preflight BUILD=1 TESTS=1
make regression
make regression-quick
make regression-with-phase1
MCP echo-local-dev
| Tool | Use |
|---|---|
run_ios_preflight |
Before user opens Xcode |
smoke_ios_backend |
SMS / OIDC / health for iOS |
run_regression |
Full headless gate |
run_release_check |
Go only |
run_validate_phase1 |
WO-230 go/no-go |
run_ios_phase3_tests |
Phase 3 logic |
health_backend / cluster_status |
Stack up? |
Reload MCP after pulling (tools/echo-local-dev-mcp/README.md).
iOS — agent limits
- Scheme name: EchoApp (not Echo)
- Simulator
API_URL:http://localhost:8000(in EchoApp.xcscheme) - Device: LAN IP via scheme env
- Agents cannot: Simulator UI, Face ID, two-device chat, TestFlight install
Related skills
| Skill | Use |
|---|---|
echo-phase1-validate |
WO-230 go/no-go |
echo-ios-agent-vs-xcode |
Agent vs Xcode ownership |
echo-phase3-ios-wire |
Phase 3 two-client WS |