Demo: Reliability Workflow
Run a 5-minute launch demo for suites, reports, and replay.
Demo Script: 5-Minute Reliability Workflow
Goal
Show a complete reliability CI Pack loop: suite -> run -> report -> replay.
Timeline
- Minute 0-1: Explain deterministic regression testing for production agents.
- Minute 1-2: Create a suite with two cases and one assertion.
- Minute 2-3: Run the suite and inspect summary counts.
- Minute 3-4: Download JUnit report for CI artifact.
- Minute 4-5: Create replay record and show fixture metadata.
Live command sequence
export BASE_URL="https://fakemcp.com"
export PROJECT_TOKEN="replace_me"
suite="$(curl -sS -X POST "$BASE_URL/v1/suites" -H "Content-Type: application/json" -H "X-Project-Token: $PROJECT_TOKEN" -d '{"name":"demo-suite","visibility":"private","cases":[{"server":"github","scenario":"rate_limit"},{"server":"notion","scenario":"malformed_payload"}],"assertions":[{"field":"statusCode","op":"gte","expected":400,"severity":"error"}]}')"
suite_id="$(node -e 'const b=JSON.parse(process.argv[1]); process.stdout.write(b.id)' "$suite")"
run="$(curl -sS -X POST "$BASE_URL/v1/runs" -H "Content-Type: application/json" -H "X-Project-Token: $PROJECT_TOKEN" -d "{\"source\":\"ci\",\"suiteId\":\"$suite_id\",\"seed\":\"demo-seed\"}")"
run_id="$(node -e 'const b=JSON.parse(process.argv[1]); process.stdout.write(b.id)' "$run")"
curl -sS "$BASE_URL/v1/runs/$run_id/report?format=junit" -H "X-Project-Token: $PROJECT_TOKEN"
curl -sS -X POST "$BASE_URL/v1/replays" -H "Content-Type: application/json" -H "X-Project-Token: $PROJECT_TOKEN" -d "{\"runId\":\"$run_id\"}"