Reliability Pack

Catch agent failures
before production.

Deterministic MCP test scenarios for regression testing AI agents. Run suites, publish replay fixtures, gate CI with assertions, and verify protocol behavior — all from a single endpoint.

Endpoint/mcp
4Fake Services
5Scenario Types
8Assertion Ops
2Conformance Profiles

Replay Fixtures

Snapshot any run into an immutable artifact. Reproduce exact failures with the same seeds and payloads, weeks later.

Assertions

Attach status codes, retryability, latency, and detail checks to every test case. Catch regressions before they ship.

CI Gate

Create runs from suites or inline cases. Export JSON and JUnit reports. Fail builds when error-severity assertions trip.

Conformance + Stateful

Validate MCP protocol handshakes and tool invocations. Simulate multi-step flows like token expiry and outage ramps.

github

Fake GitHub

Repository events, issues, pull requests, and webhook retries.

slack

Fake Slack

Channels, threads, mentions, and permission edge cases.

notion

Fake Notion

Databases, rich text payloads, and schema drift scenarios.

postgres

Fake Postgres

Transactional behavior, lock contention, and timeout modes.

Rate Limited
Auth Expired
Partial Outage
Malformed Payload
Slow Response
Terminal
# Install and start the local MCP server$ pnpm install$ pnpm --filter @fakemcp/mcp dev # Run an inline reliability suite$ curl -X POST http://127.0.0.1:8787/v1/runs \ -H "Content-Type: application/json" \ -d '{"source":"ci","cases":[{"server":"github","scenario":"rate_limit"}]}' # Export JUnit report for CI$ curl http://127.0.0.1:8787/v1/runs/<runId>/report?format=junit