1 · Security / vulnerability scan
CI owns the gate: Suites A–D, incident E–K, AGENTS.md Unicode scan, audit-chain verify, quality_gate + SARIF.
mcp-test -m security --sarif-output findings.sarif
mcp-test scan-agents
mcp-test audit verify chain.json
mcp-test manifest check
Security docs ·
Cyber suites
2 · Load testing
MCP-aware latency and throughput SLOs with concurrency ramps — fail the PR when p95 or RPS slips.
await assert_latency(mcp, "echo", max_p95_ms=120, iterations=50)
await assert_throughput(mcp, "echo", concurrency=20, duration_s=15, min_rps=40)
await assert_load_phases(mcp, "echo", phases=[...], max_p95_ms=200)
Load / performance guide
3 · Resilience testing
Chaos faults plus graceful degrade / reconnect. Load resilience asserts deny-codes, no-fail-open, and fairness under pressure.
@marker(chaos_faults=["delay", "http_503"])
async def test_survives(): ...
await assert_degrades_gracefully(...)
await assert_control_engages_under_load(...)
await assert_no_fail_open_under_load(...)
Resiliency ·
Chaos
4 · Security features → CI/CD dashboard
Wire the same run into HTML dashboard, JUnit, JSON, and SARIF artifacts. GitHub Action comments on the PR — no hosted multi-tenant dashboard in core.
mcp-test --report-format html --report-output report.html \
--junit-xml junit.xml --sarif-output findings.sarif
# GitHub Action: vaquarkhan/mcp-test-harness@v5.2.0
Sample HTML dashboard ·
Integrations / Action