arbiter

v0.1.0

MCP Server Validator - protocol compliance, code quality, best practices, and LLM ergonomics

Source Code Quick Start

What does arbiter check?

Protocol Compliance

JSON-RPC 2.0 handshake, capability negotiation, transport validation

Tool Quality

Schema completeness, description quality, parameter validation

Error Handling

Graceful failures, error codes, recovery behavior

Security

Input validation, injection resistance, secret exposure

LLM Ergonomics

Tool naming, description clarity, schema usability for AI agents

Host Compatibility

Desktop app config, environment startup, inspector support

Validation Profiles

ProfileThresholdUse Case
lenient50%Early development, quick feedback
standard70%Most servers (default)
strict85%Production-ready validation
paranoid95%Maximum compliance

Fix Packs

When validation fails, arbiter provides actionable remediation grouped into fix packs:

PackFocus
docs_baselineDocumentation completeness
schema_hardeningTool schema quality
error_hygieneError handling patterns
security_baselineSecurity fundamentals
llm_polishLLM ergonomics
lifecycle_complianceMCP lifecycle
transport_hardeningTransport layer

Get Involved

arbiter is open source under the MIT license.

View on GitHub Report Issue