Armature: Automated Testing for MCP Servers

Armature helps you catch MCP server regressions before your customers do. Connect your MCP server, define test workflows with natural-language criteria, and Armature runs them automatically on a schedule — evaluating every tool call against your criteria and alerting you the moment something breaks.

Quick Start

Connect your first MCP server and run your first test workflow in minutes.

Core Concepts

Understand workflows, runs, tool monitors, and coverage reports.

MCP API

Use Armature’s agent-facing MCP endpoint to triage, repair, and rerun workflows.

Alerts

Get notified on Slack or email when a workflow fails or a tool monitor fires.

How Armature works

Connect an MCP server

Add your MCP server’s URL and credentials. Armature probes it live to discover available tools.

Create a workflow

Write a natural-language prompt and define observable criteria — the outcomes your agent must produce.

Schedule and run

Set a schedule (or trigger manually). Armature dispatches an AI agent against your MCP server and evaluates the result.

Monitor and repair

View pass/fail results, inspect tool-call traces, and use the MCP repair API to diagnose and fix failing workflows.

Workflows

Scheduled AI-agent tests with evaluation criteria.

Tool Monitors

Lightweight pings that track per-tool uptime.

Coverage Reports

See which tools are exercised and which need more tests.

⌘I