MCPLab/ docs

Documentation

Start with Getting Started, then follow the CLI track for terminal-based workflows or the App track for the web UI.

What MCPLab Does

MCPLab is a testing and evaluation framework for MCP servers. Write scenarios that describe tasks an LLM agent should complete using your MCP tools, run them against one or more models, and assert on the results — which tools were called, in what order, and what the response contained.

Getting Started

What MCPLab does and when to use it.

Install MCPLab and configure your API keys.

Write your first eval and see results in under 5 minutes.

CLI

Running Evaluations

The mcplab run command and all its options.

Write eval.yaml — servers, agents, scenarios, assertions, and auth.

Reports & Output

What MCPLab writes after a run and how to work with it.

Run MCPLab in GitHub Actions and other CI pipelines.

App

Starting the App

Launch the MCPLab web UI and find your way around.

Running Evaluations

Launch and monitor evaluations from the web UI.

Analysing Results

Understand run output, compare agents, and browse markdown reports.

Use the Scenario and Result AI assistants to work faster.

MCP Tool Analysis

Review MCP tool definitions for quality and LLM-readiness.

Manage reusable agents and servers shared across eval configs.

Reference

Configuration Schema

Complete field reference for eval.yaml.

Environment Variables

All environment variables read by MCPLab.