MCPLab

App

AI Assistants

Use the Scenario and Result AI assistants to work faster.

Scenario Assistant

The Scenario Assistant is an AI chat that helps you design evaluation scenarios. Describe what you want to test in plain language and it produces a ready-to-use YAML scenario block.

Use it to get a first draft of a scenario, then refine it in the chat. When you are happy, copy the YAML into your eval config.

  • Describe the goal: "I want to test that the agent calls the search tool before answering."
  • Get a scenario with prompt, tool_constraints, and response_assertions already filled in.
  • Iterate: "Make the assertion stricter" or "Add a forbidden_tools constraint."

Result Assistant

The Result Assistant is an AI chat scoped to a specific completed run. Ask it questions about the results and it answers based on the run data.

Use it to understand failures quickly without manually reading through trace files.

  • Ask: "Which scenarios failed and why?"
  • Ask: "Did the agent call the correct tools in the right order?"
  • Ask: "Suggest improvements to make the failing scenarios pass."
Result Assistant