How do I test a Botpress agent?

Connect your Botpress agent to TestMu AI, ingest your docs or a knowledge source, and let it auto-generate scenarios. An AI evaluator then chats with your agent like a real user across thousands of scenarios, scoring every response on quality metrics with a clear pass or fail.

Why should I test agents built on Botpress?

Botpress ships agents fast with Autonomous Nodes, a Knowledge Base, Tables, and API calls, but once published your agent answers real customers on webchat or WhatsApp, quotes your policies, and triggers actions in your systems. One edit to an instruction, a workflow, or an uploaded doc can quietly break a conversation that worked yesterday. Independent testing catches invented answers, wrong tool calls, and missed handoffs before a customer does.

What parts of my Botpress agent can TestMu AI test?

Conversation accuracy on webchat, WhatsApp, Messenger, and Telegram; whether Autonomous Nodes call the right API, Table, or workflow with valid arguments; Knowledge Base grounding and hallucination guardrails; multi-turn memory; intent recognition; human handoff triggers; and regression after every publish. Each reply is scored on 9 quality metrics against your own pass/fail thresholds.

Will testing catch when my Botpress agent hallucinates or skips a tool call?

Yes. The AI evaluator chats with your agent like a real user and checks every reply against your Knowledge Base, so an answer that drifts from your docs is flagged as a hallucination. It also inspects whether an Autonomous Node called the correct tool with the right parameters, so a refund the agent promised but never executed, or a wrong API argument, shows up as a failure, not a happy-path demo.

Can I re-test my Botpress agent on every publish in CI/CD?

Yes. TestMu AI runs your scenario suite on a schedule using preset frequencies or full custom cron expressions with IANA timezone support, and you can trigger a run from your CI/CD pipeline on every new Botpress version, so a changed prompt or refreshed Knowledge Base is validated before it reaches customers.

Does this replace Botpress's own tooling?

No, it complements it. TestMu AI is an independent QA layer that evaluates your agent from the outside, the way a customer would. You keep building in Botpress and use KaneAI and agent testing to prove the agent behaves correctly on every release.

Test the AI Agents You Build on Botpress

Put your published Botpress agent through thousands of real conversations before customers do. AI evaluators catch hallucinated answers, wrong tool calls, and missed handoffs across every channel.

Start free with Google

Start free with Email

Automate Browser Flows from your
Terminal with Kane CLI

Explore Kane CLI

Trusted by 2M+ users globally at

+Read case study

Deep Dive into Botpress Testing

Webchat and Messaging

Tool and Action Calls

Scenario Generation

Go-Live Assessment

Test Botpress Chat and Messaging Conversations

Score every webchat, WhatsApp, Messenger, and Telegram turn across 9 quality metrics, so each Botpress reply is the right answer, not an invented one.

9 Quality Metrics Per Turn

Score hallucination, bias, completeness, context awareness, and response quality on every Botpress reply.

Real Customer Scenarios

Probe the messages your agent actually gets: refund requests, plan changes, off-topic asks, frustrated follow-ups.

Knowledge Grounding

Confirm answers trace to your uploaded docs and Knowledge Base, not stale or made-up policy details.

Complete Botpress Testing Coverage

Confidence by Evaluation Volume

HIGH (100+ evaluations), MEDIUM (50-99), LOW (20-49), VERY LOW (below 20). The more scenarios you run, the more weight each verdict carries.

9 Quality Metrics On Every Reply

Bias, hallucination, completeness, context awareness, response quality, flow, user satisfaction, file handling, and file accuracy, scored on every Botpress turn.

4-Dimension Go-Live Assessment

Before you publish a Botpress change, each run scores Functional Completeness, Quality Standards, Risk Profile, and Operational Readiness, weighted 25% each.

Tool Call and Answer Analysis

See where your Botpress agent grounded an answer, called the right Autonomous Node tool, or drifted, marked Pass, Fail, or Partial against your criteria.

Built for Every Layer of Botpress QA

Project and Environment Management

Separate your dev, staging, and published Botpress bots into projects and scope variables with bulk creation.

Test Profiles and Personas

Run scenarios as the personas your agent meets, from a calm repeat buyer to an angry customer demanding a refund.

Custom Validation Criteria

Define evidence-based pass/fail rules per scenario with High/Medium/Low confidence tracking.

Security and Infrastructure

Execute via HyperExecute with optional secure tunnels for firewall-restricted Botpress endpoints.

Scheduling Engine

Re-run your suite on every Botpress publish using preset frequencies or full custom cron expressions with IANA timezones.

Observability and Reporting

Track your Botpress agent's quality across runs with unified dashboards, exportable reports, and real-time trends.

Start Free Testing

Success Stories of TestMu AI (Formerly LambdaTest)

50%

reduction in test execution time

“HyperExecute is a highly reliable test execution platform and has excellent customer support.”

Sagar Uday Kumar

Sr. Engineering Manager

Some Love from our Customers

As Best Egg expanded its product offerings and entered new markets, we knew our old testing infrastructure couldn’t keep up.
With support from Tenny Agustin, our Engineering Operations Lead, we modernized our approach with

TestMu AI

Best Egg

best-egg

Excited to Share My Learning Journey with Kane AI & Lambda Tool!
I'm pleased to announce that I've recently gained hands-on experience exploring Kane AI through the Lambda Tool and it’s been a fantastic journey of upskilling!

KaneAI

Suryateja Goud

suryateja-goud

See how is #Futureready to enable blazing-fast test orchestration seamlessly integrated with organizations' existing CI/CD platforms, using #Microsoft Azure.

TestMu AI

Microsoft India

MicrosoftIndia

View all reviews

Frequently asked questions

TestMu AI (Formerly LambdaTest)/Botpress Testing

TestMu AI forEnterprise

Get access to solutions built on Enterprise
grade security, privacy, & compliance

Advanced access controls
Advanced data retention rules
Advanced Local Testing
Premium Support options
Early access to beta features
Private Slack Channel
Unlimited Manual Accessibility DevTools Tests