What is AgentTest?
AgentTest is an open-source A/B testing and analytics platform designed specifically for AI agents and prompt workflows. It enables developers and product teams to run experiments on multiple agent variants, collect real-world metrics, and make data-driven decisions — without handing over deployment. AgentTest aims to provide:- A lightweight SDK for easy integration
- A backend API for assignment & logging
- A dashboard (coming soon) for managing experiments
- Future support for observability via OpenTelemetry