agent-evaluation topic
giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents
trulens
Evaluation and Tracking for LLM Experiments and AI Agents
ai-agents-reality-check
Mathematical benchmark exposing the massive performance gap between real agents and LLM wrappers. Rigorous multi-dimensional evaluation with statistical validation (95% CI, Cohen's h) and reproducible...
coze-loop
Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to...
awesome-ai-agent-testing
🤖 A curated list of resources for testing AI agents - frameworks, methodologies, benchmarks, tools, and best practices for ensuring reliable, safe, and effective autonomous AI systems
eval-view
Catch AI agent regressions before you ship. YAML test cases, golden baselines, execution tracing, cost tracking, CI integration. LangGraph, CrewAI, Anthropic, OpenAI.
agent-leaderboard
Ranking LLMs on agentic tasks
ignite25-PREL13-observe-manage-and-scale-agentic-ai-apps-with-microsoft-foundry
Learn How To Observe, Manage, and Scale, Agentic AI Apps Using Azure AI Foundry - with this hands-on workshop
any-agent
A single interface to use and evaluate different agent frameworks
agentune
Tune your AI Agent to best meet its KPI with a cyclic process of analyze, improve and simulate