An open-source framework for evaluating, benchmarking, comparing, and improving AI agents through reproducible tests, metrics, and experiments.

3 Open Issues Need Help Last updated: Oct 5, 2026

Open Issues Need Help

View All on GitHub
good first issue hacktoberfest cli difficulty: beginner

An open-source framework for evaluating, benchmarking, comparing, and improving AI agents through reproducible tests, metrics, and experiments.

Python
good first issue hacktoberfest benchmark difficulty: beginner

An open-source framework for evaluating, benchmarking, comparing, and improving AI agents through reproducible tests, metrics, and experiments.

Python
good first issue hacktoberfest evaluator difficulty: beginner

An open-source framework for evaluating, benchmarking, comparing, and improving AI agents through reproducible tests, metrics, and experiments.

Python