edonadei

edonadei/caliper

Local-first eval harness for Claude Code, Codex, Hermes and Pi skills

29 stars 3 forks 29 watchers Python MIT License
ai-agents claude-code cli codex evals evaluation hermes hermes-agent hermes-skill pi reliability skills
View on GitHub Website
2 Open Issues Need Help Last updated: Jul 9, 2026

Open Issues Need Help

View All on GitHub
Persist the attempt transcript in saved results JSON 25 days ago
enhancement good first issue ready-for-agent
edonadei/caliper
29

Local-first eval harness for Claude Code, Codex, Hermes and Pi skills

Python
#ai-agents#claude-code#cli#codex#evals#evaluation#hermes#hermes-agent#hermes-skill#pi#reliability#skills
caliper compare: optional --margin for a non-inferiority-aware regression flag 27 days ago
enhancement good first issue
edonadei/caliper
29

Local-first eval harness for Claude Code, Codex, Hermes and Pi skills

Python
#ai-agents#claude-code#cli#codex#evals#evaluation#hermes#hermes-agent#hermes-skill#pi#reliability#skills