homayoun-safarpour

homayoun-safarpour/judge-drift-sentinel

Attribute eval-score movement to the system or the LLM judge using a frozen human anchor set and kappa.

0 stars 0 forks 0 watchers Python MIT License
ai-engineering ci drift-detection evals llm-as-judge llm-evaluation python reliability
View on GitHub Website
1 Open Issue Need Help Last updated: Aug 5, 2026

Open Issues Need Help

View All on GitHub
Good first issue: add one synthetic drift fixture to the anchor-set examples about 13 hours ago
good first issue
homayoun-safarpour/judge-drift-sentinel
0

Attribute eval-score movement to the system or the LLM judge using a frozen human anchor set and kappa.

Python
#ai-engineering#ci#drift-detection#evals#llm-as-judge#llm-evaluation#python#reliability