khaled-haikel

khaled-haikel/rag-eval-mcp

Touchstone — know if you broke your RAG. An MCP server and CLI that score retrieval quality against a golden set: recall@k, MRR and hit rate, with no LLM calls.

1 stars 0 forks 1 watchers Python MIT License
claude-code embeddings evaluation evaluation-metrics llm mcp model-context-protocol openai pgvector postgres python rag retrieval retrieval-augmented-generation vector-search
View on GitHub
2 Open Issues Need Help Last updated: Sep 1, 2026

Open Issues Need Help

View All on GitHub
Bump the GitHub Actions to their Node 24 releases 21 days ago
enhancement good first issue
khaled-haikel/rag-eval-mcp
1

Touchstone — know if you broke your RAG. An MCP server and CLI that score retrieval quality against a golden set: recall@k, MRR and hit rate, with no LLM calls.

Python
#claude-code#embeddings#evaluation#evaluation-metrics#llm#mcp#model-context-protocol#openai#pgvector#postgres#python#rag#retrieval#retrieval-augmented-generation#vector-search
A second vector store behind the Connection protocol 21 days ago
enhancement help wanted
khaled-haikel/rag-eval-mcp
1

Touchstone — know if you broke your RAG. An MCP server and CLI that score retrieval quality against a golden set: recall@k, MRR and hit rate, with no LLM calls.

Python
#claude-code#embeddings#evaluation#evaluation-metrics#llm#mcp#model-context-protocol#openai#pgvector#postgres#python#rag#retrieval#retrieval-augmented-generation#vector-search