Local-first RAG evaluation framework for LLM applications. 100% local, no API keys required.

2 stars 1 forks 2 watchers Python GNU Affero General Public License v3.0
ai evaluation langchain llm local-first ollama python rag retrieval-augmented-generation testing
4 Open Issues Need Help Last updated: Jan 26, 2026

Open Issues Need Help

View All on GitHub
FAISS adapter 9 days ago

AI Summary: This issue proposes adding a FAISS vector store adapter to enable fast, pure local vector search using a file-based index. The adapter will implement the `VectorStoreProtocol`, support index persistence, various index types (Flat, IVF, HNSW), batch operations, and memory-mapped indexes for large datasets. It's considered a good first issue, leveraging existing patterns from other adapters.

Complexity: 2/5
enhancement good first issue adapter

Local-first RAG evaluation framework for LLM applications. 100% local, no API keys required.

Python
#ai#evaluation#langchain#llm#local-first#ollama#python#rag#retrieval-augmented-generation#testing
enhancement good first issue adapter

Local-first RAG evaluation framework for LLM applications. 100% local, no API keys required.

Python
#ai#evaluation#langchain#llm#local-first#ollama#python#rag#retrieval-augmented-generation#testing
enhancement good first issue adapter

Local-first RAG evaluation framework for LLM applications. 100% local, no API keys required.

Python
#ai#evaluation#langchain#llm#local-first#ollama#python#rag#retrieval-augmented-generation#testing
enhancement help wanted reporter

Local-first RAG evaluation framework for LLM applications. 100% local, no API keys required.

Python
#ai#evaluation#langchain#llm#local-first#ollama#python#rag#retrieval-augmented-generation#testing