Open Issues Need Help
View All on GitHub --max-cost: stop a run cleanly when the budget is spent about 1 month ago
enhancement help wanted good first issue
Regression testing and configuration sweeps for RAG pipelines, with the statistics to know whether a change actually helped.
Python
#cli#continuous-integration#evaluation#llm#llm-evaluation#llmops#python#rag#retrieval#retrieval-augmented-generation#testing
rag-ci sweep --report report.html for a shareable result about 1 month ago
enhancement good first issue
Regression testing and configuration sweeps for RAG pipelines, with the statistics to know whether a change actually helped.
Python
#cli#continuous-integration#evaluation#llm#llm-evaluation#llmops#python#rag#retrieval#retrieval-augmented-generation#testing
LangChain integration — and it has to solve the offsets problem to be worth having about 1 month ago
enhancement help wanted
Regression testing and configuration sweeps for RAG pipelines, with the statistics to know whether a change actually helped.
Python
#cli#continuous-integration#evaluation#llm#llm-evaluation#llmops#python#rag#retrieval#retrieval-augmented-generation#testing
rag-ci demo: 60 seconds from install to a real verdict about 1 month ago
enhancement help wanted
Regression testing and configuration sweeps for RAG pipelines, with the statistics to know whether a change actually helped.
Python
#cli#continuous-integration#evaluation#llm#llm-evaluation#llmops#python#rag#retrieval#retrieval-augmented-generation#testing