0x-bala/semanticcache

A Python semantic cache for LLM applications with similarity-based retrieval, SQLite storage, optional HNSW vector search, and safeguards against incorrect cache hits.

0 stars 0 forks 0 watchers Python MIT License

caching hnswlib llm llm-applications machine-learning python3 semantic-cache sqlite vector-search

View on GitHub

1 Open Issue Need Help Last updated: Oct 25, 2026

Open Issues Need Help

View All on GitHub

Add tests for invalid cache inputs 9 days ago

good first issue

0x-bala/semanticcache

A Python semantic cache for LLM applications with similarity-based retrieval, SQLite storage, optional HNSW vector search, and safeguards against incorrect cache hits.

Python

#caching#hnswlib#llm#llm-applications#machine-learning#python3#semantic-cache#sqlite#vector-search