voidmind-io

voidmind-io/voidllm

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

122 stars 14 forks 122 watchers Go Other
ai ai-gateway anthropic api-gateway docker golang helm kubernetes llm llm-gateway llm-proxy ollama openai openai-proxy privacy privacy-first rate-limiting rbac self-hosted vllm
View on GitHub Website
5 Open Issues Need Help Last updated: Jul 21, 2026

Open Issues Need Help

View All on GitHub
tool_name truncation for mcp_tool_calls can split a UTF-8 character 7 days ago
bug good first issue area:api priority:low
voidmind-io/voidllm
122

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Go
#ai#ai-gateway#anthropic#api-gateway#docker#golang#helm#kubernetes#llm#llm-gateway#llm-proxy#ollama#openai#openai-proxy#privacy#privacy-first#rate-limiting#rbac#self-hosted#vllm
RegisterTool stores the caller-supplied Tool without cloning it 7 days ago
bug good first issue area:mcp priority:low
voidmind-io/voidllm
122

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Go
#ai#ai-gateway#anthropic#api-gateway#docker#golang#helm#kubernetes#llm#llm-gateway#llm-proxy#ollama#openai#openai-proxy#privacy#privacy-first#rate-limiting#rbac#self-hosted#vllm
Missing test coverage for concurrency and edge cases on the MCP proxy path 7 days ago
enhancement help wanted area:mcp priority:low
voidmind-io/voidllm
122

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Go
#ai#ai-gateway#anthropic#api-gateway#docker#golang#helm#kubernetes#llm#llm-gateway#llm-proxy#ollama#openai#openai-proxy#privacy#privacy-first#rate-limiting#rbac#self-hosted#vllm
Legacy MCP dialect shares ClientCaps backing bytes instead of copying them 7 days ago
enhancement good first issue area:mcp priority:low
voidmind-io/voidllm
122

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Go
#ai#ai-gateway#anthropic#api-gateway#docker#golang#helm#kubernetes#llm#llm-gateway#llm-proxy#ollama#openai#openai-proxy#privacy#privacy-first#rate-limiting#rbac#self-hosted#vllm
Add Go native fuzz targets for SSE and PII parsing paths 17 days ago
enhancement help wanted area:proxy priority:low
voidmind-io/voidllm
122

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Go
#ai#ai-gateway#anthropic#api-gateway#docker#golang#helm#kubernetes#llm#llm-gateway#llm-proxy#ollama#openai#openai-proxy#privacy#privacy-first#rate-limiting#rbac#self-hosted#vllm