ovg-project/kvcached - 8 Help Wanted Issues

Open Issues Need Help

kvcached support matrix about 11 hours ago

help wanted

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

Roadmap/Feature requested/TODOs---Start Here for New Contributors 6 days ago

help wanted

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

CI runs no tests — add a GitHub Actions job for the CPU-only pytest suite 15 days ago

enhancement help wanted

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

Error on gpt-oss with vLLM 9 months ago

good first issue

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

start mutiple models 9 months ago

good first issue

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

Failed to patch kv_cache_coordinator 10 months ago

good first issue

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

What is the difference between kvcached and Paged Attention ? 10 months ago

good first issue

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

Question About kvcached Ability to Dynamically Recognize and Utilize Kubernetes Elastic Scaled GPU Memory Resources 11 months ago

good first issue

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm