llm-d-incubation

llm-d-incubation/llm-d-modelservice

helm charts for deploying models with llm-d

32 stars 62 forks 32 watchers Go Template Apache License 2.0

View on GitHub Website

8 Open Issues Need Help Last updated: Sep 14, 2026

Open Issues Need Help

View All on GitHub

Align repository with llm-d repo template (14 items) 7 days ago

help wanted lifecycle/stale

llm-d-incubation/llm-d-modelservice

32

helm charts for deploying models with llm-d

Go Template

Bumping chart version should publish to gh-pages 9 months ago

documentation good first issue

llm-d-incubation/llm-d-modelservice

32

helm charts for deploying models with llm-d

Go Template

Update PD disaggregation example 11 months ago

good first issue help wanted

llm-d-incubation/llm-d-modelservice

32

helm charts for deploying models with llm-d

Go Template

Using pre-commit checks about 1 year ago

good first issue

llm-d-incubation/llm-d-modelservice

32

helm charts for deploying models with llm-d

Go Template

Add a `make lint` target about 1 year ago

documentation good first issue

llm-d-incubation/llm-d-modelservice

32

helm charts for deploying models with llm-d

Go Template

Skip empty acceleratorTypes items about 1 year ago

good first issue

llm-d-incubation/llm-d-modelservice

32

helm charts for deploying models with llm-d

Go Template

Clean up PD labels about 1 year ago

good first issue

llm-d-incubation/llm-d-modelservice

32

helm charts for deploying models with llm-d

Go Template

Support `schedulerName` on decode pods about 1 year ago

AI Summary: The task is to add support for the `schedulerName` parameter to the decode pods within the llm-d-modelservice Helm chart. This will allow users to specify a custom scheduler, such as `spyre`, for improved AIU support, potentially leveraging existing work from issue #59.

Complexity: 4/5

enhancement good first issue

llm-d-incubation/llm-d-modelservice

32

helm charts for deploying models with llm-d

Go Template