vllm-project

vllm-project/router

A high-performance and light-weight router for vLLM large scale deployment

398 stars 148 forks 398 watchers Rust Apache License 2.0
View on GitHub
1 Open Issue Need Help Last updated: Sep 8, 2026

Open Issues Need Help

View All on GitHub
[WIP][Help Wanted] vLLM Router 2026 Roadmap 2 days ago
help wanted High Priority omni-modality
vllm-project/router
398

A high-performance and light-weight router for vLLM large scale deployment

Rust