SystemPanic

SystemPanic/vllm-windows

A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)

566 stars 54 forks 566 watchers Python Apache License 2.0

View on GitHub Website

1 Open Issue Need Help Last updated: Jul 14, 2026

Open Issues Need Help

View All on GitHub

[Bug]: CUDA error: an illegal memory access was encountered 24 days ago

help wanted question

SystemPanic/vllm-windows

566

A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)

Python