torch-spyre/spyre-inference

[FP8] Support block-wise FP8 quantization 12 days ago

enhancement help wanted

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Add FP8 support to ParallelLMHead 13 days ago

enhancement help wanted September2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Support FP8 KV cache for attention 16 days ago

enhancement help wanted

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[EPIC] Ensure that the new plugin is robust to upstream changes 20 days ago

help wanted

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Implement SpyreFp8LinearMethod for custom linear layers 20 days ago

enhancement help wanted September2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Feature]: Configure individual layers on spyre 20 days ago

enhancement good first issue

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Epic] Support prefill/decode disaggregation 20 days ago

help wanted

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Epic] Develop KVCacheConnector for Spyre 20 days ago

help wanted

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Support online FP8 quantization (W8A16 dynamic) 20 days ago

enhancement help wanted

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Feature]: Check compile support for encoder models 20 days ago

enhancement help wanted September2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

remove cpu-roundtrip for `reshape_and_cache` about 1 month ago

help wanted vllm-spyre-next vllm-spyre-attention-backend August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Add FP8 test infrastructure and reference tests about 1 month ago

enhancement help wanted vllm-spyre-next tests August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Fix Inductor compatibility for FP8 tensors (torch-spyre #1474) about 1 month ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Add FP8 tensor initialization kernels for spyre device about 1 month ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Implement scaled_mm operator support in torch-spyre about 1 month ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

add indirect access for matmul in online softmax about 1 month ago

help wanted vllm-spyre-next vllm-spyre-attention-backend August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

remove CPU round-trip for attention result-reshape about 2 months ago

help wanted vllm-spyre-next vllm-spyre-attention-backend

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Evaluate whether vLLM IR can be used to wrap layers for torch-spyre 3 months ago

good first issue vllm-spyre-next July2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Verify the 4D matmul in the attention computation 4 months ago

good first issue vllm-spyre-next June2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Write design docs for key features 5 months ago

good first issue May2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Wrap the ParallelLMHead for torch-spyre 5 months ago

good first issue vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[doc] add a README.md 5 months ago

documentation good first issue

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Open Issues Need Help