torch-spyre/spyre-inference

remove CPU round-trip for attention result-reshape 3 days ago

help wanted vllm-spyre-next vllm-spyre-attention-backend

6

vLLM plugin for Spyre based on torch-spyre

Python

remove cpu-roundtrip for `reshape_and_cache` 4 days ago

help wanted vllm-spyre-next vllm-spyre-attention-backend

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Feature]: Check compile support for encoder models 7 days ago

enhancement help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Implement SpyreFp8LinearMethod for custom linear layers 9 days ago

enhancement help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

add indirect access for matmul in online softmax 11 days ago

help wanted vllm-spyre-next vllm-spyre-attention-backend

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Add FP8 test infrastructure and reference tests 17 days ago

enhancement help wanted vllm-spyre-next tests

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Implement scaled_mm operator support in torch-spyre about 1 month ago

enhancement help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Evaluate whether vLLM IR can be used to wrap layers for torch-spyre about 1 month ago

good first issue vllm-spyre-next July2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Feature]: Configure individual layers on spyre about 1 month ago

enhancement good first issue vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Epic] Ensure that the new plugin is robust to upstream changes about 1 month ago

help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Epic] Develop KVCacheConnector for Spyre about 2 months ago

help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Epic] Support prefill/decode disaggregation about 2 months ago

help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Add FP8 tensor initialization kernels for spyre device about 2 months ago

enhancement help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Support block-wise FP8 quantization about 2 months ago

enhancement help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Support FP8 KV cache for attention about 2 months ago

enhancement help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Support online FP8 quantization (W8A16 dynamic) about 2 months ago

enhancement help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Add FP8 support to ParallelLMHead about 2 months ago

enhancement help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Fix Inductor compatibility for FP8 tensors (torch-spyre #1474) about 2 months ago

enhancement help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Verify the 4D matmul in the attention computation 3 months ago

good first issue vllm-spyre-next June2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Write design docs for key features 3 months ago

good first issue May2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Wrap the ParallelLMHead for torch-spyre 3 months ago

good first issue vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[doc] add a README.md 3 months ago

documentation good first issue

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Open Issues Need Help