Avarok-Cybersecurity

Avarok-Cybersecurity/atlas

Pure Rust Inference Engine

541 stars 79 forks 541 watchers Rust GNU Affero General Public License v3.0

cuda dgx dgx-spark gb10 llm-inference mamba nvfp4 openai-api rust speculative-decoding ssm transformers

View on GitHub Website

2 Open Issues Need Help Last updated: Jul 1, 2026

Open Issues Need Help

View All on GitHub

[feat] Canonical internal chat IR: convert every API surface into one model-agnostic request/response type (unblocks images in tool results) 20 days ago

enhancement good first issue

Avarok-Cybersecurity/atlas

541

Pure Rust Inference Engine

Rust

#cuda#dgx#dgx-spark#gb10#llm-inference#mamba#nvfp4#openai-api#rust#speculative-decoding#ssm#transformers

[feat] Auto-gpu-utilization about 1 month ago

enhancement good first issue

Avarok-Cybersecurity/atlas

541

Pure Rust Inference Engine

Rust

#cuda#dgx#dgx-spark#gb10#llm-inference#mamba#nvfp4#openai-api#rust#speculative-decoding#ssm#transformers