Epistates/pmetal

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

311 stars 26 forks 311 watchers Rust Other

ai ane apple-silicon deep-learning distillation fine-tuning gguf inference-server llm llm-inference llm-training lora machine-learning macos metal mlx qlora quantization transformers tui

View on GitHub Website

1 Open Issue Need Help Last updated: Sep 10, 2026

Open Issues Need Help

View All on GitHub

Whisper finetune 10 days ago

enhancement good first issue

Epistates/pmetal

311

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

Rust

#ai#ane#apple-silicon#deep-learning#distillation#fine-tuning#gguf#inference-server#llm#llm-inference#llm-training#lora#machine-learning#macos#metal#mlx#qlora#quantization#transformers#tui