ddalcu/mlx-serve

[Feature Request] MLX Core: Auto-restart the server after an unexpected crash (with backoff) 7 days ago

enhancement help wanted UI

1.2K

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

Zig

#agent#anthropic-api#apple-silicon#claude-code#deepseek-v4#diffusion#gguf#image-generation#inference#llm#local-llm#macos#macos-app#mlx#openai-api#tool-calling#video-generation#voice-agent#voice-cloning#zig

H3: is there a supported way to chain windows with REF2VA references? (chained windows + ref_images are mutually exclusive) 7 days ago

enhancement help wanted engine

ddalcu/mlx-serve

1.2K

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

Zig

#agent#anthropic-api#apple-silicon#claude-code#deepseek-v4#diffusion#gguf#image-generation#inference#llm#local-llm#macos#macos-app#mlx#openai-api#tool-calling#video-generation#voice-agent#voice-cloning#zig

Feature request: unload models after idle timeout 10 days ago

enhancement help wanted

ddalcu/mlx-serve

1.2K

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

Zig

#agent#anthropic-api#apple-silicon#claude-code#deepseek-v4#diffusion#gguf#image-generation#inference#llm#local-llm#macos#macos-app#mlx#openai-api#tool-calling#video-generation#voice-agent#voice-cloning#zig

Open Issues Need Help