Open Issues Need Help
View All on GitHub enhancement good first issue
PyTorch library for cost-effective, fast and easy serving of MoE models.
Python
#huggingface#inference-engine#large-language-models#llm-inference#mixture-of-experts#pytorch