Open Issues Need Help
View All on GitHub enhancement good first issue model
A modular, scalable, high-performance training framework for LLMs, VLMs, diffusion, and embodied models.
Python
#ai#diffusion#distributed#dit#infra#llm#lora#megatron#mid-training#pretraining#sft#training#vla#vlm#wan
enhancement good first issue
A modular, scalable, high-performance training framework for LLMs, VLMs, diffusion, and embodied models.
Python
#ai#diffusion#distributed#dit#infra#llm#lora#megatron#mid-training#pretraining#sft#training#vla#vlm#wan
[FEATURE] ECHO: MoE Expert Load Balancing via Online Token Redistribution with Topology-Aware Dispatch Planning 2 months ago
enhancement good first issue
A modular, scalable, high-performance training framework for LLMs, VLMs, diffusion, and embodied models.
Python
#ai#diffusion#distributed#dit#infra#llm#lora#megatron#mid-training#pretraining#sft#training#vla#vlm#wan