huggingface

huggingface/nanotron

Minimalistic large language model 3D-parallelism training

2.8K stars 325 forks 2.8K watchers Python Apache License 2.0

3 Open Issues Need Help Last updated: Jul 28, 2026

Open Issues Need Help

View All on GitHub

[Feature] Refactor `ParallelContext.world_rank_matrix` 5 days ago

enhancement good first issue help wanted

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python

[Bug] Missing `_is_using_mup` when resume checkpoint 7 days ago

bug good first issue help wanted

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python

Avoid nested `InheritFromOtherOptimizer` 11 months ago

good first issue help wanted Low Priority

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python