huggingface

huggingface/nanotron

Minimalistic large language model 3D-parallelism training

2.8K stars 325 forks 2.8K watchers Python Apache License 2.0

4 Open Issues Need Help Last updated: Jul 28, 2026

Open Issues Need Help

View All on GitHub

[Feature] Use CUDA event for measuring elasped time 3 days ago

enhancement good first issue help wanted

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python

[Feature] Refactor `ParallelContext.world_rank_matrix` 27 days ago

enhancement good first issue help wanted

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python

[Bug] Missing `_is_using_mup` when resume checkpoint about 2 months ago

bug good first issue help wanted

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python

Avoid nested `InheritFromOtherOptimizer` 12 months ago

good first issue help wanted Low Priority

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python