axolotl-ai-cloud

axolotl-ai-cloud/axolotl

Go ahead and axolotl questions

12.2K stars 1.4K forks 12.2K watchers Python Apache License 2.0

fine-tuning llm

View on GitHub Website

14 Open Issues Need Help Last updated: Jul 8, 2026

Open Issues Need Help

View All on GitHub

Export LoRA Adapters to GGUF via convert_lora_to_gguf.py 8 days ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Async GRPO fails with `num_tiles` when data producer and prefetch are enabled 15 days ago

bug good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

[Feature] Automatic LoRA rank recommendation based on dataset size about 1 month ago

good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

[ Discussion ] NVFP4 LoRA Merge 2 months ago

enhancement help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

TPU/Trainium support 3 months ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Causal LM Eval Failing with Qwen3 Base models + Zero3 Deepspeed 3 months ago

bug help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Loading Large Long-Context SFT Dataset leads to RAM OOM 4 months ago

bug help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Zero loss and nan grad_norm when Flash Attention is enabled 4 months ago

bug help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Use flashoptim Optimizers 7 months ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Packing Support for VLM Training 7 months ago

enhancement help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

deprecate dataset_processes in preference of dataset_num_proc 7 months ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Save De-duplicated Set During Pre-processing 7 months ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

CLI Args should also handle nested options 7 months ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Wrong epoch when turning on `context_parallel_size ` 11 months ago

bug help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm