axolotl-ai-cloud

axolotl-ai-cloud/axolotl

Go ahead and axolotl questions

12.2K stars 1.4K forks 12.2K watchers Python Apache License 2.0

fine-tuning llm

View on GitHub Website

15 Open Issues Need Help Last updated: Jul 8, 2026

Open Issues Need Help

View All on GitHub

Export LoRA Adapters to GGUF via convert_lora_to_gguf.py 12 days ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

TPU/Trainium support 27 days ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

FSDP2: cpu_ram_efficient_loading + activation_checkpointing crashes with "neither a parameter nor a buffer" about 1 month ago

bug help wanted good second issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Async GRPO fails with `num_tiles` when data producer and prefetch are enabled 2 months ago

bug good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

[Feature] Automatic LoRA rank recommendation based on dataset size 3 months ago

good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

[ Discussion ] NVFP4 LoRA Merge 4 months ago

enhancement help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Causal LM Eval Failing with Qwen3 Base models + Zero3 Deepspeed 5 months ago

bug help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Loading Large Long-Context SFT Dataset leads to RAM OOM 5 months ago

bug help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Zero loss and nan grad_norm when Flash Attention is enabled 5 months ago

bug help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Use flashoptim Optimizers 8 months ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Packing Support for VLM Training 8 months ago

enhancement help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

deprecate dataset_processes in preference of dataset_num_proc 8 months ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Save De-duplicated Set During Pre-processing 9 months ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

CLI Args should also handle nested options 9 months ago

enhancement good first issue

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm

Wrong epoch when turning on `context_parallel_size ` about 1 year ago

bug help wanted

axolotl-ai-cloud/axolotl

12.2K

Go ahead and axolotl questions

Python

#fine-tuning#llm