kubeflow/trainer

Support local iceberg table with parquet files to local validation and e2es 1 day ago

help wanted good first issue area/data-cache

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Run MPI E2E tests for DeepSpeed and MLX examples 8 days ago

help wanted good first issue area/examples

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

test(statusserver): add unit tests for token parsing and status URL helpers 15 days ago

help wanted good first issue area/testing kind/feature

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Migrate Python dependency management from pip-tools to uv 21 days ago

help wanted good first issue area/engprod

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Implement validations to prevent changing TrainingRuntime 24 days ago

help wanted good first issue kind/feature lifecycle/stale area/webhook

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Move enableHTTP2 setting to config object 24 days ago

help wanted good first issue kind/feature

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Document how to use TrainJob Progress feature 25 days ago

help wanted good first issue kind/feature area/docs

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Remove Finalizer from Runtimes 27 days ago

help wanted good first issue kind/feature area/controller

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Leverage GitHub action arm64 runner 27 days ago

help wanted good first issue kind/feature lifecycle/stale

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Enhanced MPI Support in TrainJob about 1 month ago

help wanted good first issue kind/feature area/controller area/runtimes area/mpi

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

feat(docs): add theme toggle to landing page about 1 month ago

help wanted good first issue kind/feature area/docs

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

[Feature]: PodSet Container to support Image and Command about 1 month ago

help wanted good first issue kind/feature kind/cleanup

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

KEP-2839: Kubeflow Dynamic LLM Trainer Framework about 1 month ago

help wanted good first issue kind/feature area/llm

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

The helpers RuntimeInfo helpers don't handle correctly numNodes about 1 month ago

kind/bug help wanted good first issue area/controller

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Set defaultMode on MPI SSH Secret volume to restrict private key permissions about 1 month ago

help wanted good first issue kind/feature

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

[Testing] Integration and E2E tests for Flux Framework about 2 months ago

help wanted good first issue area/testing

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

[Testing] FluxPolicy Testing run EnforceMLPolicy and Build about 2 months ago

help wanted good first issue area/testing kind/feature

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Support Elastic PyTorch in TrainJob about 2 months ago

help wanted area/api kind/feature area/controller

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Improve Kubeflow Trainer release process 2 months ago

help wanted good first issue area/engprod

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Support KAI Scheduler in Kubeflow Trainer 3 months ago

help wanted good first issue kind/feature area/docs area/controller area/scheduler

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

[Feature]: Add unit tests for core and framework to cover reasonable coverage 3 months ago

help wanted good first issue area/testing kind/feature

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

[Feature]: Implement MPI Environment Variable Validation 3 months ago

help wanted good first issue kind/feature area/mpi

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

"zero-trust" security / networking for training jobs 4 months ago

help wanted good first issue kind/feature lifecycle/stale area/docs

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Fix flaky E2E test in Trainer Notebook examples 4 months ago

help wanted good first issue area/testing

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Chore(Example):Use QuantileDMatrix when hist tree method is used in distributed XGBoost example 5 months ago

kind/enhancement help wanted good first issue area/docs

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

User Guide for XGBoost Runtime 5 months ago

help wanted good first issue area/docs

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

feat: refactor and merge `setup-gpu-cluster` into single script based on flag. 5 months ago

help wanted good first issue kind/feature area/gsoc area/llm

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

chore : Rename JAX and Torch unit tests to be more descriptive 5 months ago

help wanted good first issue area/testing kind/cleanup

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Documentation for Distributed JAX with TrainJob 6 months ago

help wanted good first issue area/docs

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Distributed Tensor Parallelism with Megatron-LM and TrainJob 6 months ago

help wanted good first issue kind/feature area/examples area/llm

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Add unit tests for Trainer Config API 6 months ago

help wanted good first issue area/testing

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Remove applying jobset and lws patches when deploying with kustomize 6 months ago

help wanted good first issue

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

feat(helm): Add support for deploying ClusterTrainingRuntimes via Helm chart 6 months ago

help wanted good first issue kind/feature area/deployment

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Support XGBoost/LightGBM runtime and examples 7 months ago

help wanted good first issue kind/feature area/runtimes

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Add more AI/ML Training Example with Kubeflow Trainer 7 months ago

help wanted good first issue area/examples

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Configure deploying data_cache with helm along with trainer 7 months ago

help wanted good first issue kind/feature area/data-cache

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Introduce torch.compile to all PyTorch examples 7 months ago

help wanted good first issue

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Unable to Access Monitoring Port (Prometheus Metrics) on Kubeflow Trainer Controller Manager 7 months ago

kind/bug help wanted good first issue area/monitoring

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Add welcome workflow for new contributors 8 months ago

help wanted good first issue

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Add PlainML plugin to the MLPolicy guide 9 months ago

help wanted good first issue area/docs

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Volcano integration doesn't account for resourcesPerNode override in the trainjob 9 months ago

kind/bug help wanted good first issue area/controller

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Add Dependabot or Renovate 9 months ago

help wanted good first issue kind/feature area/engprod lifecycle/stale

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Add documentation for using TrainJob with Kueue 9 months ago

help wanted good first issue area/docs

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Add Helm integration tests to GitHub actions workflow 9 months ago

help wanted good first issue area/testing kind/feature lifecycle/stale

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Add a workflow for publishing Helm charts 9 months ago

help wanted good first issue kind/feature area/deployment

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Create Operator Guide for PodTemplateOverrides 10 months ago

help wanted good first issue kind/feature area/docs

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Trainer Config is missing in Helm Charts 10 months ago

kind/bug help wanted good first issue area/deployment

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Support for ResourcesPerNode in DeepSpeed Training Job Containers 10 months ago

help wanted good first issue kind/feature area/controller

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Automated way to generate Kustomize manifests from Helm templates 10 months ago

help wanted good first issue kind/feature lifecycle/stale area/deployment

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Add the Config API for Kubeflow Trainer controller manager 10 months ago

help wanted good first issue area/api kind/feature

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Make RuntimeInfo thread safe 10 months ago

kind/bug help wanted good first issue

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

KEP-2170: Add Kubeflow Trainer Pipeline Framework Concept page to Documentation 11 months ago

help wanted good first issue kind/documentation lifecycle/stale area/docs

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Implement ClusterTrainingRuntimes Deprecation Process 12 months ago

help wanted good first issue kind/feature area/webhook area/runtimes

kubeflow/trainer

2.1K

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go

#ai#distributed#fine-tuning#gpu#huggingface#jax#kubeflow#kubernetes#llm#machine-learning#mlops#python#pytorch#tensorflow#xgboost

Open Issues Need Help