kubeflow/trainer v2.3.0 on GitHub

This is Kubeflow Trainer v2.3.0 release.

helm install kubeflow-trainer oci://ghcr.io/kubeflow/charts/kubeflow-trainer \
    --namespace kubeflow-system \
    --create-namespace \
    --version 2.3.0 \
    --set runtimes.defaultEnabled=true

Breaking Changes

feat(runtimes): BREAKING CHANGE: Remove Runtime Finalizers (#3716 by @amirialy)
feat(manifests): BREAKING CHANGE: Move CRD to Helm chart template directory (#3655 by @andreyvelich)
- IMPORTANT: if you are upgrading from Kubeflow Trainer v2.0, v2.1 or v2.2, you must first upgrade to v2.3 before upgrading to any later version. See this migration guide for the details.

🚀 Features

feat: KEP-3562: Introduce OptimizationJob CRD (#3565 by @aniket2405)
feat(runtimes): make MPI launcher depend on worker readiness (#3748 by @andreyvelich)
feat: expose Image and Command on PodSet Container (#3674 by @reckless-sherixx)
feat: move enableHTTP2 setting to Configuration object (#3339 by @krishdef7)
feat: implement runtime snapshot mechanism (KEP-2599) (#3580 by @robert-bell)
feat(initializer): validate initializer Pod uses correct volume name (#3714 by @HarshPopat23)
feat(docs): add theme toggle to top navbar (#3682 by @adityabavadekar)
feat(runtimes): Add label to disable webhook validation for Runtimes (#3683 by @andreyvelich)
feat: add Flux integration and e2e tests (#3561 by @amirialy)
feat(examples): add interactive JAX distributed TPU smoke test notebook (#3531 by @richabanker)
feat(ci): add govulncheck CVE detection workflow for PR checks (#3557 by @ChughShilpa)
feat(docs): add dedicated documentation website (#3308 by @Sridhar1030)
feat: inject PET_* envs into init containers via envInjection config (#3516 by @panpan0000)
feat(ci): automate release process (#3536 by @Krishna-kg732)
feat(api): Add terminationGracePeriodSeconds to PodSpecPatch in TrainJob (#3324 by @krishdef7)
feat(ci): add Python dependency scanning to OSV-Scanner workflow (#3530 by @Fiona-Waters)
feat(ci): add nightly OSV-Scanner vulnerability scan workflow (#3518 by @Fiona-Waters)
feat(docs): KEP-2599: Decouple runtime lifecycle from TrainJobs to simplify updating runtimes (#3428 by @robert-bell)
feat: KEP for inject PET envs into init-container (#3417 by @panpan0000)
feat: storageuri targetjob validation fix (#3510 by @pulkit-999)
feat(docs): add AI policy reference to contributing guide (#3493 by @andreyvelich)
feat(runtimes): add validation for reserved MPI environment variables (#3491 by @adiprathapa)
feat: update k8s to 0.36 (#3470 by @kannon92)
feat: merge gpu-cluster setup into single e2e script via flag (#3281 by @aniket2405)
feat(examples): Add kubectl-friendly YAML examples for TrainJob and TrainingRuntime (#2925 by @NarayanaSabari)
feat(docs): Kubeflow Trainer ROADMAP 2026 (#3242 by @andreyvelich)
feat: add e2e tests to Helm CI workflow (#3253 by @Goku2099)
feat(docs): Add Kubeflow Trainer v2.2 release announcement to README (#3435 by @andreyvelich)
feat: add Megatron-Core GPT Tensor Parallelism example notebook (#3201 by @XploY04)
feat: customize R generation to include GPUs (#3325 by @vsoch)
feat(docs): Changelog for Kubeflow Trainer v2.2.0 (#3369 by @andreyvelich)
feat(api): Set RuntimePatch.Time field automatically during admission (#3319 by @astefanutti)

🐛 Bug Fixes

[release-2.3] fix(operator): improve status server bearer token parsing and add helper tests (#3831 by @google-oss-robot)
[release-2.3] fix(ci): Update Kubeflow SDK installation for E2Es (#3827 by @google-oss-robot)
[release-2.3] fix(ci): Remove concurrency from Helm publish action (#3793 by @google-oss-robot)
fix(ci): Publish Helm Charts in release workflow (#3789 by @google-oss-robot)
[release-2.3] fix(ci): Publish images during the GitHub release workflow (#3786 by @google-oss-robot)
fix(runtimes): propagate PodSets.Count into TemplateSpec Parallelism/Completions (#3651 by @h0pers)
fix(runtimes): merge resourcesPerNode with Runtime container resources (#3602 by @Sridhar1030)
fix: correct typos in AGENTS.md and deepspeed example notebook (#3765 by @ZhongJinHacker)
fix(api): increase the length limit on train job commands and args (#3689 by @robert-bell)
fix(docs): update Trainer documentation links (#3711 by @h0pers)
fix(operator): honor managedBy field in TrainJob reconciler (#3681 by @kaisoz)
fix(docs): add favicon, remove year from copyright (#3679 by @Sridhar1030)
fix(docs): restyle top nav and moved ads to footer (#3656 by @Sridhar1030)
fix(runtimes): set defaultMode on MPI SSH Secret volume (#3649 by @h0pers)
fix: do not declare webhook cert data in Helm chart Secret (#3627 by @andreyvelich)
fix(docs): improve top nav light mode contrast and add hero logo (#3625 by @Sridhar1030)
fix(ci): Fix the release workflow updates (#3623 by @andreyvelich)
fix(ci): Update Python API models version in make release (#3603 by @andreyvelich)
fix(cache): use status code (not identity) to detect Service AlreadyExists (#3507 by @1fanwang)
fix(ci): Guard git-cliff against empty user names (#3597 by @andreyvelich)
fix(ci): Fix git-cliff for patch release Changelog (#3591 by @andreyvelich)
fix(operator): guard against nil trainer PodSet in JAX EnforceMLPolicy (#3563 by @immanuwell)
fix: apply clientConnection QPS/burst to the manager client (#3432 by @abhijeet-dhumal)
fix: use the CI image in helm e2e tests (#3588 by @robert-bell)
fix: migrate to newer name for cncf runners (#3556 by @jaiakash)
fix(operator): support multi-replica endpoint generation in IdentifyP… (#3539 by @fedebongio)
fix(examples): use namespaced SQuAD dataset (#3560 by @XploY04)
fix(runtimes): add validation for LoRA multi-node and immutable trainer args (#3302 by @krishdef7)
fix(cache): validate cache_index schema collisions in worker dat… (#3216 by @Hitanshi7556)
fix: remove unnecessary setcap CAP_NET_BIND_SERVICE from MPI runtime docker file (#3286 by @kapil27)
fix(api): allow atomic RuntimePatches update on unsuspend (#3469 by @NarayanaSabari)
fix(manifests): Use released version for JobSet and LWS images (#3452 by @andreyvelich)
fix(examples): unblock Megatron TP notebook on GPU E2E (#3434 by @XploY04)
fix(ci): Bump Python to 3.12 in E2Es (#3330 by @andreyvelich)
fix: use global rank for dataset download guard in container backend notebook (#3418 by @Fiona-Waters)
fix(initializer): add missing glob wildcard to .pt and .pth ignore p… (#3307 by @ghazariann)
fix(ci): re-enable XGBoost E2E test (#3323 by @Krishna-kg732)
fix(examples): Verify TrainJob Completion (#3331 by @andreyvelich)
fix(docs): Update steps in release document (#3335 by @andreyvelich)
fix: back to a10-1 for gpu e2e and time slicing (#3322 by @jaiakash)
fix(ci): Generate valid release version for Python package (#3333 by @andreyvelich)

⚙️ Miscellaneous Tasks

[release-2.3] chore(api): Remove duplicate TrainJob status patch (#3806 by @google-oss-robot)
chore(deps): bump serde from 1.0.228 to 1.0.229 in /pkg/data_cache (#3777 by @dependabot[bot])
chore(deps): bump tokio from 1.53.0 to 1.53.1 in /pkg/data_cache/test (#3775 by @dependabot[bot])
chore(deps): bump actions/checkout from 7.0.0 to 7.0.1 (#3770 by @dependabot[bot])
chore(deps): bump futures from 0.3.32 to 0.3.33 in /pkg/data_cache (#3776 by @dependabot[bot])
chore(deps): bump hyper from 1.10.1 to 1.11.0 in /pkg/data_cache (#3774 by @dependabot[bot])
chore(deps): bump futures from 0.3.32 to 0.3.33 in /pkg/data_cache/test (#3773 by @dependabot[bot])
chore(deps): bump pypa/gh-action-pypi-publish from 1.14.0 to 1.14.1 (#3772 by @dependabot[bot])
chore(deps): bump serde from 1.0.228 to 1.0.229 in /pkg/data_cache/test (#3771 by @dependabot[bot])
chore(deps): bump tokio from 1.53.0 to 1.53.1 in /pkg/data_cache (#3769 by @dependabot[bot])
chore(deps): bump clap from 4.6.2 to 4.6.3 in /pkg/data_cache/test (#3768 by @dependabot[bot])
chore(deps): bump actions/setup-python from 6.3.0 to 7.0.0 (#3767 by @dependabot[bot])
chore(deps): bump github.com/go-logr/logr from 1.4.3 to 1.4.4 (#3766 by @dependabot[bot])
chore(deps): bump async-trait from 0.1.89 to 0.1.91 in /pkg/data_cache (#3778 by @dependabot[bot])
chore(deps): Bump PyTorch to 2.13 and CUDA to 13.0 version (#3780 by @andreyvelich)
chore(deps): bump kubernetes from 36.0.0 to 36.0.3 in /cmd/initializers/dataset (#3761 by @dependabot[bot])
chore(deps): bump opendal from 0.47.1 to 0.47.3 in /cmd/initializers/model (#3760 by @dependabot[bot])
chore(deps): bump opendal from 0.47.1 to 0.47.3 in /cmd/initializers/dataset (#3759 by @dependabot[bot])
chore(deps): bump bytes from 1.12.0 to 1.12.1 in /pkg/data_cache/test (#3726 by @dependabot[bot])
chore(deps): bump mpioperator/base from v0.8.0 to v0.8.2 in /cmd/runtimes/deepspeed (#3705 by @dependabot[bot])
chore(deps): bump aiohttp from 3.13.5 to 3.14.1 in /cmd/initializers/dataset (#3763 by @dependabot[bot])
chore(deps): bump tokio from 1.52.3 to 1.53.0 in /pkg/data_cache (#3758 by @dependabot[bot])
chore(deps): bump tokio from 1.52.3 to 1.53.0 in /pkg/data_cache/test (#3756 by @dependabot[bot])
chore(deps): bump huggingface-hub from 1.14.0 to 1.24.0 in /cmd/initializers/dataset (#3753 by @dependabot[bot])
chore(deps): bump actions/stale from 10.3.0 to 10.4.0 (#3730 by @dependabot[bot])
chore(deps): bump mpioperator/base from v0.8.0 to v0.8.2 in /cmd/runtimes/mlx (#3706 by @dependabot[bot])
chore(deps): bump docker/login-action from 4.2.0 to 4.4.0 (#3731 by @dependabot[bot])
chore(deps): bump github/codeql-action/upload-sarif from 4.37.0 to 4.37.1 (#3751 by @dependabot[bot])
chore(deps): bump actions/setup-go from 6.5.0 to 7.0.0 (#3757 by @dependabot[bot])
chore(deps): bump transformers from 5.13.1 to 5.14.1 in /cmd/runtimes/deepspeed (#3755 by @dependabot[bot])
chore(deps): bump actions/github-script from 7.0.1 to 9.0.0 (#3754 by @dependabot[bot])
chore(deps): bump clap from 4.6.1 to 4.6.2 in /pkg/data_cache/test (#3752 by @dependabot[bot])
chore(deps): bump huggingface-hub from 1.14.0 to 1.24.0 in /cmd/initializers/model (#3762 by @dependabot[bot])
chore: migrate Python dependency locking from pip-tools to uv (#3747 by @Sridhar1030)
chore(deps): bump serde_with from 3.16.1 to 3.21.0 in /pkg/data_cache (#3742 by @dependabot[bot])
chore(deps): bump bytes from 1.12.0 to 1.12.1 in /pkg/data_cache (#3735 by @dependabot[bot])
chore: add TrainJob progress documentation (#3624 by @reckless-sherixx)
chore(deps): bump hyper from 1.9.0 to 1.10.1 in /pkg/data_cache (#3576 by @dependabot[bot])
chore(deps): bump the kubernetes group across 1 directory with 11 updates (#3722 by @dependabot[bot])
chore(deps): bump sentencepiece from 0.2.1 to 0.2.2 in /cmd/runtimes/deepspeed (#3733 by @dependabot[bot])
chore(deps): bump rust from 1.96-bullseye to 1.97-bullseye in /cmd/data_cache (#3727 by @dependabot[bot])
chore(deps): bump github/codeql-action/upload-sarif from 4.36.2 to 4.37.0 (#3724 by @dependabot[bot])
chore(deps): bump github.com/coreos/go-oidc/v3 from 3.19.0 to 3.20.0 (#3721 by @dependabot[bot])
chore(deps): bump golang.org/x/crypto from 0.53.0 to 0.54.0 in the golang group (#3720 by @dependabot[bot])
chore(deps): bump transformers from 5.13.0 to 5.13.1 in /cmd/runtimes/deepspeed (#3732 by @dependabot[bot])
chore(deps): bump softprops/action-gh-release from 3.0.1 to 3.0.2 (#3728 by @dependabot[bot])
chore(deps): bump actions/checkout from 6.0.3 to 7.0.0 (#3645 by @dependabot[bot])
chore(deps): bump torch from 2.12.0 to 2.13.0 in /cmd/runtimes/deepspeed (#3644 by @dependabot[bot])
chore(deps): bump github.com/onsi/gomega from 1.42.0 to 1.42.1 (#3658 by @dependabot[bot])
chore(deps): bump actions-rust-lang/setup-rust-toolchain from 1.16.1 to 1.17.0 (#3662 by @dependabot[bot])
chore(deps): bump actions/setup-python from 5.6.0 to 6.3.0 (#3659 by @dependabot[bot])
chore(deps): bump bytes from 1.11.1 to 1.12.0 in /pkg/data_cache (#3642 by @dependabot[bot])
chore(deps): bump deepspeed from 0.19.1 to 0.19.2 in /cmd/runtimes/deepspeed (#3639 by @dependabot[bot])
chore(deps): bump actions/github-script from 8.0.0 to 9.0.0 (#3637 by @dependabot[bot])
chore(deps): bump bytes from 1.11.1 to 1.12.0 in /pkg/data_cache/test (#3636 by @dependabot[bot])
chore(deps): bump github.com/coreos/go-oidc/v3 from 3.18.0 to 3.19.0 (#3634 by @dependabot[bot])
chore(deps): bump github.com/onsi/ginkgo/v2 from 2.31.0 to 2.32.0 (#3633 by @dependabot[bot])
chore(deps): bump actions/setup-go from 6.4.0 to 6.5.0 (#3660 by @dependabot[bot])
chore(deps): Bump JobSet to v0.12.0 and update SMP (#3709 by @andreyvelich)
chore(deps): bump transformers from 5.12.1 to 5.13.0 in /cmd/runtimes/deepspeed (#3707 by @dependabot[bot])
chore(ci): skip image builds and E2E tests for docs-only changes (#3699 by @adityabavadekar)
chore(test): refactor TestFlux to use wantInfo to match MPI plugin (#3601 by @roberthluo)
chore(docs): Update release doc with milestone applier (#3663 by @andreyvelich)
chore(test): add unit tests for TorchTune plugin helpers (#3599 by @YassinNouh21)
chore(test): add helm unit tests for torchtune llama3.2-1b runtime (#3630 by @YassinNouh21)
chore(ci): pin all GitHub Actions to immutable SHA digests (#3631 by @christian-heusel)
chore(docs): Move KEPs to the proposals directory (#3629 by @andreyvelich)
chore(docs): Add targeted-file lint/format commands to AGENTS.md (#3554 by @ChughShilpa)
chore(deps): bump actions/setup-go from 5 to 6 (#3610 by @dependabot[bot])
chore(deps): bump transformers from 5.12.0 to 5.12.1 in /cmd/runtimes/deepspeed (#3608 by @dependabot[bot])
chore(deps): bump github.com/onsi/ginkgo/v2 from 2.29.0 to 2.31.0 (#3605 by @dependabot[bot])
chore(deps): bump actions/checkout from 4 to 6 (#3607 by @dependabot[bot])
chore(deps): bump arrow-flight from 58.3.0 to 59.0.0 in /pkg/data_cache/test (#3611 by @dependabot[bot])
chore(deps): bump actions/download-artifact from 4 to 8 (#3617 by @dependabot[bot])
chore(deps): bump softprops/action-gh-release from 2 to 3 (#3615 by @dependabot[bot])
chore(deps): bump actions/upload-artifact from 4 to 7 (#3614 by @dependabot[bot])
chore(deps): bump github.com/onsi/gomega from 1.41.0 to 1.42.0 (#3606 by @dependabot[bot])
chore: Add CODE_OF_CONDUCT.md in kubeflow/trainer (#3596 by @codeurluce)
chore(deps): bump transformers from 5.10.1 to 5.12.0 in /cmd/runtimes/deepspeed (#3585 by @dependabot[bot])
chore(deps): bump nvidia/cuda from 13.2.1-devel-ubuntu22.04 to 13.3.0-devel-ubuntu22.04 in /cmd/runtimes/deepspeed (#3582 by @dependabot[bot])
chore(deps): bump datasets from 4.8.5 to 5.0.0 in /cmd/runtimes/mlx (#3584 by @dependabot[bot])
chore(deps): bump golang.org/x/crypto from 0.52.0 to 0.53.0 in the golang group (#3581 by @dependabot[bot])
chore(deps): bump nvidia/cuda from 13.2.1-devel-ubuntu22.04 to 13.3.0-devel-ubuntu22.04 in /cmd/runtimes/mlx (#3583 by @dependabot[bot])
chore(deps): bump datasets from 4.8.5 to 5.0.0 in /cmd/runtimes/deepspeed (#3586 by @dependabot[bot])
chore(deps): bump transformers from 5.8.0 to 5.10.1 in /cmd/runtimes/deepspeed (#3571 by @dependabot[bot])
chore(deps): bump deepspeed from 0.19.0 to 0.19.1 in /cmd/runtimes/deepspeed (#3569 by @dependabot[bot])
chore(deps): update kagglehub requirement from <1.0.0 to <2.0.0 in /cmd/trainers/torchtune (#3568 by @dependabot[bot])
chore(deps): bump rust from 1.95-bullseye to 1.96-bullseye in /cmd/data_cache (#3567 by @dependabot[bot])
chore(deps): bump golang.org/x/crypto from 0.51.0 to 0.52.0 in the golang group across 1 directory (#3542 by @dependabot[bot])
chore(deps): bump github.com/onsi/ginkgo/v2 from 2.28.3 to 2.29.0 (#3520 by @dependabot[bot])
chore(deps): bump torch from 2.11.0 to 2.12.0 in /cmd/runtimes/deepspeed (#3527 by @dependabot[bot])
chore(deps): bump mpi4py from 4.1.1 to 4.1.2 in /cmd/runtimes/deepspeed (#3525 by @dependabot[bot])
chore(deps): bump github.com/onsi/gomega from 1.40.0 to 1.41.0 (#3519 by @dependabot[bot])
chore(scripts): add copyright boilerplate verification (#3359 by @tariq-hasan)
chore(deps): bump tokio from 1.52.2 to 1.52.3 in /pkg/data_cache/test (#3497 by @dependabot[bot])
chore: rename lifecycle/needs-triage to needs-triage in issue templates (#3512 by @abhijeet-dhumal)
chore(deps): update huggingface-hub requirement from <1.14,>=1.13.0 to >=1.14.0,<1.15 in /cmd/initializers/model (#3502 by @dependabot[bot])
chore(deps): bump arrow-flight from 58.2.0 to 58.3.0 in /pkg/data_cache/test (#3503 by @dependabot[bot])
chore(deps): bump tokio from 1.52.2 to 1.52.3 in /pkg/data_cache (#3501 by @dependabot[bot])
chore(deps): bump tonic from 0.14.5 to 0.14.6 in /pkg/data_cache/test (#3500 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.14,>=1.13.0 to >=1.14.0,<1.15 in /cmd/initializers/dataset (#3499 by @dependabot[bot])
chore(deps): bump transformers from 5.7.0 to 5.8.0 in /cmd/runtimes/deepspeed (#3498 by @dependabot[bot])
chore(deps): bump deepspeed from 0.18.9 to 0.19.0 in /cmd/runtimes/deepspeed (#3496 by @dependabot[bot])
chore(deps): bump golang.org/x/crypto from 0.50.0 to 0.51.0 in the golang group (#3495 by @dependabot[bot])
chore(test): add unit tests for trainingruntime and trainjob utilities (#3370 by @codewithyug06)
chore(test): add unit tests for jobset builder (#3490 by @Sridhar1030)
chore(deps): update opendal requirement from >=0.46.0 to >=0.47.1 in /cmd/initializers/model (#3484 by @dependabot[bot])
chore(deps): update opendal requirement from >=0.46.0 to >=0.47.1 in /cmd/initializers/dataset (#3477 by @dependabot[bot])
chore(deps): bump tokio from 1.52.1 to 1.52.2 in /pkg/data_cache (#3483 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.13,>=1.12.0 to >=1.13.0,<1.14 in /cmd/initializers/model (#3480 by @dependabot[bot])
chore(deps): bump tokio from 1.52.1 to 1.52.2 in /pkg/data_cache/test (#3478 by @dependabot[bot])
chore: unit tests for runtime registry and RuntimeInfo error handling (#3168 by @Goku2099)
chore(deps): bump github.com/onsi/ginkgo/v2 from 2.28.2 to 2.28.3 (#3473 by @dependabot[bot])
chore(deps): bump transformers from 5.6.2 to 5.7.0 in /cmd/runtimes/deepspeed (#3479 by @dependabot[bot])
chore(deps): bump arrow-flight from 58.1.0 to 58.2.0 in /pkg/data_cache/test (#3482 by @dependabot[bot])
chore(deps): update kagglehub requirement from >=1.0.0 to >=1.0.1 in /cmd/trainers/torchtune (#3476 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.13,>=1.12.0 to >=1.13.0,<1.14 in /cmd/initializers/dataset (#3481 by @dependabot[bot])
chore(deps): bump go.uber.org/zap from 1.27.1 to 1.28.0 (#3472 by @dependabot[bot])
chore: update golangci-linter and kube-api-linter (#3471 by @kannon92)
chore(deps): update bitsandbytes requirement from >=0.41.1 to >=0.49.2 in /cmd/trainers/torchtune (#3463 by @dependabot[bot])
chore(deps): bump transformers from 5.5.4 to 5.6.2 in /cmd/runtimes/deepspeed (#3462 by @dependabot[bot])
chore(deps): bump hyper from 1.8.1 to 1.9.0 in /pkg/data_cache (#3466 by @dependabot[bot])
chore(deps): bump axum from 0.8.8 to 0.8.9 in /pkg/data_cache (#3468 by @dependabot[bot])
chore(deps): bump datasets from 4.8.4 to 4.8.5 in /cmd/runtimes/deepspeed (#3465 by @dependabot[bot])
chore(deps): bump mlx-lm from 0.31.2 to 0.31.3 in /cmd/runtimes/mlx (#3461 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.12,>=0.27.0 to >=1.12.0,<1.13 in /cmd/initializers/dataset (#3464 by @dependabot[bot])
chore(deps): bump go.opentelemetry.io/otel from 1.36.0 to 1.41.0 (#3450 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.12,>=0.27.0 to >=1.12.0,<1.13 in /cmd/initializers/model (#3460 by @dependabot[bot])
chore(deps): update kagglehub requirement from >=0.4.0 to >=1.0.0 in /cmd/trainers/torchtune (#3459 by @dependabot[bot])
chore(deps): update kubernetes requirement from >=27.2.0 to >=35.0.0 in /cmd/initializers/dataset (#3458 by @dependabot[bot])
chore(deps): bump datasets from 4.8.4 to 4.8.5 in /cmd/runtimes/mlx (#3457 by @dependabot[bot])
chore(deps): bump github.com/onsi/ginkgo/v2 from 2.28.1 to 2.28.2 (#3456 by @dependabot[bot])
chore(deps): bump rustls-webpki from 0.103.12 to 0.103.13 in /pkg/data_cache (#3449 by @dependabot[bot])
chore(deps): bump tokio from 1.50.0 to 1.51.0 in /pkg/data_cache (#3412 by @dependabot[bot])
chore(deps): Bump Go to 1.26 (#3451 by @andreyvelich)
chore(deps): bump rand from 0.8.5 to 0.8.6 in /pkg/data_cache (#3447 by @dependabot[bot])
chore(deps): bump rustls-webpki from 0.103.8 to 0.103.12 in /pkg/data_cache (#3444 by @dependabot[bot])
chore(deps): bump torch from 2.10.0 to 2.11.0 in /cmd/runtimes/deepspeed (#3383 by @dependabot[bot])
chore(deps): bump clap from 4.6.0 to 4.6.1 in /pkg/data_cache/test (#3442 by @dependabot[bot])
chore(deps): bump tokio from 1.51.1 to 1.52.1 in /pkg/data_cache/test (#3440 by @dependabot[bot])
chore(deps): bump nvidia/cuda from 13.2.0-devel-ubuntu22.04 to 13.2.1-devel-ubuntu22.04 in /cmd/runtimes/mlx (#3439 by @dependabot[bot])
chore(deps): bump rust from 1.94-bullseye to 1.95-bullseye in /cmd/data_cache (#3438 by @dependabot[bot])
chore(deps): bump datasets from 4.7.0 to 4.8.4 in /cmd/runtimes/deepspeed (#3384 by @dependabot[bot])
chore(deps): bump deepspeed from 0.18.7 to 0.18.9 in /cmd/runtimes/deepspeed (#3402 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.11,>=0.27.0 to >=0.27.0,<1.12 in /cmd/initializers/dataset (#3443 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.11,>=0.27.0 to >=0.27.0,<1.12 in /cmd/initializers/model (#3441 by @dependabot[bot])
chore(deps): bump nvidia/cuda from 13.2.0-devel-ubuntu22.04 to 13.2.1-devel-ubuntu22.04 in /cmd/runtimes/deepspeed (#3437 by @dependabot[bot])
chore(deps): bump golang.org/x/crypto from 0.48.0 to 0.49.0 in the golang group across 1 directory (#3351 by @dependabot[bot])
chore: Remove Year from copyright (#3276 by @sameerdattav)
chore(examples): Use QuantileDMatrix for histogram tree method in XGBoost example (#3376 by @sunalawa)
chore: added docs for cncf gpu arc (#3218 by @jaiakash)
chore(deps): bump tokio from 1.50.0 to 1.51.1 in /pkg/data_cache/test (#3426 by @dependabot[bot])
chore(deps): bump transformers from 5.4.0 to 5.5.4 in /cmd/runtimes/deepspeed (#3425 by @dependabot[bot])
chore(deps): bump nvidia/cuda from 13.1.1-devel-ubuntu22.04 to 13.2.0-devel-ubuntu22.04 in /cmd/runtimes/deepspeed (#3380 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.10,>=0.27.0 to >=0.27.0,<1.11 in /cmd/initializers/model (#3424 by @dependabot[bot])
chore(deps): bump actions/github-script from 8 to 9 (#3422 by @dependabot[bot])
chore(deps): bump github.com/coreos/go-oidc/v3 from 3.17.0 to 3.18.0 (#3421 by @dependabot[bot])
chore(deps): bump mlx-lm from 0.31.1 to 0.31.2 in /cmd/runtimes/mlx (#3423 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.7,>=0.27.0 to >=0.27.0,<1.10 in /cmd/initializers/model (#3414 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.9,>=0.27.0 to >=0.27.0,<1.10 in /cmd/initializers/dataset (#3415 by @dependabot[bot])
chore(deps): bump github.com/go-jose/go-jose/v4 from 4.1.3 to 4.1.4 (#3406 by @dependabot[bot])
chore(deps): bump transformers from 5.3.0 to 5.4.0 in /cmd/runtimes/deepspeed (#3401 by @dependabot[bot])
chore(deps): bump arrow-flight from 58.0.0 to 58.1.0 in /pkg/data_cache/test (#3398 by @dependabot[bot])
chore(deps): update huggingface-hub requirement from <1.7,>=0.27.0 to >=0.27.0,<1.9 in /cmd/initializers/dataset (#3397 by @dependabot[bot])
chore(deps): bump datasets from 4.7.0 to 4.8.4 in /cmd/runtimes/mlx (#3382 by @dependabot[bot])
chore(deps): bump nvidia/cuda from 13.1.1-devel-ubuntu22.04 to 13.2.0-devel-ubuntu22.04 in /cmd/runtimes/mlx (#3379 by @dependabot[bot])
chore(ci): Remove Trivy Action (#3389 by @andreyvelich)
chore(runtimes): persist runtimes map and expose Runtimes function (#3360 by @kaisoz)
chore(deps): bump lz4_flex from 0.11.5 to 0.11.6 in /pkg/data_cache (#3349 by @dependabot[bot])
chore(deps): bump tracing-subscriber from 0.3.22 to 0.3.23 in /pkg/data_cache/test (#3354 by @dependabot[bot])
chore(deps): bump tracing-subscriber from 0.3.22 to 0.3.23 in /pkg/data_cache (#3357 by @dependabot[bot])
chore(deps): bump github.com/open-policy-agent/cert-controller from 0.15.0 to 0.16.0 (#3352 by @dependabot[bot])
chore(deps): bump sigs.k8s.io/scheduler-plugins from 0.34.1-devel to 0.34.4-devel-sg in the kubernetes group (#3350 by @dependabot[bot])
chore: add timeout-minutes to gpu-e2e-test workflow (#3329 by @Goku2099)

New Contributors

@google-oss-robot made their first contribution in #3831
@github-actions[bot] made their first contribution in #
@h0pers made their first contribution in #3651
@Sridhar1030 made their first contribution in #3602
@aniket2405 made their first contribution in #3565
@ZhongJinHacker made their first contribution in #3765
@reckless-sherixx made their first contribution in #3674
@HarshPopat23 made their first contribution in #3714
@adityabavadekar made their first contribution in #3682
@roberthluo made their first contribution in #3601
@YassinNouh21 made their first contribution in #3599
@richabanker made their first contribution in #3531
@christian-heusel made their first contribution in #3631
@panpan0000 made their first contribution in #3516
@1fanwang made their first contribution in #3507
@codeurluce made their first contribution in #3596
@immanuwell made their first contribution in #3563
@abhijeet-dhumal made their first contribution in #3432
@fedebongio made their first contribution in #3539
@Hitanshi7556 made their first contribution in #3216
@pulkit-999 made their first contribution in #3510
@codewithyug06 made their first contribution in #3370
@adiprathapa made their first contribution in #3491
@NarayanaSabari made their first contribution in #3469
@sunalawa made their first contribution in #3376
@ghazariann made their first contribution in #3307