apache/spark-kubernetes-operator 0.3.0

on GitHub

Apache Spark™ K8s Operator is a subproject of Apache Spark and aims to extend K8s resource manager to manage Apache Spark applications via Operator Pattern. This release includes Apache Spark K8s Operator 0.3.0 (App Version) with Helm chart 1.1.0 (Chart Version).

Notable Features

• Support K8s v1.30, v1.31, v1.32, and v1.33
• Support Apache Spark 3.5 and 4.0
• Support SparkApp and SparkCluster CRDs
  • sparkapplications.spark.apache.org (v1beta1)
  • sparkclusters.spark.apache.org (v1beta1)
• Support HPA for SparkCluster
• Support Artifact Hub
  • https://artifacthub.io/packages/helm/spark-kubernetes-operator/spark-kubernetes-operator/
• Provide various examples

Docker Image

docker pull apache/spark-kubernetes-operator:0.3.0

Install Helm Chart

$ helm repo add spark https://apache.github.io/spark-kubernetes-operator
$ helm repo update
$ helm install spark spark-kubernetes-operator/spark-kubernetes-operator
$ helm list
NAME   NAMESPACE  REVISION UPDATED                            	STATUS   CHART                           APP VERSION
spark  default    1        2025-06-04 11:06:24.61408 -0700 PDT  deployed spark-kubernetes-operator-1.1.0 0.3.0

Full Changelog:

• https://github.com/apache/spark-kubernetes-operator/commits/0.3.0

Resolved Issues

• [SPARK-52205] Release Spark Kubernetes Operator 0.3.0 (v1beta1)
• [SPARK-51953] Support Java 24
• [SPARK-52005] Upgrade Spark build dependency to 4.0.0
• [SPARK-52207] Bump version to 0.3.0-SNAPSHOT in main branch
• [SPARK-52208] Add branch-0.2 to publish_snapshot_*.yml GitHub Action jobs
• [SPARK-52222] Upgrade kubernetes-client to 7.3.0
• [SPARK-52250] Promote Spark CRDs to v1beta1
• [SPARK-52253] Support both v1alpha1 and v1beta1
• [SPARK-52273] Use Apache Spark 4.0.0 docker image instead of 4.0.0-preview2
• [SPARK-52279] Make spark-kubernetes-operator get the official status in Artifact Hub
• [SPARK-52291] Remove nightly info from README.md
• [SPARK-52292] Use super-linter for markdown files
• [SPARK-52295] Add pi-v1alpha1.yaml example
• [SPARK-52296] Add spark-role=operator label
• [SPARK-52297] Add Swift-based SparkPi K8s Job example
• [SPARK-52304] Add pi-with-driver-timeout.yaml example
• [SPARK-52315] Upgrade kubernetes-client version to 7.3.1
• [SPARK-52328] Use apache/spark-connect-swift:pi image
• [SPARK-52342] Upgrade Spark 3 tests to use 3.5.6
• [SPARK-52357] Upgrade Gradle to 8.14.1
• [SPARK-52380] Update GitHub Action YAML file in branch-0.3