Features
- Upgrade to Spark 3.5.5 (#2490 by @jacobsalway)
- Add timeZone to ScheduledSparkApplication (#2471 by @jacobsalway)
- Enable the override of MemoryLimit through webhook (#2478 by @danielrsfreitas)
- Add ShuffleTrackingEnabled to DynamicAllocation struct to allow disabling shuffle tracking (#2511 by @jbhalodia-slack)
- Define SparkApplicationSubmitter interface to allow customizing submitting mechanism (#2500 by @ChenYi015)
- Add support for using cert manager to generate webhook certificates (#2373 by @ChenYi015)
Bug Fixes
- fix: add webhook cert validity checking (#2489 by @teejaded)
- fix and add back unit tests (#2532 by @nabuskey)
- fix volcano tests (#2533 by @nabuskey)
- Add v2 to module path (#2515 by @ChenYi015)
- #2525 spark metrics in depends on prometheus (#2529 by @blcksrx)
Misc
- Add APRA AMCOS to adopters (#2485 by @shuch3ng)
- Bump github.com/stretchr/testify from 1.9.0 to 1.10.0 (#2488 by @dependabot[bot])
- Bump github.com/prometheus/client_golang from 1.20.5 to 1.21.1 (#2487 by @dependabot[bot])
- Bump sigs.k8s.io/controller-runtime from 0.20.1 to 0.20.4 (#2486 by @dependabot[bot])
- Deprecating sparkctl (#2484 by @vikas-saxena02)
- Changing image repo from docker.io to ghcr.io (#2483 by @vikas-saxena02)
- Upgrade Golang to 1.24.1 and golangci-lint to 1.64.8 (#2494 by @jacobsalway)
- Bump helm.sh/helm/v3 from 3.16.2 to 3.17.3 (#2503 by @dependabot[bot])
- Add changelog for v2.1.1 (#2504 by @ChenYi015)
- Remove sparkctl (#2466 by @ChenYi015)
- Bump github.com/spf13/viper from 1.19.0 to 1.20.1 (#2496 by @dependabot[bot])
- Bump golang.org/x/net from 0.37.0 to 0.38.0 (#2505 by @dependabot[bot])
- Remove clientset, informer and listers generated by code-generator (#2506 by @ChenYi015)
- Remove v1beta1 API (#2516 by @ChenYi015)
- add unit tests for driver and executor configs (#2521 by @nabuskey)
- Adding securityContext to spark examples (#2530 by @tarekabouzeid)
- Bump github.com/spf13/cobra from 1.8.1 to 1.9.1 (#2497 by @dependabot[bot])
- Bump golang.org/x/mod from 0.23.0 to 0.24.0 (#2495 by @dependabot[bot])
- Adding Manabu to the reviewers (#2522 by @vara-bonthu)
- Bump manusa/actions-setup-minikube from 2.13.1 to 2.14.0 (#2523 by @dependabot[bot])
- Bump k8s.io dependencies to v0.32.5 (#2540 by @ChenYi015)
- Pass the correct LDFLAGS when building the operator image (#2541 by @ChenYi015)