New Features
- Upgrade to Spark 3.5.3 (#2202 by @jacobsalway)
- feat: support archives param for spark-submit (#2256 by @kaka-zb)
- Allow --ingress-class-name to be specified in chart (#2278 by @jacobsalway)
- Update default container security context (#2265 by @ChenYi015)
- Support pod template for Spark 3.x applications (#2141 by @ChenYi015)
Bug Fixes
- Minor fixes to e2e test
maketargets (#2242 by @Tom-Newton) - Added off heap memory to calculation for YuniKorn gang scheduling (#2209 by @guangyu-yang-rokt)
- Add permissions to controller serviceaccount to list and watch ingresses (#2246 by @tcassaert)
- Make sure enable-ui-service flag is set to false when controller.uiService.enable is set to false (#2261 by @Roberdvs)
omitemptycorrections (#2255 by @Tom-Newton)- Fix retries (#2241 by @Tom-Newton)
Misc
- remove redundant test.sh file (#2243 by @ChenYi015)
- Bump github.com/aws/aws-sdk-go-v2/config from 1.27.42 to 1.27.43 (#2252 by @dependabot[bot])
- Bump manusa/actions-setup-minikube from 2.12.0 to 2.13.0 (#2247 by @dependabot[bot])
- Bump golang.org/x/net from 0.29.0 to 0.30.0 (#2251 by @dependabot[bot])
- Bump aquasecurity/trivy-action from 0.24.0 to 0.27.0 (#2248 by @dependabot[bot])
- Bump gocloud.dev from 0.39.0 to 0.40.0 (#2250 by @dependabot[bot])
- Add Quick Start guide to README (#2259 by @jacobsalway)
- Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.63.3 to 1.65.3 (#2249 by @dependabot[bot])
- Add release badge to README (#2263 by @jacobsalway)
- Bump helm.sh/helm/v3 from 3.16.1 to 3.16.2 (#2275 by @dependabot[bot])
- Bump github.com/prometheus/client_golang from 1.20.4 to 1.20.5 (#2274 by @dependabot[bot])
- Bump cloud.google.com/go/storage from 1.44.0 to 1.45.0 (#2273 by @dependabot[bot])
- Run e2e tests with Kubernetes version matrix (#2266 by @jacobsalway)
- Bump aquasecurity/trivy-action from 0.27.0 to 0.28.0 (#2270 by @dependabot[bot])
- Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.65.3 to 1.66.0 (#2271 by @dependabot[bot])
- Bump github.com/aws/aws-sdk-go-v2/config from 1.27.43 to 1.28.0 (#2272 by @dependabot[bot])
- Add workflow for releasing sparkctl binary (#2264 by @ChenYi015)