This is a bug fix release based on Spark 2.4.5. Notable fixes/enhancements include:
- #935: added the container port for exposing Spark metrics in Prometheus data format.
- #914: support customization of Spark driver UI port and ingress configuration.
- #898: fixed how default values of certain fields get applied.
- #876: fix for #868.
- #867: fix for termination time when using sidecars.
- #852: added a new metric on job start latency.
- #847: fix around use of
metricsProperties
andhasPrometheusConfigFile
. - Other fixes and refactoring.