Highlight

Fully verified with Java 8, 11, and 17, Scala 2.12, initial support Scala 2.13
Fully verified with Spark 3.1, 3.2, 3.3, and 3.4, initial support Spark 3.5
Fully verified with Flink 1.16, 1.17, and 1.18
New Web UI (experimental)
New Chat engine with OpenAI ChatGPT backend
Major improvements of Spark Batch API, optimized for large-scale job submission (experimental)
Major improvements of Spark AuthZ plugin, including enhanced Iceberg and DSv2 operators support
Major improvements of Flink engine, including YARN Application Mode support
Introducing Atlas hook support in Spark Lineage plugin
Continuously Kyuubi Helm Chart & Spark on K8s improvements

Release Notes