4.24.1 (2023-12-06)
Bugs Fixed
- Fixed
SecurityException
with messagejava.lang.SecurityException: class "org.apache.spark.SparkInternalsBridge$"'s signer information does not match signer information of other classes in the same package
when deploying the Spark connector in Databricks by copying it directly to/databricks/jars
instead of going through the usual deployment APIs or UI-deployment. To fix this issue, instead of using abridge-approach
reflection is used to use the internal API necessary to publish custom metrics. See PR 37934