Breaking Changes:
All Test Presets were renamed.
TestPreset suffix was added to original names:
- NoTargetPerformance -> NoTargetPerformanceTestPreset
- DataQuality -> DataQualityTestPreset
- DataStability -> DataStabilityTestPreset
- DataDrift -> DataDriftTestPreset
- Regression -> RegressionTestPreset
- MulticlassClassification -> MulticlassClassificationTestPreset
- BinaryClassificationTopK -> BinaryClassificationTopKTestPreset
- BinaryClassification -> BinaryClassificationTestPreset
Updates:
Added DataDrift metrics:
- DatasetDriftMetric
- DataDriftTable
- ColumnValuePlot
- TargetByFeaturesTable
Added DataQuality metrics:
- ColumnDistributionMetric
- ColumnQuantileMetric
- ColumnCorrelationsMetric
- ColumnValueListMetric
- ColumnValueRangeMetric
- DatasetCorrelationsMetric
Added DataIntegrity metrics:
- ColumnSummaryMetric
- ColumnMissingValuesMetric
- DatasetSummaryMetric
- DatasetMissingValuesMetric
Added Classification metrics:
- ClassificationQuality
- ClassificationClassBalance
- ClassificationConfusionMatrix
- ClassificationQualityByClass
- ClassificationClassSeparationPlot
- ProbabilityDistribution
- ClassificationRocCurve
- ClassificationPRCurve
- ClassificationPRTable
- ClassificationQualityByFeatureTable
Added Regression metrics:
- RegressionQualityMetric
- RegressionPredictedVsActualScatter
- RegressionPredictedVsActualPlot
- RegressionErrorPlot
- RegressionAbsPercentageErrorPlot
- RegressionErrorDistribution
- RegressionErrorNormality
- RegressionTopErrorMetric
- RegressionErrorBiasTable
Added MetricPresets:
- DataDriftPreset
- DataQualityPreset
- RegressionPreset
- ClassificationPreset
Added New Statistical Tests
- Anderson-Darling test for numerical features
- Cramer Von Mises test for numerical features
- Hellinger distance test for numerical and categorical features
- Mann-Whitney U-rank test for numerical features
- Cressie-Read power divergence test for categorical features