Changed
- Applied new rules for visualizations. Estimated values will be the color indigo and represented with a dashed line.
Calculated values will be blue and have a solid line. This color coding might be overridden in comparison plots.
Data periods will no longer have different colors, we've added some additional text fields to the plot to indicate the data period. - Cleaned up legends in plots, since there will no longer be a different entry for reference and analysis periods of metrics.
- Removed the lower threshold for default thresholds of the KS and Wasserstein drift detection methods.
Added
- We've added the
business_valuemetric for both estimated and realized binary classification performance. It allows
you to assign a value (or cost) to true positive, true negative, false positive and false negative occurrences.
This can help you track something like a monetary value or business impact of a model as a metric. Read more in the
business value tutorials (estimated
or realized)
or the how it works page.
Fixed
- Sync quickstart of the README with the dedicated quickstart page. (#256)
Thanks @NeoKish! - Fixed incorrect code snippet order in the thresholding tutorial. (#258)
Thanks once more to the one and only @NeoKish! - Fixed broken container build that had sneakily been going on for a while
- Fixed incorrect confidence band color in comparison plots (#259)
- Fixed incorrect titles and missing legends in comparison plots (#264)
- Fixed an issue where numerical series marked as category would cause issues during Chi2 calculation