NannyML/nannyml v0.4.0

on GitHub

Added

• Added support for new metrics in the Confidence Based Performance Estimator (CBPE). It now estimates roc_auc,
  f1, precision, recall, specificity and accuracy.
• Added support for multiclass classification. This includes
  • Specifying multiclass classification metadata + support in automated metadata extraction (by introducing a
    model_type parameter).
  • Support for all CBPE metrics.
  • Support for realized performance calculation using the PerformanceCalculator.
  • Support for all types of drift detection (model inputs, model output, target distribution).
  • A new synthetic toy dataset.

Changed

• Removed the identifier property from the ModelMetadata class. Joining analysis data and
  analysis target values should be done upfront or index-based.
• Added an exclude_columns parameter to the extract_metadata function. Use it to specify the columns that should
  not be considered as model metadata or features.
• All fit methods now return the fitted object. This allows chaining Calculator/Estimator instantiation
  and fitting into a single line.
• Custom metrics are no longer supported in the PerformanceCalculator. Only the predefined metrics remain supported.
• Big documentation revamp: we've tweaked overall structure, page structure and incorporated lots of feedback.
• Improvements to consistency and readability for the 'hover' visualization in the step plots, including consistent
  color usage, conditional formatting, icon usage etc.
• Improved indication of "realized" and "estimated" performance in all CBPE step plots
  (changes to hover, axes and legends)

Fixed

• Updated homepage in project metadata
• Added missing metadata modification to the quickstart
• Perform some additional check on reference data during preprocessing
• Various documentation suggestions (#58)