performance#

Module contains checks of model performance metrics.

Classes

PerformanceReport

Summarize given scores on a dataset and model.

ConfusionMatrixReport

Calculate the confusion matrix of the model on the given dataset.

RocReport

Calculate the ROC curve for each class.

SimpleModelComparison

Compare given model score to simple model score (according to given model type).

CalibrationScore

Calculate the calibration curve with brier score for each class.

SegmentPerformance

Display performance score segmented by 2 top (or given) features in a heatmap.

RegressionSystematicError

Check the regression systematic error.

RegressionErrorDistribution

Check regression error distribution.

MultiModelPerformanceReport

Summarize performance scores for multiple models on test datasets.

ModelErrorAnalysis

Find features that best split the data into segments of high and low model error.