model_evaluation#

Module containing the model evaluation checks in the nlp package.

Classes

SingleDatasetPerformance

Summarize given model performance on a dataset based on selected scorers.

MetadataSegmentsPerformance

Search for segments with low performance scores.

PropertySegmentsPerformance

Search for segments with low performance scores.

PredictionDrift

Calculate prediction drift between train dataset and test dataset, using statistical measures.

ConfusionMatrixReport

Calculate the confusion matrix of the model on the given dataset.

TrainTestPerformance

Summarize given model performance on the train and test datasets based on selected scorers.