StringMismatchComparison#
- class StringMismatchComparison[source]#
Detect different variants of string categories between the same categorical column in two datasets.
This check compares the same categorical column within a dataset and baseline and checks whether there are variants of similar strings that exists only in dataset and not in baseline. Specifically, we define similarity between strings if they are equal when ignoring case and non-letter characters. Example: We have a train dataset with similar strings ‘string’ and ‘St. Ring’, which have different meanings. Our tested dataset has the strings ‘string’, ‘St. Ring’ and a new phrase, ‘st. ring’. Here, we have a new variant of the above strings, and would like to be acknowledged, as this is obviously a different version of ‘St. Ring’.
- Parameters
- columnsUnion[Hashable, List[Hashable]] , default: None
Columns to check, if none are given checks all columns except ignored ones.
- ignore_columnsUnion[Hashable, List[Hashable]] , default: None
Columns to ignore, if none given checks based on columns variable
- n_top_columnsint , optional
amount of columns to show ordered by feature importance (date, index, label are first)
- n_samplesint , default: 1_000_000
number of samples to use for this check.
- random_stateint, default: 42
random seed for all check internals.
- __init__(columns: Optional[Union[Hashable, List[Hashable]]] = None, ignore_columns: Optional[Union[Hashable, List[Hashable]]] = None, n_top_columns: int = 10, n_samples: int = 1000000, random_state: int = 42, **kwargs)[source]#
- __new__(*args, **kwargs)#
Methods
|
Add new condition function to the check. |
Add condition - no new variants allowed in test data. |
|
|
Add condition - require new variants' percentage in test data to be less or equal to the threshold. |
Remove all conditions from this check instance. |
|
Run conditions on given result. |
|
Return check configuration (conditions' configuration not yet supported). |
|
Return check object from a CheckConfig object. |
|
Return check metadata. |
|
Name of class in split camel case. |
|
|
Return parameters to show when printing the check. |
Remove given condition by index. |
|
|
Run check. |
|
Run check. |
