DataDuplicates#
- class DataDuplicates[source]#
Checks for duplicate samples in the dataset.
- Parameters
- columnsUnion[Hashable, List[Hashable]] , default: None
List of columns to check, if none given checks all columns Except ignored ones.
- ignore_columnsUnion[Hashable, List[Hashable]] , default: None
List of columns to ignore, if none given checks based on columns variable.
- n_to_showint , default: 5
number of most common duplicated samples to show.
- n_samplesint , default: 10_000_000
number of samples to use for this check.
- random_stateint, default: 42
random seed for all check internals.
- __init__(columns: Optional[Union[Hashable, List[Hashable]]] = None, ignore_columns: Optional[Union[Hashable, List[Hashable]]] = None, n_to_show: int = 5, n_samples: int = 10000000, random_state: int = 42, **kwargs)[source]#
- __new__(*args, **kwargs)#
Methods
|
Add new condition function to the check. |
Add condition - require duplicate ratio to be less or equal to max_ratio. |
|
Remove all conditions from this check instance. |
|
Run conditions on given result. |
|
|
Return check configuration (conditions' configuration not yet supported). |
|
Return check object from a CheckConfig object. |
|
Deserialize check instance from JSON string. |
|
Return check metadata. |
Name of class in split camel case. |
|
|
Return parameters to show when printing the check. |
Remove given condition by index. |
|
|
Run check. |
|
Run check. |
|
Serialize check instance to JSON string. |
