SimpleModelComparison.run#
- SimpleModelComparison.run(train_dataset: VisionData, test_dataset: VisionData, model: Optional[Module] = None, model_name: str = '', scorers: Optional[Mapping[str, Metric]] = None, scorers_per_class: Optional[Mapping[str, Metric]] = None, device: Optional[Union[str, device]] = None, random_state: int = 42, n_samples: Optional[int] = 10000, with_display: bool = True, train_predictions: Optional[Dict[int, Union[Sequence[Tensor], Tensor]]] = None, test_predictions: Optional[Dict[int, Union[Sequence[Tensor], Tensor]]] = None, train_properties: Optional[Dict[int, Dict[PropertiesInputType, Dict[str, Any]]]] = None, test_properties: Optional[Dict[int, Dict[PropertiesInputType, Dict[str, Any]]]] = None) CheckResult[source]#
Run check.
- Parameters
- train_dataset: VisionData
VisionData object, representing data an neural network was fitted on
- test_dataset: VisionData
VisionData object, representing data an neural network predicts on
- model: Optional[nn.Module] , default None
pytorch neural network module instance
- model_name: str , default: ‘’
The name of the model
- scorersOptional[Mapping[str, Metric]] , default: None
dict of scorers names to a Metric
- scorers_per_classOptional[Mapping[str, Metric]] , default: None
dict of scorers for classification without averaging of the classes. See <a href= “https://scikit-learn.org/stable/modules/model_evaluation.html#from-binary-to-multiclass-and-multilabel”> scikit-learn docs</a>
- deviceUnion[str, torch.device], default: ‘cpu’
processing unit for use
- random_stateint
A seed to set for pseudo-random functions
- n_samplesOptional[int], default: None
number of samples
- with_displaybool , default: True
flag that determines if checks will calculate display (redundant in some checks).
- train_predictions: Optional[Dict[int, Union[Sequence[torch.Tensor], torch.Tensor]]] , default None
Dictionary of the model prediction over the train dataset (keys are the indexes).
- test_predictions: Optional[Dict[int, Union[Sequence[torch.Tensor], torch.Tensor]]] , default None
Dictionary of the model prediction over the test dataset (keys are the indexes).