SingleDatasetPerformance

class SingleDatasetPerformance

Calculate performance metrics of a given model on a given dataset.

Parameters

scorersUnion[Dict[str, Union[Metric, Callable, str]], List[Any]] = None,

An optional dictionary of scorer name to scorer functions. If none given, using default scorers

__init__(scorers: Optional[Union[Dict[str, Union[Metric, Callable, str]], List[Any]]] = None, **kwargs)

__new__(*args, **kwargs)

Methods

SingleDatasetPerformance.add_condition(name, ...)	Add new condition function to the check.
SingleDatasetPerformance.add_condition_greater_than(...)	Add condition - the result is greater than the threshold.
SingleDatasetPerformance.add_condition_less_than(...)	Add condition - the result is less than the threshold.
SingleDatasetPerformance.clean_conditions()	Remove all conditions from this check instance.
SingleDatasetPerformance.compute(context, ...)	Compute the metric result using the ignite metrics compute method and reduce to a scalar.
SingleDatasetPerformance.conditions_decision(result)	Run conditions on given result.
SingleDatasetPerformance.config()	Return check configuration (conditions' configuration not yet supported).
SingleDatasetPerformance.from_config(conf)	Return check object from a CheckConfig object.
SingleDatasetPerformance.initialize_run(...)	Initialize the metric for the check, and validate task type is relevant.
SingleDatasetPerformance.metadata([...])	Return check metadata.
SingleDatasetPerformance.name()	Name of class in split camel case.
SingleDatasetPerformance.params([show_defaults])	Return parameters to show when printing the check.
SingleDatasetPerformance.reduce_output(...)	Return the values of the metrics for the dataset provided in a {metric: value} format.
SingleDatasetPerformance.remove_condition(index)	Remove given condition by index.
SingleDatasetPerformance.run(dataset[, ...])	Run check.
SingleDatasetPerformance.update(context, ...)	Update the metrics by passing the batch to ignite metric update method.

Examples

Single Dataset Performance

previous

SimpleModelComparison.update

next

SingleDatasetPerformance.add_condition