metric_utils#

Module containing metrics utils for nlp tasks.

Members

get_default_token_scorers([use_avg_defaults])

Return the default scorers for token classification.

validate_scorers(scorers)

Validate the given scorer list.

get_scorer_dict([suffix, mode, scheme])

Return a dict of scorers for token classification.

init_validate_scorers(scorers, ...)

Initialize scorers and return all of them as deepchecks scorers.

infer_on_text_data(scorer, model, data)

Infer using DeepcheckScorer on NLP TextData using an NLP context _DummyModel.