check_estimator#

check_estimator(estimator, return_exceptions=True, tests_to_run=None, fixtures_to_run=None, verbose=True, tests_to_exclude=None, fixtures_to_exclude=None)[source]#

Run all tests on one single estimator.

Tests that are run on estimator:

all tests in test_all_estimators all interface compatibility tests from the module of estimator’s scitype

for example, test_all_forecasters if estimator is a forecaster

Parameters
estimatorestimator class or estimator instance
return_exceptionbool, optional, default=True
whether to return exceptions/failures, or raise them

if True: returns exceptions in results if False: raises exceptions as they occur

tests_to_runstr or list of str, optional. Default = run all tests.

Names (test/function name string) of tests to run. sub-sets tests that are run to the tests given here.

fixtures_to_runstr or list of str, optional. Default = run all tests.

pytest test-fixture combination codes, which test-fixture combinations to run. sub-sets tests and fixtures to run to the list given here. If both tests_to_run and fixtures_to_run are provided, runs the union, i.e., all test-fixture combinations for tests in tests_to_run,

plus all test-fixture combinations in fixtures_to_run.

verbosestr, optional, default=True.

whether to print out informative summary of tests run.

tests_to_excludestr or list of str, names of tests to exclude. default = None

removes tests that should not be run, after subsetting via tests_to_run.

fixtures_to_excludestr or list of str, fixtures to exclude. default = None

removes test-fixture combinations that should not be run. This is done after subsetting via fixtures_to_run.

Returns
resultsdict of results of the tests in self

keys are test/fixture strings, identical as in pytest, e.g., test[fixture] entries are the string “PASSED” if the test passed,

or the exception raised if the test did not pass

returned only if all tests pass, or return_exceptions=True

Raises
if return_exception=False, raises any exception produced by the tests directly

Examples

>>> from sktime.forecasting.theta import ThetaForecaster
>>> from sktime.utils.estimator_checks import check_estimator
>>> results = check_estimator(ThetaForecaster, tests_to_run="test_pred_int_tag")
All tests PASSED!
>>> check_estimator(
...    ThetaForecaster, fixtures_to_run="test_score[ThetaForecaster-y:1cols-fh=1]"
... )
All tests PASSED!
{'test_score[ThetaForecaster-y:1cols-fh=1]': 'PASSED'}