INNER CODE UNIT · Python
evaluate
DeepLabCut/DeepLabCut · deeplabcut/benchmark/__init__.py:46
def evaluate(
include_benchmarks: Container[str] = None,
results: ResultCollection = None,
on_error="return",
) -> ResultCollection:
"""Run evaluation for all benchmarks and methods.
Note that in order for your custom benchmark to be included during
evaluation, the following conditions need to be met:
- The benchmark subclassed one of the benchmark definitions in
in ``benchmark.benchmarks``
- The benchmark is registered by applying the ``@benchmark.register``
decorator to the class
- The benchmark was imported. This is done automatically for all
benchmarks that are defined in submodules or subpackages of the
``benchmark.submissions`` module. For all other locations, make
sure to manually import the packages **before** calling the