dasf.ml.inference.loader.base

Classes

BaseLoader

BaseLoader for DL models. When running in a Dask Cluster instantiates a model per worker that will be reused on every subsequent prediction task.

Module Contents

class dasf.ml.inference.loader.base.BaseLoader

BaseLoader for DL models. When running in a Dask Cluster instantiates a model per worker that will be reused on every subsequent prediction task.

abstract inference(model, data)

abstract load_model()

Load Model method is specific for each framework/model.

load_model_distributed(**kwargs)

Distributed model instantiation

_lazy_load(**kwargs)

_load(**kwargs)

_lazy_load_cpu(**kwargs)

_lazy_load_gpu(**kwargs)

_load_cpu(**kwargs)

_load_gpu(**kwargs)

load(**kwargs)

predict(data)

Predict method called on prediction tasks.

preprocessing(data)

Preprocessing stage which is called before inference

abstract inference(model, data)

Inference method, receives model and input data

postprocessing(data)

Postprocessing stage which is called after inference