dasf.ml.inference.loader.base

Classes

BaseLoader

BaseLoader for DL models. When running in a Dask Cluster instantiates a model per worker that will be reused on every subsequent prediction task.

Module Contents

class dasf.ml.inference.loader.base.BaseLoader

BaseLoader for DL models. When running in a Dask Cluster instantiates a model per worker that will be reused on every subsequent prediction task.

model_instances

abstract inference(model, data)

abstract load_model()

Load Model method is specific for each framework/model.

load_model_distributed(**kwargs)

Distributed model instantiation

_lazy_load(**kwargs)

_load(**kwargs)

_lazy_load_cpu(**kwargs)

_lazy_load_gpu(**kwargs)

_load_cpu(**kwargs)

_load_gpu(**kwargs)

load(**kwargs)

predict(data)

Predict method called on prediction tasks.

preprocessing(data)

Preprocessing stage which is called before inference

postprocessing(data)

Postprocessing stage which is called after inference