dasf.pipeline

Init module for DASF Pipeline and its features.

Subpackages

dasf.pipeline.executors

Submodules

Classes

`Pipeline`
`PipelinePlugin`

Package Contents

class dasf.pipeline.Pipeline(name, executor=None, verbose=False, callbacks=None)[source]

Parameters:: callbacks (List[PipelinePlugin])

_name

_executor

_verbose

_dag

_dag_table

_dag_g

_logger

_callbacks

register_plugin(plugin)[source]

info()[source]

execute_callbacks(func_name, *args, **kwargs)[source]

Parameters:: func_name (str)

__add_into_dag(obj, func_name, parameters=None, itself=None)

__inspect_element(obj)

add(obj, **kwargs)[source]

visualize(filename=None)[source]

__register_dataset(dataset)

__execute(func, params, name)

get_result_from(obj)[source]

run()[source]

class dasf.pipeline.PipelinePlugin[source]

on_pipeline_start(fn_keys)[source]

on_pipeline_end()[source]

on_task_start(func, params, name)[source]

on_task_end(func, params, name, ret)[source]

on_task_error(func, params, name, exception)[source]