simrun ❭ robust_dask_delayed_execution

robust_dask_delayed_execution¶

Robustly execute all dask.delayed objects in a ManagedFolder

Robust execution here is taken to mean:

• The delayed objects are only executed once.

• File locking is used to ensure each delayed object is only handled by a single process

• The status (["not_started", "started", "finished"]) of the delayed objects is saved during execution.

Classes¶