❭ API reference ❭ simrun ❭

robust_dask_delayed_execution

Robustly execute all dask.delayed objects in a ManagedFolder

Robust execution here is taken to mean:

  • The delayed objects are only executed once.

  • File locking is used to ensure each delayed object is only handled by a single process

  • The status (["not_started", "started", "finished"]) of the delayed objects is saved during execution.

Classes

RobustDaskDelayedExecution

Execute dask delayed objects in a robust way.