data_baseutilssynchronous_ddf_concat

synchronous_ddf_concat

data_base.utils.synchronous_ddf_concat(ddf_path, meta, N, n, scheduler=None)

Concatenate a pickles dask dataframe to a pandas dataframe.

Parameters:
  • ddf_path (str) – path to the dask dataframe

  • meta (pd.DataFrame) – the metadata for the dask dataframe.

  • N (int) – number of chunks

  • n (int) – the chunk to be concatenated

  • scheduler (str) – the scheduler to be used

Returns:

the concatenated dataframe

Return type:

pd.DataFrame