synchronous_ddf_concat

data_base.utils.synchronous_ddf_concat(ddf_path, meta, N, n, scheduler=None)

Concatenate a pickles dask dataframe to a pandas dataframe.

Parameters:
ddf_path : str

path to the dask dataframe

meta : pd.DataFrame

the metadata for the dask dataframe.

N : int

number of chunks

n : int

the chunk to be concatenated

scheduler : str

the scheduler to be used

Returns:

the concatenated dataframe

Return type:

pd.DataFrame