data_baseIOLoaderDumperdask_to_parquet

dask_to_parquet

Save and load dask dataframes to and from Apache parquet format.

Classes

Loader

Load a dask dataframe from a parquet file

Functions

check(obj)

Check whether the object can be saved with this dumper

load_helper(savedir, n_partitions, partition, meta, columns)

Load a single partition of a dask dataframe from a parquet file

save_helper(savedir, delayed_df, n_partitions, partition)

Save a single partition of a dask dataframe to a parquet file

check_df_suitable_for_pq(delayed_df)

-

dump(obj, savedir, schema, client, repartition)

Save a dask dataframe to one or more parquet files.