data_base ❭ isf_data_base ❭ IO ❭ LoaderDumper ❭ dask_to_parquet ❭ load_helper

load_helper¶

data_base.isf_data_base.IO.LoaderDumper.dask_to_parquet.load_helper(savedir, n_partitions, partition, meta=None, columns=None)¶

Load a single partition of a dask dataframe from a parquet file

Parameters:¶

• savedir (str) – Directory where the parquet files are stored

• n_partitions (int) – Number of partitions

• partition (int) – Partition number

• meta (pandas.DataFrame) – Meta information for the dask dataframe

• columns (list) – Columns to load

Returns:¶

Dask dataframe

Return type:¶

dask.dataframe