Provides the utilities required to deal with particle track data.
- pegasustools.loading_tracks.collate_tracks_from_ascii(num_processes, source_dir, destination_dir, *, max_parquet_size=2000)¶
Collate the .track.dat files in a directory into ordered files.
- Parameters:
num_processes (int) – The number of processes to use.
source_dir (Path) – The path to the directory with the .track.dat files
destination_dir (Path) – The path with filename where the parquet files should be created. It will be created if it doesn’t exist.
max_parquet_size (int, optional) – The maximum parquet file size in MB. This is only approximate and the actual file size might be smaller to help with load balancing. By default 2000MB
- Return type:
- pegasustools.loading_tracks.collate_tracks_from_binary(num_processes, source_dir, destination_dir, *, restart_collect=False)¶
Collate the .track_mpiio_optimized files in a directory into ordered files.
- Parameters:
num_processes (int) – The number of processes to use.
source_dir (Path) – The path to the directory with the .track_mpiio_optimized files
destination_dir (Path) – The path with filename where the parquet files should be created. It will be created if it doesn’t exist.
restart_collect (bool, optional) – Only run the final collection stage. Intended to be used to restart if the collection step fails due to running out of memory, by default False
- Return type: