Opened 5 years ago

#1584 new enhancement

CarpetIOHDF5 should support extensible datasets

Reported by: Ian Hinder Owned by: Erik Schnetter
Priority: minor Milestone:
Component: Carpet Version: development version
Keywords: Cc:


Currently, CarpetIOHDF5 outputs one dataset per iteration. This makes sense for gridfunctions, as the datasets are typically large and can change shape if there is regridding. However, for grid arrays, the size is fixed from one iteration to the next, and there are often only a few values of interest. This means that output consists of hundreds of separate datasets, all of the same shape, and each with only a handful of elements.

HDF5 supports "extensible datasets" <>. These are datasets which can be extended with new data in some directions after being first created. I propose that CarpetIOHDF5 should support output of grid arrays using this format. Multipole already does this. We would add a dimension for "iteration" and extend the dataset in that dimension when new output is available. This would mean that a grid array could be read from a single dataset, rather than having to loop over all iterations.

Attachments (0)

Change History (0)

Modify Ticket

Change Properties
Set your email in Preferences
as new The owner will remain Erik Schnetter.
Next status will be 'review'.
as The resolution will be set.
to The owner will be changed from Erik Schnetter to the specified user.
Next status will be 'confirmed'.
The owner will be changed from Erik Schnetter to anonymous.

Add Comment

E-mail address and name can be saved in the Preferences.

Note: See TracTickets for help on using tickets.