DREAM3D icon indicating copy to clipboard operation
DREAM3D copied to clipboard

gzip support in dream3d file format

Open Micket opened this issue 7 years ago • 1 comments

We develop a tool that outputs synthetic microstructures directly as a *.dream3d data file, and after a bit of debugging, I realized that it was the HDF standard compression of datasets I started using a while back.

I see a drastic decrease in file size with a simple gzip (default compression) turned on (over 50 times smaller!), so it would be a shame if it could not be supported in DREAM3D.

Micket avatar May 07 '18 16:05 Micket

We can look into supporting this in DREAM.3D. Historically HDF5 did not include all the libraries needed for portable compression. By that I mean that some systems had zlib included and some did not which created all sorts of problems when creating a redistributable package. It is probably time to take another look at enabling the compression in HDF5.

imikejackson avatar May 07 '18 16:05 imikejackson