deepdish
deepdish copied to clipboard
Flexible HDF5 saving/loading and other data science tools from the University of Chicago
`spots` dictionary is of mixed types e.g. dictionaries, pandas DataFrames, numbers etc. 
Hi, thanks for this cool library. The following example I took from your readthedocs (https://deepdish.readthedocs.io/en/latest/io.html#class-instances): ```python import deepdish as dd class Foo(dd.util.SaveableRegistry): def __init__(self, x): self.x = x @classmethod def...
Thanks for the great package! Not sure if this is the best place to make this request, but is there any chance you can update the version of `deepdish` on...
This is useful for those cases where one wants to load things directly from memory (e.g. BytesIO) without having to write it out to a file first and load it...
I have been using deepdish to save dictionaries with large amounts of data. I ran into the following issue when attempting to save a particularly large file. I have tried...
When saving files with deepdish, I cannot save in __folders__ (files are ok) containing German umlaut: import deepdish as dd # works dd.io.save(r"D:\Tmp\aeoeue\Test_öäü.h5", {'a': list(range(10))}) # does not work dd.io.save(r"D:\Tmp\äöü\Test_öäü.h5",...
I am trying to use deepdish to store/restore large datasets in the HDF5 format, but `deepdish.io.save` crashes every time the dataset is larger than about 2GB. For example, suppose we...
Hello, I have loaded a MATLAB dataset into Python using scipy.io.loadmat(), and have a dictionary saved in a dictionary named mat. I would like to save this dictionary in HDF5...
There are cases when a developer may not want to save the HDF5 data to local disk. This resolves #30
I have a use-case where I don't want to save the resulting HDF5 data to local disk. Rather, I want to handle the produced data with a stream pattern. In...