vortex
vortex copied to clipboard
spiraldb
A toolkit for working with compressed array data
Where each boolean is represented as a single byte. This allows zero-copy from formats that use this layout, e.g. Vec
Currently the caller has to specify which adapter to use. But actually, the adapter is dependent on the selected runtime. We should feature flag which adapter is used and bring...
Parent issue for tracking WASM support. - [ ] Take direct dependency on getrandom to fix rand - [x] Remove linkme #292
The current compressor implements a single strategy based on sampling. But it's a bit of a hammer. Encodings have to decide themselves, in isolation, whether they should or shouldn't be...
Umbrella issue for the IPC format. - [x] #182 - [x] #173 - [x] #150 - [ ] Split chunked arrays into batches - [ ] Support stats on ArrayView...
The DType and Scalar crates should both support Serde, FlatBuffer and Protobuf serialisation via features. The current flat buffer build.rs script should be fixed up to check for these features...