compressed-vec
compressed-vec copied to clipboard
SIMD Floating point and integer compressed vector library
The code below fails on the last assert: `assert_eq!(sink.values, input);`. It seems like the last 8 `u64` values are not written to the sink. Other inputs (e.g. the commented out...
Hello, use compressed_vec::VectorU64Appender; use compressed_vec::VectorReader; let data: Vec = (0..100000).collect(); let mut appender = VectorU64Appender::try_new(data.len()).unwrap(); let result = appender.encode_all(data.clone()).unwrap(); let reader = VectorReader::::try_new(&result[..]).unwrap(); let result: Vec = reader.iterate().collect(); assert_eq!(data, result);...
It will be very useful if the compressed vec can be serialized using serde, which is beneficial when the vector needs to be transferred over limited bandwidth network for example.
packed_simd is now again being published under its original name.
I used the below code to compression vector with f32. But its not providing even 50% compression. Following are the data for a vector with 256 as dimension. original size...
I'm looking at this library for one of my projects, and one requirement is periodic sync of vectors to storage. We have`.finish()`, but we don't have a constructor which takes...