CodecZstd.jl

CodecZstd.jl copied to clipboard

Bumps [julia-actions/cache](https://github.com/julia-actions/cache) from 1 to 2. Release notes Sourced from julia-actions/cache's releases. v2.0.0 Breaking Changes ⚠️ v2.0.0 requires node20. This is a breaking change, because node20 does not support the...

dependabot[bot]

Dictionary Training

4

I'm interested in developing support in this package for building a dictionary using Zstd. I would probably start with making automatically generated bindings via Clang.jl for these headers: https://github.com/facebook/zstd/blob/dev/lib/zdict.h https://github.com/facebook/zstd/blob/dev/lib/zstd.h

mkitti

These changes add a Julian API to create a pre-trained ZSTD dictionary. It also creates an AbstractDict interface to set and get parameters. This is currently in draft form since...

mkitti

``` julia> data = rand(Float32, 1_000_000); julia> io = open("foo", "w"); julia> zio = CodecZstd.ZstdCompressorStream(io); julia> @time write(zio, data) 0.023578 seconds (60.39 k allocations: 2.623 MiB) 4000000 julia> @time write(zio,...

kcajf

It'd be nice to expose additional options that are available on the command line like `--threads`, but it looks a bit more involved than just passing through an extra parameter:...

colinxs

jrevels

random access/seek support

1

ref https://github.com/facebook/zstd/issues/395#issuecomment-492741194 ref https://discourse.julialang.org/t/ann-onda-jl-a-format-for-multi-sensor-multi-channel-lpcm-encodable-recordings/32650/3 I'm not sure if the upstream `zstd`'s seek support is considered stable enough to support here, or what the most desirable interface would be from a...

jrevels

Detect truncated frames to avoid infinite loop

1

Fixes #24 The streaming decompression function will only return zero when a frame is fully decoded and flushed out. If the return value is not an error it will be...

nhz2

Add ZstdFrameCompressor and ZstdFrameDecompressor for non-streaming API

13

Also add ZstdError exception type for more descriptive errors. ZstdError is only implemented for the new compressors. They will be applied to the streaming compressors for a breaking version bump.

mkitti

use TestsForCodecPackages.jl

1

These testing utilities are being deprecated in TranscodingStreams.jl

nhz2