Avro.jl
Avro.jl copied to clipboard
JuliaData
Pure Julia implementation for reading/writing data in the Avro format
When I try to convert an Arrow file to Avro using this code: ``` function t_arrowtoavro(path, file) a = Arrow.Table(joinpath(path, "$(file).arrow")) |> DataFrame println(Tables.schema(a)) Avro.writetable(joinpath(path, "$(file).avro"), a; compress=:zstd) end ```...
This package hasn't seen any updates in 2 years. Is it still working in 2023? @quinnj it seems you have been responsible for most of the good stuff that has...
hi :) as indicated in the Tables.jl docs, for large dataframes (>10k columns), Tables.Schema stores its values in .storenames and .storedtypes instead of the type parameters. This causes e.g. Avro.writetable...
This is a first prototype at solving #15 I am not sure whether the API is a good choice, but it might be a basis for discussion. Also not sure...
I have a use case where the file I would be writing to or reading from is too large to be in memory. However I only need to access one...
We should probably either move up the project dependency to Julia 1.5 or else workaround the issue that is making all the CI fail. https://github.com/JuliaData/Avro.jl/blob/main/src/types/binary.jl#L151 ``` _ _ _ _(_)_...
I ran into an issue reading one of my own. I think I debugged it, but it would be good for the sake avoiding regressions to test for this going...
