goavro icon indicating copy to clipboard operation
goavro copied to clipboard

Allow limiting written block size

Open tanner-bruce opened this issue 4 years ago • 0 comments

When loading Avro files to BigQuery, there is a limit on the maximum size of avro data blocks inside an ocf file. In the BQ case, it's 16MB. goavro should support a MaxBlockLen (number of bytes) config option similar to MaxBlockSize (number of rows)

tanner-bruce avatar Apr 19 '22 16:04 tanner-bruce