goavro
goavro copied to clipboard
Allow limiting written block size
When loading Avro files to BigQuery, there is a limit on the maximum size of avro data blocks inside an ocf file. In the BQ case, it's 16MB. goavro should support a MaxBlockLen (number of bytes) config option similar to MaxBlockSize (number of rows)