How to save org.apache.arrow.vector.VectorSchemaRoot into parquet file in Java API

Open igor-suhorukov opened this issue 3 years ago • 2 comments

Hi team,

Could you please provide info regarding how to save Apache Arrow org.apache.arrow.vector.VectorSchemaRoot into Apache Parquet file in Java API and update related project documentation. This possibility available in CPP and Python API.

Regards, Igor

Jul 31 '22 21:07 igor-suhorukov

Hi @igor-suhorukov,

Unfortunately, writing to Parquet files is not yet supported in Java. You would have to hand-off the data to CPP and use the CPP Dataset API

Aug 02 '22 19:08 lwhite1

@lwhite1 thank your for advice. But it I try this as workaround for https://github.com/apache/arrow/issues/13760 to save Arrow data Vector from JVM based solution in Parquet instead of Arrow file format. But anyway this feature would be useful in future in java based solution for data export like QuestDB database

Aug 03 '22 09:08 igor-suhorukov

Related PR #14151 but it works only from ArrowReader, not from VectorSchemaRoot

Feb 14 '23 10:02 igor-suhorukov