scalding icon indicating copy to clipboard operation
scalding copied to clipboard

Parquet ParquetReadSupport passing issue

Open brucedeng opened this issue 9 years ago • 1 comments

I found some issues when I was trying to use macro to generate ParquetReadSupport:

here is the repl. Could there be some bugs in the macro? The ParquetWriteSupport works through. many thanks!

scalding> case class Test( | a: Option[List[Option[String]]] | ) defined class Test

scalding> Macros.caseClassParquetSchema[Test] res8: String = "message Test { optional group a (LIST) { repeated group list { optional binary element; } } } "

scalding> val readSupport = Macros.caseClassParquetReadSupport[Test] :37: error: type mismatch; found : Option[String] required: Option[List[Option[String]]] val readSupport = Macros.caseClassParquetReadSupport[Test]

brucedeng avatar Nov 26 '16 06:11 brucedeng

Did you ever find a solution for this?

jmartone avatar Aug 10 '20 17:08 jmartone