usql icon indicating copy to clipboard operation
usql copied to clipboard

are there examples showing how to convert csv to arvo?

Open alexgman opened this issue 6 years ago • 1 comments

are there examples showing how to convert csv to arvo using u-sql?

alexgman avatar Sep 08 '19 19:09 alexgman

I'm not sure whether this applies for u-sql or not, but you can use Azure Data Lake Analytics. There is a sample Avro extractor at https://github.com/Azure/usql/blob/master/Examples/DataFormats/Microsoft.Analytics.Samples.Formats/Avro/AvroExtractor.cs. You can easily adapt the code into an out putter. Another possibility is to fire up an HDInsight cluster on top of your data lake store and use Pig, Hive or Spark.

dylanhernandez1 avatar Apr 08 '23 18:04 dylanhernandez1