Hannes Miller
Hannes Miller
@flexik Have you considered using the *SchemaInferrer*? ```scala val inferrer = SchemaInferrer(SchemaType.String, SchemaRule("qty", SchemaType.Int, false), SchemaRule(".*_id", SchemaType.Int)) CsvSource("myfile").withSchemaInferrer(inferrer) ``` I take your point though that perhaps if you explicitly pass...
@flexik ok this maybe a bug that was introduced between versions - nevertheless I agree this should match the supplied schema - we will make this a priority for the...
Just to be clear it's *NOT* an EEL bug. Whatever the Parquet exception is...it is propagated up the call stack. In this case I think it gave a number format...
Yeah good point! Here's a good resource: http://goessner.net/articles/JsonPath/
Cool! I am not sure whether we need to honour other Hive dialects such as **Parquet** and **Avro**? I'll investigate this...
You can assign this one to me.
I am fine with this...Yeah I guess its main purpose is for streaming l, but I have used it for ingesting large batches of events (rows) into HDFS. My initial...
*DDL* Display the DDL from create table command for JDBC query: ddl from JDBC with driver=blah, url=jdbc:blah, sql=blah, dialect=Parquet, location=blah, sql=blah partitions=p1:string,p2:int - partitions are specified using the notation *name:type*
*File Compaction* Reduce several small files into a single file for a folder or hive table. Note for *Parquet* or other similar types the new file's schema should be the...
@mycaule Thank you - I have reopened this issue and we will look into this.