Felix K Jose

New Airflow version support (1.10.11)

2

Hello, There are a couple of new versions have released than the current supported version (1.10.9) in this docker image. When are we going to have new version support added?

Hello All, I am using spark-submit to submit a job by modifying a nested struct column by adding a new field using withField() Following is the spark-submit command: > spark-submit...

How to configure a different URL than default AWS S3 URL

10

I would like to configure a different S3 URL than default S3 URL (s3.amazonaws.com). But I could not find a configurable directive like s3.bucket, s3.region. Could you provide details on...

How could I persist Object Meta Data along with Object into S3 using the Connector

6

I have requirement that I have to persist the object metadata along with object. So later we could use that in Amazon Athena to do some queries and also avoid...