Lucas Arruda

icon indicating a website link http://linkedin.com/in/larruda icon indicating an email [email protected]

icon company CI&T icon location Campinas icon location Google Developer Expert - Cloud

Results 2 issues of Lucas Arruda

Upgrades Apache Beam from 2.11 to 2.18.

2.11 is deprecated. 2.19 (latest) fails a single unit test (related to BigQuery Storage API). 2.18 passes all tests (except for 2 Avro related). Let's go for 2.18 for now...

Column does not exist in BatchData when column name has a dot (.) - Spark only

2 comment

**Describe the bug** I'm using a SparkFileSystemDatasource with a CSVAsset (header=True). The csv file has a header line and some column names have dots (e.g. Data.Entrega). GX is not able...