Levi Jiang
Levi Jiang
> Might be looked into already, but is there any spec changes between 1.2 to 1.5? also can we do a staging test before merge? Added some notable changes, but...
> one question. > > Also, when we have things like ADLSv2 storage, can we remove Kai's copy ? I want to do that in a separate PR.
Performance the same [tests](https://docs.google.com/document/d/1yXORH5ety5Gdr6Avsh7XEmIghiJ8wQrg0l4G4_9Soxo/edit) in the staging environment. @HotSushi
Can we keep both hadoop configs in the code, so we can easily switch locally? Also, why don't we use `bde2020/2.0.0-hadoop2.7.4-java8` which is a newer image and match the `spark-3.1.1-bin-hadoop2.7`...