Raghav Aggarwal

Have made few minor custom changes: 1. Added underscore in config name ATSHOOKQUEUECAPACITY 2. removed numSparkJobs

There seems to be a behaviour changes in parsing of fields in tez. For instance, in callerId the User is getting appended. In hive3 its not there. I'll investigate this...

@arorasimran0309 , I can still see nimbus older version in _iceberg/patched-iceberg-core/pom.xml_ ``` [INFO] | +- org.apache.hadoop:hadoop-auth:jar:3.4.1:compile (optional) [INFO] | | +- com.nimbusds:nimbus-jose-jwt:jar:9.37.2:compile (optional) [INFO] | | | \- com.github.stephenc.jcip:jcip-annotations:jar:1.0-1:compile (optional)...

Dependency tree looks good, packaing also contains onty nimbus-jose-jwt-10.4.2.jar. LGTM +1

Changes makes sense to me, to cleanup scratch directory in case of exception before `startSessionAndContainers()` in `openInternal()` method LGTM +1 (non-binding)

@vikramahuja1001 , i think change is required in `org.apache.hadoop.hive.ql.exec.DDLPlanUtils#checkIfDefaultPartition()` https://github.com/apache/hive/blob/73503291cbdd0f95bc33add0769234fed6683840/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLPlanUtils.java#L307

Remove hardcoding from here as well + update comments as well accordingly org.apache.hadoop.hive.common.FileUtils#escapePathName(java.lang.String, java.lang.String) https://github.com/apache/hive/blob/413069ea0faeb893fe78faa215b08a70ece80595/common/src/java/org/apache/hadoop/hive/common/FileUtils.java#L298 https://github.com/apache/hive/blob/90820ac0a241468482073beb269bcaa3928fbc6f/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/utils/FileUtils.java#L310

Remove hardcoding from following place: https://github.com/apache/hive/blob/733d4f09011f27bea17a5301537a9c6174f28874/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java#L715 https://github.com/apache/hive/blob/ba0217ff17501fb849d8999e808d37579db7b4f1/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/HCatFileUtil.java#L71

Thanks for the PR @slfan1989. As this is a dependency upgrade, can you change the description and based on HIVE-27419, can you attach the dependency tree in the PR?

``` org.apache.atlas:atlas-intg:jar:2.3.0:compile [INFO] | | | | +- commons-validator:commons-validator:jar:1.6:compile [INFO] | | | | | \- commons-digester:commons-digester:jar:1.8.1:compile [INFO] | | | | +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:jar:2.16.1:compile [INFO] | | | | +-...