Nandini Anagondi

Results 11 comments of Nandini Anagondi

Hi @abhishekagarwal87 I would like to work on this issue.

Raised the PR: #17310

``` diff main_old/dep.tree upgraded/dep.tree 918,920c918,920 < [INFO] +- org.apache.hadoop:hadoop-client-api:jar:3.3.6:provided < [INFO] +- org.apache.hadoop:hadoop-client-runtime:jar:3.3.6:provided < [INFO] +- org.apache.hadoop:hadoop-client-minicluster:jar:3.3.6:test --- > [INFO] +- org.apache.hadoop:hadoop-client-api:jar:3.4.0:provided > [INFO] +- org.apache.hadoop:hadoop-client-runtime:jar:3.4.0:provided > [INFO] +- org.apache.hadoop:hadoop-client-minicluster:jar:3.4.0:test...

From distribution tar: tar -tzf apache-druid-32.0.0-SNAPSHOT-bin.tar.gz_upgrade | grep '\.jar$' | sort > new_jars.txt ``` ➜ compare diff main_old/old_jars.txt upgraded/new_jars.txt 36c36 < apache-druid-32.0.0-SNAPSHOT/extensions/ambari-metrics-emitter/hadoop-annotations-3.3.6.jar --- > apache-druid-32.0.0-SNAPSHOT/extensions/ambari-metrics-emitter/hadoop-annotations-3.4.0.jar 57c57 < apache-druid-32.0.0-SNAPSHOT/extensions/druid-avro-extensions/hadoop-client-api-3.3.6.jar --- >...

1. Bundle Jar is of hadoop-aws ``` [INFO] +- org.apache.hadoop:hadoop-aws:jar:3.4.0:runtime [INFO] | +- software.amazon.awssdk:bundle:jar:2.23.19:runtime ``` 2. hadoop-mapreduce-client-core has all the new netty related dependencies ``` [INFO] +- org.apache.hadoop:hadoop-mapreduce-client-core:jar:3.4.0:runtime [INFO] |...

hadoop-common has a new dependency org.bouncycastle:bcprov-jdk15on:jar:1.70:compile -> this [version-jdk 1.5](https://mvnrepository.com/artifact/org.bouncycastle/bcprov-jdk15on) moved to jdk1.8 and also it has CVEs. It is fixed in hadoop 3.4.1 (not released yet) by moving to...

> @naanagon - have you done a Hadoop Ingestion with this change? Can you also get a diff of what jars changed in the distribution tar as a result of...

> Thanks @naanagon for taking this up. Great to see you contributing to Apache Druid 🚀 . > > We would most likely move to a LTS stable version of...