hadoop icon indicating copy to clipboard operation
hadoop copied to clipboard

HDFS-17121. BPServiceActor to provide new thread to handle FBR

Open LiuGuH opened this issue 2 years ago • 56 comments

Description of PR

After HDFS-16016 , it makes ibr in a thread to avoid heartbeat blocking with ibr when require readlock in Datanode.

Now fbr should do as this. The reason is this:

(1)heartbeat maybe block because of fbr with readlock in datanode

(2)fbr will only may return FinalizeCommand

How was this patch tested?

There is no a new test for it. We can use original test case.

LiuGuH avatar Jul 25 '23 09:07 LiuGuH

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 45s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 :green_heart: mvninstall 51m 34s trunk passed
+1 :green_heart: compile 1m 29s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: compile 1m 21s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 1m 20s trunk passed
+1 :green_heart: mvnsite 1m 33s trunk passed
+1 :green_heart: javadoc 1m 20s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 44s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 37s trunk passed
+1 :green_heart: shadedclient 41m 12s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 1m 15s the patch passed
+1 :green_heart: compile 1m 24s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javac 1m 24s the patch passed
+1 :green_heart: compile 1m 10s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 1m 10s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 1m 2s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 2 new + 23 unchanged - 0 fixed = 25 total (was 23)
+1 :green_heart: mvnsite 1m 24s the patch passed
+1 :green_heart: javadoc 0m 57s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 26s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 30s the patch passed
+1 :green_heart: shadedclient 38m 46s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 212m 14s hadoop-hdfs in the patch passed.
+1 :green_heart: asflicense 0m 56s The patch does not generate ASF License warnings.
370m 34s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/1/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/5888
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 942813419e47 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 223ec0fd3961db0958eed1aba2171d097d12fc1c
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/1/testReport/
Max. process+thread count 3722 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/1/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jul 25 '23 15:07 hadoop-yetus

the changes look good at high level, could you please take care of checkstyle?

virajjasani avatar Jul 25 '23 23:07 virajjasani

Good improvement. Not think carefully but my first feeling, IBR - FBR mis-order could trigger some issues, such as miss some block report? One case, a. generate full block report, b. received one replica named r and send IBR, c. send full block report; And NameNode process FBF and IBR as the above order, then NameNode will consider that this DataNode does not include replica r, right?

Thanks.

Hexiaoqiao avatar Jul 26 '23 03:07 Hexiaoqiao

I agree with @Hexiaoqiao . We have done something similar before, and here we need to ensure the order of FBR and IBR.

tomscut avatar Jul 26 '23 03:07 tomscut

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 37s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 :green_heart: mvninstall 45m 52s trunk passed
+1 :green_heart: compile 1m 28s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: compile 1m 17s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 1m 14s trunk passed
+1 :green_heart: mvnsite 1m 30s trunk passed
+1 :green_heart: javadoc 1m 14s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 36s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 30s trunk passed
+1 :green_heart: shadedclient 39m 58s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 1m 17s the patch passed
+1 :green_heart: compile 1m 20s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javac 1m 20s the patch passed
+1 :green_heart: compile 1m 13s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 1m 13s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 0m 59s the patch passed
+1 :green_heart: mvnsite 1m 20s the patch passed
+1 :green_heart: javadoc 1m 2s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 29s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 20s the patch passed
+1 :green_heart: shadedclient 39m 14s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 215m 15s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 :green_heart: asflicense 0m 53s The patch does not generate ASF License warnings.
366m 1s
Reason Tests
Failed junit tests hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/2/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/5888
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 53852bbe4702 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / f4b9ae882689ba709d708f75e1745a682bd91d71
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/2/testReport/
Max. process+thread count 2962 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/2/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jul 26 '23 08:07 hadoop-yetus

@Hexiaoqiao ,if the order of ibr and fbr is must be guaranteed at datanode side, HDFS-16016 also can not guarantee it.
Thus if it is import the order of br rpc , a idea is that I put the ibr ,fbr into a queue with the right order.

LiuGuH avatar Jul 26 '23 09:07 LiuGuH

And maybe it not a problem. The FBR will only process the reported block list,the replication r will not discard. FBR finally execute BlockManager.processReportedBlock method , just as ibr addblock does.

LiuGuH avatar Jul 26 '23 10:07 LiuGuH

And maybe it not a problem.

I am sure IT IS (As @tomscut mentioned above.). IMO, if there is issue that confirmed, the proper way is fix it first then improve it. I believe this proposal is very important, actually we have deploy this feature for years, however we should be safe to land it. I think the simple way is adding mutex/lock to avoid IBR and FBR mis-order. Maybe there is some other smooth way, welcome to discuss. Good luck!

Hexiaoqiao avatar Jul 26 '23 13:07 Hexiaoqiao

Yes,I know it. It is a problem with mis-order. a. heartbeat got a delete cmd on replication named r b. generate fbr c. datanode delete repliction r and send ibr d. send fbr

LiuGuH avatar Jul 26 '23 13:07 LiuGuH

@Hexiaoqiao , well, I user original sendIBRLock to make right order for ibr and fbr. The FBR will execute ibr first, so the sendIBRLock will be successful for it. Please review for it, Thanks.

LiuGuH avatar Jul 27 '23 02:07 LiuGuH

actually we have deploy this feature for years, however we should be safe to land it.

@Hexiaoqiao just one question: do you mean you already have IBR and FBR being processed asynchronously? or you mean you have HDFS-16016 deployed?

I think the simple way is adding mutex/lock to avoid IBR and FBR mis-order.

this sounds good

virajjasani avatar Jul 27 '23 02:07 virajjasani

@LiuGuH sorry i got bit confused, if we want to solve the ordering problem by using the same lock for both IBR and FBR as part of this PR, do we really need HDFS-17129 as separate Jira?

virajjasani avatar Jul 27 '23 02:07 virajjasani

just one question: do you mean you already have IBR and FBR being processed asynchronously? or you mean you have HDFS-16016 deployed?

Send FBR asynchronously. (Not include IBR, because we didn't meet some performance issue here).

if we want to solve the ordering problem by using the same lock for both IBR and FBR as part of this PR, do we really need HDFS-17129 as separate Jira?

+1, if we could solve this issue here, we DO NOT need create another one.

Hexiaoqiao avatar Jul 27 '23 03:07 Hexiaoqiao

About this PR, I didn't get the original purpose (include HDFS-16016). IIUC, we want to keep lightweight channel to send heartbeat avoid to be blocked, Right? If true, is it enough to make IBR and FBR asynchronously together and use only one thread? Thanks.

Hexiaoqiao avatar Jul 27 '23 03:07 Hexiaoqiao

If true, is it enough to make IBR and FBR asynchronously together and use only one thread? Variable fullBlockReportLeaseId updates from heartbeat and used by fbr and then update to 0 . It is difficulty to do all in one thread.

LiuGuH avatar Jul 27 '23 04:07 LiuGuH

Send FBR asynchronously. (Not include IBR, because we didn't meet some performance issue here).

got it, thank you @Hexiaoqiao!

virajjasani avatar Jul 27 '23 05:07 virajjasani

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 48s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 :green_heart: mvninstall 47m 37s trunk passed
+1 :green_heart: compile 1m 22s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: compile 1m 17s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 1m 14s trunk passed
+1 :green_heart: mvnsite 1m 28s trunk passed
+1 :green_heart: javadoc 1m 11s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 34s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 35s trunk passed
+1 :green_heart: shadedclient 40m 24s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 1m 14s the patch passed
+1 :green_heart: compile 1m 20s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javac 1m 20s the patch passed
+1 :green_heart: compile 1m 10s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 1m 10s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 1m 2s the patch passed
+1 :green_heart: mvnsite 1m 17s the patch passed
+1 :green_heart: javadoc 0m 58s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 30s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 26s the patch passed
+1 :green_heart: shadedclient 39m 14s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 223m 21s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 :green_heart: asflicense 0m 53s The patch does not generate ASF License warnings.
376m 5s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.ha.TestObserverNode
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/3/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/5888
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 8b9a9510431d 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 6a93902a3a6d4d66be04d2752a20e51a0c9430a0
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/3/testReport/
Max. process+thread count 3400 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/3/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jul 27 '23 08:07 hadoop-yetus

If true, is it enough to make IBR and FBR asynchronously together and use only one thread? Thanks. Please review https://github.com/apache/hadoop/pull/5898 , make IBR and FBR into one thread. Thanks @Hexiaoqiao @virajjasani

LiuGuH avatar Jul 28 '23 08:07 LiuGuH

Please review https://github.com/apache/hadoop/pull/5898 , make IBR and FBR into one thread.

Suggest to submit at one PR (rather than different PR) , thus we could focus and discuss at the same place. Thanks.

Hexiaoqiao avatar Jul 28 '23 09:07 Hexiaoqiao

Suggest to submit at one PR (rather than different PR) , thus we could focus and discuss at the same place. OK , done. Thanks

LiuGuH avatar Jul 28 '23 10:07 LiuGuH

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 38s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 :green_heart: mvninstall 46m 25s trunk passed
+1 :green_heart: compile 1m 27s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: compile 1m 23s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 1m 18s trunk passed
+1 :green_heart: mvnsite 1m 39s trunk passed
+1 :green_heart: javadoc 1m 16s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 44s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 47s trunk passed
+1 :green_heart: shadedclient 43m 38s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 1m 22s the patch passed
+1 :green_heart: compile 1m 25s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javac 1m 25s the patch passed
+1 :green_heart: compile 1m 11s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 1m 11s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 1m 10s the patch passed
+1 :green_heart: mvnsite 1m 30s the patch passed
+1 :green_heart: javadoc 1m 0s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 35s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 34s the patch passed
+1 :green_heart: shadedclient 40m 8s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 215m 25s hadoop-hdfs in the patch passed.
+1 :green_heart: asflicense 0m 57s The patch does not generate ASF License warnings.
372m 31s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/4/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/5888
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 46d454e296db 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / c1c9ae9a5afcf4f9be87153863792278e217ccc8
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/4/testReport/
Max. process+thread count 3057 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/4/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jul 28 '23 12:07 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 30s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
-1 :x: mvninstall 31m 57s /branch-mvninstall-root.txt root in trunk failed.
+1 :green_heart: compile 0m 54s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: compile 0m 51s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 0m 44s trunk passed
+1 :green_heart: mvnsite 0m 53s trunk passed
+1 :green_heart: javadoc 0m 51s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 10s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 1m 59s trunk passed
+1 :green_heart: shadedclient 22m 9s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 46s the patch passed
+1 :green_heart: compile 0m 45s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javac 0m 45s the patch passed
+1 :green_heart: compile 0m 41s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 0m 41s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 0m 34s the patch passed
+1 :green_heart: mvnsite 0m 46s the patch passed
+1 :green_heart: javadoc 0m 38s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 3s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 1m 56s the patch passed
+1 :green_heart: shadedclient 22m 13s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 206m 11s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 :green_heart: asflicense 0m 40s The patch does not generate ASF License warnings.
299m 16s
Reason Tests
Failed junit tests hadoop.hdfs.TestDecommissionWithBackoffMonitor
hadoop.hdfs.server.namenode.TestFSImage
hadoop.hdfs.server.namenode.TestNestedEncryptionZones
hadoop.hdfs.TestDFSUpgradeFromImage
hadoop.hdfs.server.datanode.TestBlockReplacement
hadoop.hdfs.server.namenode.TestFSEditLogLoader
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.server.datanode.TestTriggerBlockReport
hadoop.fs.viewfs.TestViewFileSystemLinkFallback
hadoop.hdfs.server.namenode.TestFsck
hadoop.hdfs.TestEncryptedTransfer
hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting
hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
hadoop.hdfs.server.namenode.ha.TestHASafeMode
hadoop.hdfs.server.blockmanagement.TestBlockManager
hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
hadoop.hdfs.server.namenode.ha.TestObserverNode
hadoop.hdfs.TestDFSShell
hadoop.hdfs.server.namenode.TestStartup
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/5/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/5888
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux acdac8eacf79 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 235501374000f41c3ec608a519575be248358177
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/5/testReport/
Max. process+thread count 3391 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/5/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jul 28 '23 15:07 hadoop-yetus

Please check report from Yetus first.

Hexiaoqiao avatar Jul 30 '23 06:07 Hexiaoqiao

Apache Yetus(jenkins) error: mvninstall Could not transfer artifact org.codehaus.mojo:extra-enforcer-rules:pom:1.5.1 from/to central (https://repo.maven.apache.org/maven2): Transfer failed for https://repo.maven.apache.org/maven2/org/codehaus/mojo/extra-enforcer-rules/1.5.1/extra-enforcer-rules-1.5.1.pom: Connection reset -> [Help 1] It could be a network connection problem. How can I trigger compilation without change the code ?

LiuGuH avatar Jul 31 '23 08:07 LiuGuH

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 42s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 :green_heart: mvninstall 44m 56s trunk passed
+1 :green_heart: compile 1m 27s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: compile 1m 20s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 1m 10s trunk passed
+1 :green_heart: mvnsite 1m 29s trunk passed
+1 :green_heart: javadoc 1m 12s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 39s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 25s trunk passed
+1 :green_heart: shadedclient 37m 58s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 1m 15s the patch passed
+1 :green_heart: compile 1m 19s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javac 1m 19s the patch passed
+1 :green_heart: compile 1m 10s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 1m 10s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 1m 2s the patch passed
+1 :green_heart: mvnsite 1m 20s the patch passed
+1 :green_heart: javadoc 0m 57s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 28s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 27s the patch passed
+1 :green_heart: shadedclient 39m 3s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 232m 23s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 :green_heart: asflicense 0m 54s The patch does not generate ASF License warnings.
379m 53s
Reason Tests
Failed junit tests hadoop.hdfs.TestPread
hadoop.hdfs.TestEncryptedTransfer
hadoop.hdfs.server.namenode.TestFSImage
hadoop.hdfs.server.namenode.ha.TestHASafeMode
hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
hadoop.hdfs.server.datanode.TestBlockReplacement
hadoop.hdfs.server.datanode.TestTriggerBlockReport
hadoop.hdfs.server.namenode.TestStartup
hadoop.hdfs.server.namenode.TestFsck
hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
hadoop.hdfs.server.namenode.TestFSEditLogLoader
hadoop.hdfs.TestDecommissionWithBackoffMonitor
hadoop.hdfs.TestDFSUpgradeFromImage
hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting
hadoop.hdfs.server.blockmanagement.TestBlockManager
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
hadoop.hdfs.TestDFSShell
hadoop.hdfs.server.namenode.TestNestedEncryptionZones
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/6/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/5888
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux d40d92c25b05 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 1e32f9a23b9d2910ab1768a8f710c3dde285fd19
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/6/testReport/
Max. process+thread count 3664 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/6/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Aug 02 '23 18:08 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 40s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 :green_heart: mvninstall 45m 48s trunk passed
+1 :green_heart: compile 1m 23s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: compile 1m 15s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 1m 10s trunk passed
+1 :green_heart: mvnsite 1m 28s trunk passed
+1 :green_heart: javadoc 1m 12s trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 39s trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 4m 9s trunk passed
+1 :green_heart: shadedclient 40m 16s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 1m 16s the patch passed
+1 :green_heart: compile 1m 22s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javac 1m 22s the patch passed
+1 :green_heart: compile 1m 13s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 1m 13s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 1m 4s the patch passed
+1 :green_heart: mvnsite 1m 21s the patch passed
+1 :green_heart: javadoc 1m 1s the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1
+1 :green_heart: javadoc 1m 36s the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 33s the patch passed
+1 :green_heart: shadedclient 38m 37s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 220m 16s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 :green_heart: asflicense 0m 53s The patch does not generate ASF License warnings.
370m 33s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.ha.TestObserverNode
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/7/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/5888
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux e8ec2cddba89 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / ca54fd0410de4721d3c82fb4baed26b45e32a6f8
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/7/testReport/
Max. process+thread count 3738 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/7/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Aug 03 '23 07:08 hadoop-yetus

Revert the previous commit because of problems. Can we review the ibr and fbr in different thread first?

LiuGuH avatar Aug 03 '23 08:08 LiuGuH

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 15m 0s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 1s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 :green_heart: mvninstall 50m 6s trunk passed
+1 :green_heart: compile 1m 28s trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 1m 24s trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: checkstyle 1m 19s trunk passed
+1 :green_heart: mvnsite 1m 33s trunk passed
+1 :green_heart: javadoc 1m 14s trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 43s trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: spotbugs 3m 58s trunk passed
+1 :green_heart: shadedclient 41m 31s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 1m 22s the patch passed
+1 :green_heart: compile 1m 27s the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 1m 27s the patch passed
+1 :green_heart: compile 1m 18s the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: javac 1m 18s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 1m 6s the patch passed
+1 :green_heart: mvnsite 1m 27s the patch passed
+1 :green_heart: javadoc 1m 4s the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 36s the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: spotbugs 3m 33s the patch passed
+1 :green_heart: shadedclient 42m 30s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 214m 57s hadoop-hdfs in the patch passed.
+1 :green_heart: asflicense 0m 56s The patch does not generate ASF License warnings.
391m 1s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/8/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/5888
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 672c7c17a534 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / fb09ccf3192a7f424ffd3511c705085888ce9e48
Default Java Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/8/testReport/
Max. process+thread count 3409 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/8/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Aug 03 '23 14:08 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 52s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 :green_heart: mvninstall 48m 3s trunk passed
+1 :green_heart: compile 1m 21s trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 1m 11s trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: checkstyle 1m 9s trunk passed
+1 :green_heart: mvnsite 1m 21s trunk passed
+1 :green_heart: javadoc 1m 6s trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 39s trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: spotbugs 3m 19s trunk passed
+1 :green_heart: shadedclient 39m 56s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 1m 9s the patch passed
+1 :green_heart: compile 1m 16s the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 1m 16s the patch passed
+1 :green_heart: compile 1m 6s the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: javac 1m 6s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 1m 1s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 1 new + 23 unchanged - 0 fixed = 24 total (was 23)
+1 :green_heart: mvnsite 1m 13s the patch passed
+1 :green_heart: javadoc 0m 55s the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 33s the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
-1 :x: spotbugs 3m 22s /new-spotbugs-hadoop-hdfs-project_hadoop-hdfs.html hadoop-hdfs-project/hadoop-hdfs generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
-1 :x: shadedclient 40m 25s patch has errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 208m 30s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 :green_heart: asflicense 0m 49s The patch does not generate ASF License warnings.
361m 14s
Reason Tests
SpotBugs module:hadoop-hdfs-project/hadoop-hdfs
Uninitialized read of fullBlockReportLeaseIdLock in new org.apache.hadoop.hdfs.server.datanode.BPServiceActor(String, String, InetSocketAddress, InetSocketAddress, BPOfferService) At BPServiceActor.java:new org.apache.hadoop.hdfs.server.datanode.BPServiceActor(String, String, InetSocketAddress, InetSocketAddress, BPOfferService) At BPServiceActor.java:[line 150]
Failed junit tests hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
hadoop.hdfs.server.namenode.TestFSImage
hadoop.cli.TestCryptoAdminCLI
hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
hadoop.hdfs.server.balancer.TestBalancerRPCDelay
hadoop.cli.TestAclCLIWithPosixAclInheritance
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr
hadoop.hdfs.TestListFilesInFileContext
hadoop.hdfs.server.datanode.TestTransferRbw
hadoop.fs.contract.hdfs.TestHDFSContractMkdir
hadoop.hdfs.TestModTime
hadoop.hdfs.TestAppendDifferentChecksum
hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
hadoop.hdfs.server.namenode.TestAllowFormat
hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot
hadoop.hdfs.server.namenode.TestBlockUnderConstruction
hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks
hadoop.hdfs.server.datanode.TestDataNodeECN
hadoop.hdfs.server.namenode.TestNameNodeMXBean
hadoop.hdfs.server.namenode.TestQuotaByStorageType
hadoop.hdfs.server.datanode.TestHSync
hadoop.hdfs.server.namenode.TestMetaSave
hadoop.hdfs.TestDFSMkdirs
hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
hadoop.hdfs.TestDFSPermission
hadoop.hdfs.server.datanode.TestIncrementalBlockReports
hadoop.hdfs.TestDecommissionWithBackoffMonitor
hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
hadoop.hdfs.TestErasureCodingMultipleRacks
hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
hadoop.fs.viewfs.TestViewFsWithXAttrs
hadoop.fs.viewfs.TestViewFsHdfs
hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
hadoop.fs.TestUnbuffer
hadoop.hdfs.TestDataStream
hadoop.cli.TestXAttrCLI
hadoop.hdfs.TestParallelShortCircuitLegacyRead
hadoop.hdfs.server.namenode.TestFileTruncate
hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs
hadoop.fs.contract.hdfs.TestHDFSContractSetTimes
hadoop.hdfs.server.datanode.TestDiskError
hadoop.hdfs.server.namenode.snapshot.TestSnapshot
hadoop.hdfs.TestFSOutputSummer
hadoop.hdfs.server.namenode.TestAddBlock
hadoop.hdfs.web.TestHttpsFileSystem
hadoop.hdfs.TestByteBufferPread
hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
hadoop.hdfs.TestClientReportBadBlock
hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId
hadoop.hdfs.server.namenode.TestAuditLogs
hadoop.hdfs.server.balancer.TestBalancerService
hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica
hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
hadoop.hdfs.TestApplyingStoragePolicy
hadoop.hdfs.TestIsMethodSupported
hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes
hadoop.hdfs.server.datanode.TestBlockReplacement
hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocksWithRandomECPolicy
hadoop.hdfs.TestBlocksScheduledCounter
hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter
hadoop.hdfs.server.mover.TestMover
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.server.datanode.TestDataNodeMetricsLogger
hadoop.hdfs.TestEncryptedTransfer
hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus
hadoop.hdfs.security.TestDelegationTokenForProxyUser
hadoop.hdfs.server.namenode.snapshot.TestRandomOpsWithSnapshots
hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocks
hadoop.hdfs.server.datanode.TestDeleteBlockPool
hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
hadoop.hdfs.server.namenode.TestCommitBlockWithInvalidGenStamp
hadoop.hdfs.TestFileStatusWithRandomECPolicy
hadoop.hdfs.web.TestWebHdfsUrl
hadoop.hdfs.server.namenode.ha.TestHAAppend
hadoop.hdfs.TestBatchedListDirectories
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
hadoop.hdfs.server.blockmanagement.TestPendingDataNodeMessages
hadoop.hdfs.TestTrashWithSecureEncryptionZones
hadoop.hdfs.server.datanode.TestBPOfferService
hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC
hadoop.hdfs.server.namenode.TestAddBlockRetry
hadoop.hdfs.TestFileLengthOnClusterRestart
hadoop.hdfs.TestRead
hadoop.hdfs.server.namenode.TestFileContextXAttr
hadoop.hdfs.TestSetrepIncreasing
hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
hadoop.hdfs.server.namenode.TestReconstructStripedBlocks
hadoop.hdfs.server.diskbalancer.TestDiskBalancer
hadoop.hdfs.TestDFSInotifyEventInputStream
hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs
hadoop.hdfs.server.blockmanagement.TestSlowDiskTracker
hadoop.hdfs.TestDatanodeRegistration
hadoop.hdfs.TestMaintenanceState
hadoop.fs.contract.hdfs.TestHDFSContractOpen
hadoop.hdfs.client.impl.TestClientBlockVerification
hadoop.fs.contract.hdfs.TestHDFSContractPathHandle
hadoop.hdfs.server.blockmanagement.TestBlockReportLease
hadoop.hdfs.server.namenode.TestFSNamesystemLockReport
hadoop.hdfs.server.namenode.TestEditLogRace
hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
hadoop.hdfs.server.namenode.TestCacheDirectivesWithViewDFS
hadoop.hdfs.TestRenameWhileOpen
hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
hadoop.hdfs.TestClientProtocolForPipelineRecovery
hadoop.hdfs.TestDFSUpgradeFromImage
hadoop.hdfs.tools.TestViewFileSystemOverloadSchemeWithFSCommands
hadoop.fs.contract.hdfs.TestHDFSContractAppend
hadoop.fs.TestFcHdfsPermission
hadoop.hdfs.server.aliasmap.TestSecureAliasMap
hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
hadoop.fs.viewfs.TestViewFileSystemWithTruncate
hadoop.hdfs.TestReservedRawPaths
hadoop.hdfs.TestDFSClientFailover
hadoop.hdfs.TestDatanodeConfig
hadoop.hdfs.TestQuota
hadoop.hdfs.TestLeaseRecovery
hadoop.hdfs.server.namenode.TestStorageRestore
hadoop.hdfs.server.balancer.TestBalancerLongRunningTasks
hadoop.hdfs.TestDFSStripedOutputStreamUpdatePipeline
hadoop.hdfs.server.namenode.TestGetContentSummaryWithPermission
hadoop.hdfs.TestViewDistributedFileSystemContract
hadoop.hdfs.server.namenode.TestNameNodeStatusMXBean
hadoop.hdfs.server.namenode.TestReencryptionWithKMS
hadoop.fs.contract.hdfs.TestHDFSContractSafeMode
hadoop.hdfs.TestReplaceDatanodeFailureReplication
hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
hadoop.hdfs.server.datanode.TestIncrementalBrVariations
hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
hadoop.hdfs.server.diskbalancer.TestConnectors
hadoop.hdfs.server.namenode.TestXAttrConfigFlag
hadoop.hdfs.server.namenode.TestNameNodeRpcServerMethods
hadoop.hdfs.server.namenode.TestStartup
hadoop.hdfs.server.datanode.fsdataset.impl.TestReplicaCachingGetSpaceUsed
hadoop.hdfs.server.namenode.TestSecurityTokenEditLog
hadoop.hdfs.TestMultipleNNPortQOP
hadoop.hdfs.TestDFSShellGenericOptions
hadoop.hdfs.TestDecommission
hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
hadoop.fs.contract.hdfs.TestHDFSContractCreate
hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory
hadoop.hdfs.tools.TestDFSAdmin
hadoop.hdfs.client.impl.TestBlockReaderRemote
hadoop.hdfs.TestErasureCodingPolicyWithSnapshotWithRandomECPolicy
hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot
hadoop.hdfs.TestBalancerBandwidth
hadoop.hdfs.TestExternalBlockReader
hadoop.hdfs.TestLocatedBlocksRefresher
hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork
hadoop.hdfs.TestParallelShortCircuitRead
hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
hadoop.hdfs.TestMissingBlocksAlert
hadoop.hdfs.TestDFSClientSocketSize
hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy
hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl
hadoop.TestRefreshCallQueue
hadoop.fs.TestSymlinkHdfsFileContext
hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter
hadoop.hdfs.server.datanode.TestDataNodeExit
hadoop.fs.TestUrlStreamHandler
hadoop.hdfs.TestBlockTokenWrappingQOP
hadoop.hdfs.TestUnsetAndChangeDirectoryEcPolicy
hadoop.hdfs.client.impl.TestBlockReaderFactory
hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN
hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
hadoop.hdfs.server.namenode.web.resources.TestWebHdfsCreatePermissions
hadoop.hdfs.TestMiniDFSCluster
hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
hadoop.cli.TestCacheAdminCLI
hadoop.hdfs.TestReadWhileWriting
hadoop.fs.viewfs.TestViewFsLinkFallback
hadoop.cli.TestHDFSCLI
hadoop.hdfs.TestDFSRename
hadoop.hdfs.server.mover.TestStorageMover
hadoop.hdfs.server.diskbalancer.TestDiskBalancerWithMockMover
hadoop.hdfs.TestGetFileChecksum
hadoop.hdfs.TestRestartDFS
hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy
hadoop.hdfs.server.namenode.TestAclConfigFlag
hadoop.hdfs.TestHDFSFileSystemContract
hadoop.fs.viewfs.TestViewFileSystemLinkRegex
hadoop.hdfs.TestParallelShortCircuitReadUnCached
hadoop.hdfs.TestParallelRead
hadoop.hdfs.TestAclsEndToEnd
hadoop.hdfs.server.datanode.TestDataTransferThrottler
hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
hadoop.hdfs.TestInjectionForSimulatedStorage
hadoop.hdfs.server.datanode.TestDataNodeInitStorage
hadoop.hdfs.server.blockmanagement.TestBlockManager
hadoop.hdfs.TestWriteReadStripedFile
hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation
hadoop.hdfs.server.namenode.TestReencryption
hadoop.hdfs.TestReadStripedFileWithDecoding
hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
hadoop.fs.contract.hdfs.TestHDFSContractUnbuffer
hadoop.hdfs.TestMultiThreadedHflush
hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
hadoop.hdfs.server.namenode.TestNameEditsConfigs
hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
hadoop.hdfs.server.namenode.TestNamenodeStorageDirectives
hadoop.hdfs.TestWriteConfigurationToDFS
hadoop.hdfs.tools.TestWebHDFSStoragePolicyCommands
hadoop.hdfs.server.datanode.TestTriggerBlockReport
hadoop.hdfs.TestFileCreationClient
hadoop.hdfs.TestFileAppendRestart
hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead
hadoop.hdfs.server.datanode.TestDataNodeTcpNoDelay
hadoop.hdfs.server.datanode.TestDataNodeTransferSocketSize
hadoop.hdfs.server.namenode.TestHDFSConcat
hadoop.fs.viewfs.TestViewFileSystemHdfs
hadoop.hdfs.TestFileAppend
hadoop.hdfs.tools.TestStoragePolicyCommands
hadoop.hdfs.TestDFSFinalize
hadoop.fs.viewfs.TestViewFsDefaultValue
hadoop.hdfs.server.blockmanagement.TestCorruptionWithFailover
hadoop.fs.viewfs.TestViewFsWithAcls
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
hadoop.hdfs.server.namenode.TestMetadataVersionOutput
hadoop.hdfs.TestSlowDatanodeReport
hadoop.hdfs.TestDFSStartupVersions
hadoop.hdfs.server.datanode.TestBlockRecovery
hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
hadoop.fs.TestFcHdfsCreateMkdir
hadoop.hdfs.server.namenode.TestINodeAttributeProvider
hadoop.tools.TestJMXGet
hadoop.hdfs.TestReplication
hadoop.hdfs.TestEncryptionZonesWithHA
hadoop.hdfs.server.datanode.TestDatanodeRegister
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
hadoop.hdfs.TestLeaseRecovery2
hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
hadoop.hdfs.crypto.TestHdfsCryptoStreams
hadoop.hdfs.TestReadStripedFileWithMissingBlocks
hadoop.fs.contract.hdfs.TestHDFSContractRename
hadoop.hdfs.TestPersistBlocks
hadoop.hdfs.TestDFSRemove
hadoop.hdfs.TestDFSClientExcludedNodes
hadoop.fs.TestHDFSFileContextMainOperations
hadoop.hdfs.server.namenode.TestNameNodeXAttr
hadoop.hdfs.TestDFSOutputStream
hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
hadoop.hdfs.server.namenode.sps.TestStoragePolicySatisfierWithStripedFile
hadoop.hdfs.server.namenode.TestParallelImageWrite
hadoop.hdfs.TestErasureCodingExerciseAPIs
hadoop.hdfs.TestAbandonBlock
hadoop.hdfs.TestFileAppend2
hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling
hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
hadoop.hdfs.TestReplaceDatanodeOnFailure
hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
hadoop.hdfs.TestHDFSServerPorts
hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
hadoop.hdfs.TestSetrepDecreasing
hadoop.fs.TestResolveHdfsSymlink
hadoop.hdfs.TestParallelShortCircuitReadNoChecksum
hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
hadoop.hdfs.TestLocalDFS
hadoop.hdfs.TestFileCreation
hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier
hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
hadoop.security.TestPermission
hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens
hadoop.hdfs.TestDFSShell
hadoop.hdfs.server.datanode.TestDatanodeProtocolRetryPolicy
hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
hadoop.fs.TestWebHdfsFileContextMainOperations
hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransferExpiredBlockToken
hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
hadoop.hdfs.server.namenode.TestCacheDirectives
hadoop.hdfs.server.namenode.ha.TestUpdateBlockTailing
hadoop.hdfs.TestFetchImage
hadoop.hdfs.TestFileAppend4
hadoop.hdfs.TestErasureCodingPoliciesWithRandomECPolicy
hadoop.hdfs.TestSafeMode
hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
hadoop.hdfs.TestMaintenanceWithStriped
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.web.TestWebHDFSForHA
hadoop.hdfs.server.namenode.TestINodeFile
hadoop.hdfs.server.datanode.TestBlockCountersInPendingIBR
hadoop.hdfs.TestSnapshotCommands
hadoop.fs.contract.hdfs.TestHDFSContractConcat
hadoop.hdfs.TestFileChecksum
hadoop.hdfs.server.namenode.TestMalformedURLs
hadoop.fs.shell.TestHdfsTextCommand
hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
hadoop.hdfs.tools.TestViewFSStoragePolicyCommands
hadoop.hdfs.server.datanode.TestLargeBlockReport
hadoop.hdfs.TestLeaseRecoveryStriped
hadoop.fs.TestFcHdfsSetUMask
hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
hadoop.hdfs.TestDFSStripedOutputStreamWithRandomECPolicy
hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
hadoop.fs.contract.hdfs.TestHDFSContractDelete
hadoop.hdfs.server.namenode.TestRefreshBlockPlacementPolicy
hadoop.hdfs.server.namenode.TestNameNodeRpcServer
hadoop.hdfs.server.datanode.TestCachingStrategy
hadoop.hdfs.security.TestDelegationToken
hadoop.fs.TestSymlinkHdfsFileSystem
hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
hadoop.hdfs.TestFSInputChecker
hadoop.hdfs.TestDisableConnCache
hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics
hadoop.hdfs.server.namenode.TestLeaseManager
hadoop.hdfs.TestErasureCodingPolicyWithSnapshot
hadoop.hdfs.server.namenode.TestSecureNameNode
hadoop.hdfs.server.datanode.TestDirectoryScanner
hadoop.hdfs.server.namenode.TestDecommissioningStatusWithBackoffMonitor
hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy
hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
hadoop.hdfs.server.datanode.TestCorruptMetadataFile
hadoop.hdfs.TestViewDistributedFileSystemWithMountLinks
hadoop.hdfs.TestFileCorruption
hadoop.hdfs.TestDatanodeReport
hadoop.fs.viewfs.TestViewFSOverloadSchemeWithMountTableConfigInHDFS
hadoop.hdfs.TestBlockStoragePolicy
hadoop.hdfs.server.datanode.fsdataset.impl.TestFsVolumeList
hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary
hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness
hadoop.hdfs.server.namenode.TestNameNodeResourceChecker
hadoop.net.TestNetworkTopology
hadoop.hdfs.TestDecommissionWithStriped
hadoop.hdfs.web.TestWebHDFSAcl
hadoop.hdfs.server.namenode.ha.TestDNFencing
hadoop.hdfs.TestDFSClientRetries
hadoop.fs.viewfs.TestViewFileSystemOverloadSchemeWithHdfsScheme
hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
hadoop.hdfs.server.datanode.TestDataNodeMetrics
hadoop.hdfs.server.namenode.TestSnapshotPathINodes
hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing
hadoop.hdfs.TestDFSInputStream
hadoop.hdfs.server.blockmanagement.TestPendingReconstruction
hadoop.fs.TestSymlinkHdfsDisable
hadoop.hdfs.TestQuotaAllowOwner
hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes
hadoop.hdfs.server.namenode.ha.TestObserverNode
hadoop.hdfs.TestExtendedAcls
hadoop.hdfs.TestSetTimes
hadoop.hdfs.server.datanode.TestDataNodeVolumeMetrics
hadoop.hdfs.tools.TestDebugAdmin
hadoop.hdfs.TestDatanodeLayoutUpgrade
hadoop.hdfs.server.namenode.TestRedudantBlocks
hadoop.hdfs.TestErasureCodeBenchmarkThroughput
hadoop.cli.TestDeleteCLI
hadoop.hdfs.server.namenode.TestStoragePolicySatisfierWithHA
hadoop.hdfs.server.namenode.TestStripedINodeFile
hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting
hadoop.hdfs.qjournal.TestSecureNNWithQJM
hadoop.hdfs.server.namenode.TestFileLimit
hadoop.hdfs.server.namenode.TestDecommissioningStatus
hadoop.hdfs.TestDecommissionWithStripedBackoffMonitor
hadoop.hdfs.server.namenode.TestDeadDatanode
hadoop.hdfs.web.TestWebHdfsFileSystemContract
hadoop.hdfs.server.blockmanagement.TestBlockTokenWithShortCircuitRead
hadoop.hdfs.TestRollingUpgrade
hadoop.hdfs.TestWriteRead
hadoop.fs.viewfs.TestViewFileSystemLinkMergeSlash
hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy
hadoop.hdfs.server.namenode.TestAddStripedBlockInFBR
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForErasureCodingPolicy
hadoop.hdfs.server.blockmanagement.TestStorageBlockPoolUsageStdDev
hadoop.hdfs.TestDatanodeDeath
hadoop.hdfs.TestDeadNodeDetection
hadoop.hdfs.server.namenode.TestFSDirectory
hadoop.hdfs.TestSafeModeWithStripedFile
hadoop.fs.contract.hdfs.TestHDFSContractLeaseRecovery
hadoop.fs.permission.TestStickyBit
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForStoragePolicy
hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff
hadoop.hdfs.TestDFSAddressConfig
hadoop.hdfs.TestDataTransferProtocol
hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean
hadoop.hdfs.server.namenode.snapshot.TestFSImageWithOrderedSnapshotDeletion
hadoop.hdfs.server.datanode.TestDataNodeUUID
hadoop.fs.contract.hdfs.TestHDFSContractSeek
hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame
hadoop.hdfs.server.namenode.TestDeleteRace
hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
hadoop.security.TestPermissionSymlinks
hadoop.hdfs.server.datanode.TestBlockScanner
hadoop.hdfs.TestHFlush
hadoop.hdfs.server.namenode.TestBackupNode
hadoop.hdfs.server.blockmanagement.TestBlockInfoStriped
hadoop.hdfs.server.namenode.TestAuditLogger
hadoop.hdfs.TestErasureCodingPolicies
hadoop.hdfs.TestReadStripedFileWithDecodingDeletedData
hadoop.hdfs.TestSeekBug
hadoop.hdfs.server.namenode.TestNameNodeAcl
hadoop.hdfs.TestHdfsAdmin
hadoop.hdfs.TestDFSStripedInputStream
hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
hadoop.hdfs.TestTrashWithEncryptionZones
hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
hadoop.hdfs.TestConnCache
hadoop.hdfs.TestFileConcurrentReader
hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
hadoop.hdfs.server.namenode.TestHostsFiles
hadoop.hdfs.TestReadStripedFileWithDecodingCorruptData
hadoop.hdfs.TestDistributedFileSystemWithECFileWithRandomECPolicy
hadoop.fs.viewfs.TestViewFileSystemLinkFallback
hadoop.hdfs.TestClose
hadoop.hdfs.TestFileStatusWithDefaultECPolicy
hadoop.hdfs.TestDFSInputStreamBlockLocations
hadoop.hdfs.TestDFSShellTouch
hadoop.hdfs.TestReadStripedFileWithDNFailure
hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
hadoop.hdfs.server.blockmanagement.TestErasureCodingCorruption
hadoop.fs.TestEnhancedByteBufferAccess
hadoop.fs.TestGlobPaths
hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs
hadoop.hdfs.TestFsShellPermission
hadoop.security.TestRefreshUserMappings
hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot
hadoop.hdfs.server.namenode.TestNameNodeReconfigure
hadoop.hdfs.TestCrcCorruption
hadoop.hdfs.server.namenode.TestFSEditLogLoader
hadoop.hdfs.server.balancer.TestBalancer
hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand
hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
hadoop.hdfs.server.blockmanagement.TestSequentialBlockId
hadoop.hdfs.TestDFSStripedOutputStream
hadoop.cli.TestAclCLI
hadoop.fs.loadGenerator.TestLoadGenerator
hadoop.hdfs.TestLease
hadoop.hdfs.tools.TestECAdmin
hadoop.hdfs.server.namenode.TestFileContextAcl
hadoop.hdfs.server.namenode.snapshot.TestFsShellMoveToTrashWithSnapshots
hadoop.hdfs.server.namenode.TestEditLog
hadoop.hdfs.TestSmallBlock
hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations
hadoop.hdfs.server.namenode.TestPersistentStoragePolicySatisfier
hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetCache
hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
hadoop.hdfs.server.namenode.TestNestedEncryptionZones
hadoop.hdfs.TestGetBlocks
hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
hadoop.hdfs.server.datanode.TestDataNodeMXBean
hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
hadoop.hdfs.TestListFilesInDFS
hadoop.hdfs.server.datanode.TestDataNodeFaultInjector
hadoop.hdfs.web.TestFSMainOperationsWebHdfs
hadoop.hdfs.TestHDFSTrash
hadoop.hdfs.server.datanode.TestBlockRecovery2
hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
hadoop.TestGenericRefresh
hadoop.hdfs.TestBlockMissingException
hadoop.hdfs.TestDFSStorageStateRecovery
hadoop.hdfs.TestStripedFileAppend
hadoop.hdfs.TestFileAppend3
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
hadoop.hdfs.TestFileStatus
hadoop.cli.TestErasureCodingCLI
hadoop.hdfs.server.datanode.TestDataNodeLifeline
hadoop.fs.viewfs.TestViewFileSystemWithXAttrs
hadoop.hdfs.server.namenode.TestCreateEditsLog
hadoop.hdfs.TestDFSRollback
hadoop.hdfs.shortcircuit.TestShortCircuitCache
hadoop.hdfs.TestAppendSnapshotTruncate
hadoop.hdfs.server.namenode.ha.TestBootstrapAliasmap
hadoop.hdfs.tools.TestStoragePolicySatisfyAdminCommands
hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant
hadoop.fs.viewfs.TestViewFsFileStatusHdfs
hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
hadoop.hdfs.server.datanode.TestBatchIbr
hadoop.hdfs.TestParallelUnixDomainRead
hadoop.hdfs.web.TestWebHDFSXAttr
hadoop.hdfs.server.blockmanagement.TestNodeCount
hadoop.hdfs.server.namenode.TestFSImageWithXAttr
hadoop.hdfs.TestPipelines
hadoop.hdfs.server.namenode.ha.TestHAMetrics
hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation
hadoop.hdfs.server.namenode.TestFSImageWithAcl
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
hadoop.hdfs.tools.TestViewFileSystemOverloadSchemeWithDFSAdmin
hadoop.hdfs.TestDistributedFileSystemWithECFile
hadoop.hdfs.server.namenode.TestAddStripedBlocks
hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
hadoop.fs.viewfs.TestViewFsAtHdfsRoot
hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
hadoop.hdfs.server.namenode.TestNetworkTopologyServlet
hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy
hadoop.fs.TestSWebHdfsFileContextMainOperations
hadoop.fs.viewfs.TestViewFileSystemOverloadSchemeHdfsFileSystemContract
hadoop.hdfs.TestStoragePolicyPermissionSettings
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands
hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
hadoop.hdfs.TestFileCreationDelete
hadoop.hdfs.server.namenode.TestNamenodeRetryCache
hadoop.hdfs.server.namenode.TestFSNamesystemMBean
hadoop.hdfs.web.TestWebHdfsTokens
hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
hadoop.hdfs.TestLargeBlock
hadoop.fs.viewfs.TestViewFileSystemWithAcls
hadoop.hdfs.server.datanode.TestStorageReport
hadoop.hdfs.TestPread
hadoop.hdfs.server.namenode.TestListOpenFiles
hadoop.hdfs.TestStateAlignmentContextWithHA
hadoop.hdfs.security.token.block.TestBlockToken
hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
hadoop.hdfs.server.namenode.TestCheckpoint
hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
hadoop.hdfs.server.namenode.snapshot.TestListSnapshot
hadoop.hdfs.TestSecureEncryptionZoneWithKMS
hadoop.hdfs.TestReconstructStripedFileWithValidator
hadoop.hdfs.TestDFSUpgrade
hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
hadoop.hdfs.server.namenode.TestSaveNamespace
hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy
hadoop.hdfs.TestDataTransferKeepalive
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
hadoop.hdfs.TestReconstructStripedFile
hadoop.hdfs.TestFileCreationEmpty
hadoop.hdfs.server.datanode.TestRefreshNamenodes
hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
hadoop.hdfs.server.blockmanagement.TestRedundancyMonitor
hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/11/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/5888
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 87a9646149cf 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 1179b4fc8bc621a08ade6fb6a690ae522ea4e52a
Default Java Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/11/testReport/
Max. process+thread count 3045 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/11/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Aug 17 '23 13:08 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 34s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 :green_heart: mvninstall 31m 49s trunk passed
+1 :green_heart: compile 0m 56s trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 0m 49s trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: checkstyle 0m 43s trunk passed
+1 :green_heart: mvnsite 0m 57s trunk passed
+1 :green_heart: javadoc 0m 51s trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 9s trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: spotbugs 1m 59s trunk passed
+1 :green_heart: shadedclient 22m 8s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 45s the patch passed
+1 :green_heart: compile 0m 47s the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 0m 47s the patch passed
+1 :green_heart: compile 0m 44s the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: javac 0m 44s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 34s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 1 new + 23 unchanged - 0 fixed = 24 total (was 23)
+1 :green_heart: mvnsite 0m 47s the patch passed
+1 :green_heart: javadoc 0m 39s the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 5s the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
+1 :green_heart: spotbugs 1m 52s the patch passed
+1 :green_heart: shadedclient 21m 54s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 220m 12s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 :green_heart: asflicense 0m 39s The patch does not generate ASF License warnings.
313m 11s
Reason Tests
Failed junit tests hadoop.hdfs.TestDecommissionWithBackoffMonitor
hadoop.hdfs.server.namenode.TestFSImage
hadoop.hdfs.server.namenode.TestNestedEncryptionZones
hadoop.hdfs.TestDFSUpgradeFromImage
hadoop.hdfs.server.datanode.TestBlockReplacement
hadoop.hdfs.server.namenode.TestFSEditLogLoader
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.server.datanode.TestTriggerBlockReport
hadoop.hdfs.server.namenode.TestFsck
hadoop.hdfs.TestEncryptedTransfer
hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting
hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
hadoop.hdfs.server.namenode.ha.TestHASafeMode
hadoop.hdfs.server.blockmanagement.TestBlockManager
hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
hadoop.hdfs.TestDFSShell
hadoop.hdfs.server.namenode.TestStartup
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/12/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/5888
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux f2784304aace 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 993ee84f8112537a35a9723abc157aecc6165f9e
Default Java Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/12/testReport/
Max. process+thread count 3537 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5888/12/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Aug 17 '23 13:08 hadoop-yetus