8000 HADOOP-19540. [JDK17] Add ubuntu:noble as a build platform with JDK-17 as default by vinayakumarb · Pull Request #7608 · apache/hadoop · GitHub
[go: up one dir, main page]

Skip to content

HADOOP-19540. [JDK17] Add ubuntu:noble as a build platform with JDK-17 as default #7608

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
May 6, 2025

Conversation

vinayakumarb
Copy link
Contributor

Description of PR

  1. Added "ubuntu:noble" to supported docker platforms.
  2. Modified start-build-env.sh to use expected Dockerfiles dynamically. ex: bash start-build-env.sh ubuntu_24 where ubuntu_24 is the extra suffix in the name of the Dockerfile.
  3. Added jdk17 profile activated when jdk17 is available.
  4. Had to add #include <stdint.h> to header files which misses it to successfully compile with g++ (13.3) in ubuntu 24.

How was this patch tested?

Successfully built the entire Hadoop tar with native support on env created using bash start-build-env.sh ubuntu_24

For code changes:

  • [y] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • [NA] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • [NA] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • [NA] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

Copy link
Member
@ayushtkn ayushtkn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The error message on aarch64 ain't cheese

ayushsaxena@ayushsaxena hadoop % ./start-build-env.sh ubuntu_24 
[+] Building 0.0s (2/2) FINISHED                                                                                                                                                              
 => [internal] load .dockerignore                                                                                                                                                        0.0s
 => => transferring context: 2B                                                                                                                                                          0.0s
 => [internal] load build definition from Dockerfile_ubuntu_24_aarch64                                                                                                                   0.0s
 => => transferring dockerfile: 2B                                                                                                                                                       0.0s
ERROR: failed to solve: failed to read dockerfile: open /var/lib/docker/tmp/buildkit-mount1675973539/Dockerfile_ubuntu_24_aarch64: no such file or directory
ayushsaxena@ayushsaxena hadoop % 

Can we update the BUILDING.txt to reflect which ones are supported for aarch64.

Rest if the build comes clean, changes LGTM

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 45m 34s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 hadolint 0m 1s hadolint was not available.
+0 🆗 shellcheck 0m 1s Shellcheck was not available.
+0 🆗 shelldocs 0m 1s Shelldocs was not available.
+0 🆗 jsonlint 0m 1s jsonlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 6m 16s Maven dependency ordering for branch
-1 ❌ mvninstall 36m 34s /branch-mvninstall-root.txt root in trunk failed.
-1 ❌ compile 13m 0s /branch-compile-root.txt root in trunk failed.
-1 ❌ mvnsite 4m 48s /branch-mvnsite-root.txt root in trunk failed.
-1 ❌ javadoc 6m 47s /branch-javadoc-root.txt root in trunk failed.
+1 💚 shadedclient 45m 6s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 33s Maven dependency ordering for patch
-1 ❌ mvninstall 35m 57s /patch-mvninstall-root.txt root in the patch failed.
-1 ❌ compile 13m 2s /patch-compile-root.txt root in the patch failed.
-1 ❌ cc 13m 2s /patch-compile-root.txt root in the patch failed.
-1 ❌ golang 13m 2s /patch-compile-root.txt root in the patch failed.
-1 ❌ javac 13m 2s /patch-compile-root.txt root in the patch failed.
+1 💚 blanks 0m 0s The patch has no blanks issues.
-1 ❌ mvnsite 4m 59s /patch-mvnsite-root.txt root in the patch failed.
+1 💚 xmllint 0m 0s No new issues.
-1 ❌ javadoc 6m 29s /patch-javadoc-root.txt root in the patch failed.
+1 💚 shadedclient 45m 57s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 598m 9s /patch-unit-root.txt root in the patch failed.
+1 💚 asflicense 1m 33s The patch does not generate ASF License warnings.
855m 27s
Reason Tests
Failed junit tests hadoop.util.TestNativeCodeLoader
hadoop.crypto.TestCryptoCodec
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerMultiNodes
hadoop.yarn.client.api.impl.TestOpportunisticContainerAllocationE2E
hadoop.yarn.client.api.impl.TestAMRMProxy
hadoop.yarn.client.api.impl.TestYarnClient
hadoop.yarn.client.api.impl.TestNMClient
hadoop.yarn.client.api.impl.TestAMRMClientPlacementConstraints
hadoop.yarn.client.api.impl.TestAMRMClient
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/1/artifact/out/Dockerfile
GITHUB PR #7608
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs jsonlint compile cc mvnsite javac unit golang javadoc mvninstall shadedclient xmllint
uname Linux ed869f1b88db 5.15.0-131-generic #141-Ubuntu SMP Fri Jan 10 21:18:28 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 877f792
Default Java Red Hat, Inc.-1.8.0_412-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/1/testReport/
Max. process+thread count 2370 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-hdfs-project/hadoop-hdfs-native-client . U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/1/console
versions git=2.9.5 maven=3.6.3 xmllint=20901
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@vinayakumarb
Copy link
Contributor Author

All the failures in compilation are due to below. Nothing to do with changes in this PR.

[ERROR] PROTOC FAILED: /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe: /usr/lib64/libstdc++.so.6: version `CXXABI_1.3.8' not found (required by /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe)
/home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe: /usr/lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe)
/home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.21' not found (required by /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe)
--grpc-java_out: protoc-gen-grpc-java: Plugin failed with status code 1.

[ERROR] /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/src/main/proto/csi.proto [0:0]: /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe: /usr/lib64/libstdc++.so.6: version `CXXABI_1.3.8' not found (required by /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe)
/home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe: /usr/lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe)
/home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.21' not found (required by /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-7608/centos-7/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/target/protoc-plugins/protoc-gen-grpc-java-1.69.0-linux-x86_64.exe)
--grpc-java_out: protoc-gen-grpc-java: Plugin failed with status code 1.

@vinayakumarb vinayakumarb force-pushed the features/HADOOP-19540 branch from 877f792 to 0db1122 Compare April 14, 2025 17:17
@vinayakumarb
Copy link
Contributor Author

The error message on aarch64 ain't cheese

ayushsaxena@ayushsaxena hadoop % ./start-build-env.sh ubuntu_24 
[+] Building 0.0s (2/2) FINISHED                                                                                                                                                              
 => [internal] load .dockerignore                                                                                                                                                        0.0s
 => => transferring context: 2B                                                                                                                                                          0.0s
 => [internal] load build definition from Dockerfile_ubuntu_24_aarch64                                                                                                                   0.0s
 => => transferring dockerfile: 2B                                                                                                                                                       0.0s
ERROR: failed to solve: failed to read dockerfile: open /var/lib/docker/tmp/buildkit-mount1675973539/Dockerfile_ubuntu_24_aarch64: no such file or directory
ayushsaxena@ayushsaxena hadoop % 

Can we update the BUILDING.txt to reflect which ones are supported for aarch64.

Rest if the build comes clean, changes LGTM

Ack. Updated the BUILDING.txt and added error message in start-build-env.sh as well.

@vinayakumarb vinayakumarb requested a review from ayushtkn April 14, 2025 17:20
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 52s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 hadolint 0m 1s hadolint was not available.
+0 🆗 shellcheck 0m 1s Shellcheck was not available.
+0 🆗 shelldocs 0m 1s Shelldocs was not available.
+0 🆗 jsonlint 0m 1s jsonlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ tru 8000 nk Compile Tests _
+0 🆗 mvndep 5m 51s Maven dependency ordering for branch
-1 ❌ mvninstall 37m 7s /branch-mvninstall-root.txt root in trunk failed.
-1 ❌ compile 12m 43s /branch-compile-root.txt root in trunk failed.
-1 ❌ mvnsite 6m 15s /branch-mvnsite-root.txt root in trunk failed.
-1 ❌ javadoc 7m 29s /branch-javadoc-root.txt root in trunk failed.
+1 💚 shadedclient 46m 17s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 33s Maven dependency ordering for patch
-1 ❌ mvninstall 36m 13s /patch-mvninstall-root.txt root in the patch failed.
-1 ❌ compile 13m 10s /patch-compile-root.txt root in the patch failed.
-1 ❌ cc 13m 10s /patch-compile-root.txt root in the patch failed.
-1 ❌ golang 13m 10s /patch-compile-root.txt root in the patch failed.
-1 ❌ javac 13m 10s /patch-compile-root.txt root in the patch failed.
+1 💚 blanks 0m 0s The patch has no blanks issues.
-1 ❌ mvnsite 5m 3s /patch-mvnsite-root.txt root in the patch failed.
+1 💚 xmllint 0m 1s No new issues.
-1 ❌ javadoc 6m 21s /patch-javadoc-root.txt root in the patch failed.
+1 💚 shadedclient 46m 6s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 507m 18s /patch-unit-root.txt root in the patch failed.
-1 ❌ asflicense 1m 9s /results-asflicense.txt The patch generated 1 ASF License warnings.
722m 33s
Reason Tests
Unreaped Processes root:2
Failed junit tests hadoop.util.TestNativeCodeLoader
hadoop.crypto.TestCryptoCodec
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerMultiNodes
hadoop.yarn.client.api.impl.TestOpportunisticContainerAllocationE2E
hadoop.yarn.client.api.impl.TestAMRMProxy
hadoop.yarn.client.api.impl.TestYarnClient
hadoop.yarn.client.api.impl.TestNMClient
hadoop.yarn.client.api.impl.TestAMRMClientPlacementConstraints
hadoop.yarn.client.api.impl.TestAMRMClient
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/2/artifact/out/Dockerfile
GITHUB PR #7608
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs jsonlint compile cc mvnsite javac unit golang javadoc mvninstall shadedclient xmllint
uname Linux 4679aca24879 5.15.0-131-generic #141-Ubuntu SMP Fri Jan 10 21:18:28 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 877f792
Default Java Red Hat, Inc.-1.8.0_412-b08
Unreaped Processes Log https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/2/artifact/out/patch-unit-root-reaper.txt
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/2/testReport/
Max. process+thread count 2609 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-hdfs-project/hadoop-hdfs-native-client . U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/2/console
versions git=2.9.5 maven=3.6.3 xmllint=20901
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

Copy link
Member
@ayushtkn ayushtkn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Something crazy with the last build as well, see if you can get a clean build, before merging, haven't seen this error before, not sure why is it crying in yarn for protoc

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 43m 32s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 hadolint 0m 1s hadolint was not available.
+0 🆗 shellcheck 0m 1s Shellcheck was not available.
+0 🆗 shelldocs 0m 1s Shelldocs was not available.
+0 🆗 jsonlint 0m 1s jsonlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 6m 26s Maven dependency ordering for branch
-1 ❌ mvninstall 21m 13s /branch-mvninstall-root.txt root in trunk failed.
-1 ❌ compile 6m 18s /branch-compile-root.txt root in trunk failed.
-1 ❌ mvnsite 2m 33s /branch-mvnsite-root.txt root in trunk failed.
-1 ❌ javadoc 4m 30s /branch-javadoc-root.txt root in trunk failed.
+1 💚 shadedclient 27m 2s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 23s Maven dependency ordering for patch
-1 ❌ mvninstall 22m 36s /patch-mvninstall-root.txt root in the patch failed.
-1 ❌ compile 7m 5s /patch-compile-root.txt root in the patch failed.
-1 ❌ cc 7m 5s /patch-compile-root.txt root in the patch failed.
-1 ❌ golang 7m 5s /patch-compile-root.txt root in the patch failed.
-1 ❌ javac 7m 5s /patch-compile-root.txt root in the patch failed.
+1 💚 blanks 0m 0s The patch has no blanks issues.
-1 ❌ mvnsite 2m 53s /patch-mvnsite-root.txt root in the patch failed.
+1 💚 xmllint 0m 0s No new issues.
-1 ❌ javadoc 4m 8s /patch-javadoc-root.txt root in the patch failed.
+1 💚 shadedclient 25m 37s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 483m 11s /patch-unit-root.txt root in the patch failed.
+1 💚 asflicense 0m 48s The patch does not generate ASF License warnings.
653m 8s
Reason Tests
Failed junit tests hadoop.util.TestNativeCodeLoader
hadoop.crypto.TestCryptoCodec
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/3/artifact/out/Dockerfile
GITHUB PR #7608
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs jsonlint compile cc mvnsite javac unit golang javadoc mvninstall shadedclient xmllint
uname Linux 472735767fd0 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 0db1122
Default Java Red Hat, Inc.-1.8.0_412-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/3/testReport/
Max. process+thread count 3299 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-hdfs-project/hadoop-hdfs-native-client . U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/3/console
versions git=2.9.5 maven=3.6.3 xmllint=20901
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@vinayakumarb
Copy link
Contributor Author

Ran the failed tests locally..

[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.crypto.TestCryptoCodec
[WARNING] Tests run: 5, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 21.64 s - in org.apache.hadoop.crypto.TestCryptoCodec
[INFO] Running org.apache.hadoop.util.TestNativeCodeLoader
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.215 s - in org.apache.hadoop.util.TestNativeCodeLoader
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 3
[INFO] 

@vinayakumarb vinayakumarb force-pushed the features/HADOOP-19540 branch from 0db1122 to bcd73e6 Compare April 18, 2025 14:57
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 41m 11s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 hadolint 0m 0s hadolint was not available.
+0 🆗 shellcheck 0m 0s Shellcheck was not available.
+0 🆗 shelldocs 0m 0s Shelldocs was not available.
+0 🆗 jsonlint 0m 0s jsonlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 7m 16s Maven dependency ordering for branch
-1 ❌ mvninstall 31m 40s /branch-mvninstall-root.txt root in trunk failed.
-1 ❌ compile 11m 33s /branch-compile-root.txt root in trunk failed.
-1 ❌ mvnsite 4m 38s /branch-mvnsite-root.txt root in trunk failed.
-1 ❌ javadoc 6m 36s /branch-javadoc-root.txt root in trunk failed.
+1 💚 shadedclient 39m 2s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 33s Maven dependency ordering for patch
-1 ❌ mvninstall 30m 24s /patch-mvninstall-root.txt root in the patch failed.
-1 ❌ compile 10m 44s /patch-compile-root.txt root in the patch failed.
-1 ❌ cc 10m 44s /patch-compile-root.txt root in the patch failed.
-1 ❌ golang 10m 44s /patch-compile-root.txt root in the patch failed.
-1 ❌ javac 10m 44s /patch-compile-root.txt root in the patch failed.
+1 💚 blanks 0m 0s The patch has no blanks issues.
-1 ❌ mvnsite 4m 41s /patch-mvnsite-root.txt root in the patch failed.
+1 💚 xmllint 0m 0s No new issues.
-1 ❌ javadoc 6m 24s /patch-javadoc-root.txt root in the patch failed.
+1 💚 shadedclient 40m 45s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 504m 2s /patch-unit-root.txt root in the patch failed.
-1 ❌ asflicense 1m 1s /results-asflicense.txt The patch generated 1 ASF License warnings.
731m 14s
Reason Tests
Unreaped Processes root:2
Failed junit tests hadoop.fs.TestHdfsNativeCodeLoader
hadoop.crypto.TestCryptoCodec
hadoop.util.TestNativeCodeLoader
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/4/artifact/out/Dockerfile
GITHUB PR #7608
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs jsonlint compile cc mvnsite javac unit golang javadoc mvninstall shadedclient xmllint
uname Linux 3c1e7344c191 5.15.0-131-generic #141-Ubuntu SMP Fri Jan 10 21:18:28 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / bcd73e6
Default Java Red Hat, Inc.-1.8.0_412-b08
Unreaped Processes Log https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/4/artifact/out/patch-unit-root-reaper.txt
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/4/testReport/
Max. process+thread count 3572 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-hdfs-project/hadoop-hdfs-native-client . U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/4/console
versions git=2.9.5 maven=3.6.3 xmllint=20901
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

Copy link
Contributor
@cnauroth cnauroth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 from me, pending resolution of the last round of feedback from @pan3793 . Thanks @vinayakumarb !

…7 as default

1. Added "ubuntu:noble" to supported docker platforms.
2. Modified `start-build-env.sh` to use expected Dockerfiles dynamically.
   ex: `bash start-build-env.sh ubuntu_24` where `ubuntu_24` is the extra suffix in the name of the Dockerfile.
3. Added `jdk17++` profile activated when jdk17 is available.

Successfully built the entire Hadoop tar with native support on env created using `bash start-build-env.sh ubuntu_24`
@vinayakumarb vinayakumarb force-pushed the features/HADOOP-19540 branch from bcd73e6 to 1bea33c Compare April 27, 2025 18:56
@github-actions github-actions bot removed the HDFS label Apr 27, 2025
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 46m 15s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 hadolint 0m 0s hadolint was not available.
+0 🆗 shellcheck 0m 0s Shellcheck was not available.
+0 🆗 shelldocs 0m 0s Shelldocs was not available.
+0 🆗 jsonlint 0m 0s jsonlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 6m 36s Maven dependency ordering for branch
-1 ❌ mvninstall 36m 56s /branch-mvninstall-root.txt root in trunk failed.
-1 ❌ compile 12m 59s /branch-compile-root.txt root in trunk failed.
-1 ❌ mvnsite 5m 21s /branch-mvnsite-root.txt root in trunk failed.
-1 ❌ javadoc 6m 42s /branch-javadoc-root.txt root in trunk failed.
+1 💚 shadedclient 45m 13s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 33s Maven dependency ordering for patch
-1 ❌ mvninstall 36m 32s /patch-mvninstall-root.txt root in the patch failed.
-1 ❌ compile 12m 54s /patch-compile-root.txt root in the patch failed.
-1 ❌ javac 12m 54s /patch-compile-root.txt root in the patch failed.
+1 💚 blanks 0m 0s The patch has no blanks issues.
-1 ❌ mvnsite 4m 53s /patch-mvnsite-root.txt root in the patch failed.
+1 💚 xmllint 0m 0s No new issues.
-1 ❌ javadoc 6m 26s /patch-javadoc-root.txt root in the patch failed.
+1 💚 shadedclient 45m 56s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 913m 3s /patch-unit-root.txt root in the patch failed.
+1 💚 asflicense 1m 52s The patch does not generate ASF License warnings.
1172m 52s
Reason Tests
Failed junit tests hadoop.yarn.sls.appmaster.TestAMSimulator
hadoop.mapred.gridmix.TestGridmixSubmission
hadoop.mapred.gridmix.TestLoadJob
hadoop.mapred.gridmix.TestSleepJob
hadoop.fs.s3a.prefetch.TestS3ACachingBlockManager
hadoop.util.TestNativeCodeLoader
hadoop.crypto.TestCryptoCodec
hadoop.hdfs.server.namenode.TestCacheDirectives
hadoop.fs.viewfs.TestViewFileSystemOverloadSchemeHdfsFileSystemContract
hadoop.hdfs.TestDatanodeRegistration
hadoop.hdfs.server.blockmanagement.TestBlockReportLease
hadoop.fs.TestFcHdfsCreateMkdir
hadoop.fs.TestHDFSFileContextMainOperations
hadoop.fs.viewfs.TestViewFileSystemLinkFallback
hadoop.fs.viewfs.TestViewFileSystemLinkMergeSlash
hadoop.hdfs.server.blockmanagement.TestBlockTokenWithShortCircuitRead
hadoop.fs.TestHdfsNativeCodeLoader
hadoop.fs.viewfs.TestViewFsAtHdfsRoot
hadoop.hdfs.server.blockmanagement.TestDatanodeManager
hadoop.hdfs.server.namenode.TestCacheDirectivesWithViewDFS
hadoop.fs.TestSWebHdfsFileContextMainOperations
hadoop.fs.viewfs.TestViewFileSystemHdfs
hadoop.fs.viewfs.TestViewFileSystemLinkRegex
hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
hadoop.fs.viewfs.TestViewFsHdfs
hadoop.fs.TestWebHdfsFileContextMainOperations
hadoop.yarn.applications.distributedshell.TestDSTimelineV10
hadoop.yarn.applications.distributedshell.TestDSWithMultipleNodeManager
hadoop.yarn.applications.distributedshell.TestDSTimelineV20
hadoop.yarn.applications.distributedshell.TestDSTimelineV15
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerMultiNodes
hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor
hadoop.yarn.server.router.TestRouterMetrics
hadoop.yarn.server.router.secure.TestSecureLogins
hadoop.yarn.server.router.webapp.TestFederationInterceptorREST
hadoop.yarn.server.router.TestRouterServerUtil
hadoop.yarn.server.router.webapp.TestFederationInterceptorRESTRetry
hadoop.yarn.client.api.impl.TestOpportunisticContainerAllocationE2E
hadoop.yarn.client.api.impl.TestAMRMProxy
hadoop.yarn.client.api.impl.TestYarnClient
hadoop.yarn.client.api.impl.TestNMClient
hadoop.yarn.client.api.impl.TestAMRMClientPlacementConstraints
hadoop.yarn.client.api.impl.TestAMRMClient
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/5/artifact/out/Dockerfile
GITHUB PR #7608
Optional Tests dupname asflicense codespell detsecrets hadolint shellcheck shelldocs jsonlint compile javac javadoc mvninstall mvnsite unit shadedclient xmllint
uname Linux 396c4e0b03ef 5.15.0-131-generic #141-Ubuntu SMP Fri Jan 10 21:18:28 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 1bea33c
Default Java Red Hat, Inc.-1.8.0_412-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/5/testReport/
Max. process+thread count 2778 (vs. ulimit of 5500)
modules C: hadoop-project . U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7608/5/console
versions git=2.9.5 maven=3.6.3 xmllint=20901
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@vinayakumarb
Copy link
Contributor Author

Thanks everyone for reviews.
Mergiing now.
All the failures shown above are not related at all.

@vinayakumarb vinayakumarb merged commit 5279af9 into apache:trunk May 6, 2025
1 of 2 checks passed
@vinayakumarb vinayakumarb deleted the features/HADOOP-19540 branch May 6, 2025 18:34
@slfan1989
Copy link
Contributor

Thanks everyone for reviews.
Mergiing now.
All the failures shown above are not related at all.

@vinayakumarb Thank you for the contribution!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants
0