8000 [DO NOT MERGE] rebase HDFS-17531 by KeeProMise · Pull Request #7408 · apache/hadoop · GitHub
[go: up one dir, main page]
Skip to content

[DO NOT MERGE] rebase HDFS-17531 #7408

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 17 commits into from
10000 Closed

[DO NOT MERGE] rebase HDFS-17531 #7408

wants to merge 17 commits into from

Conversation

KeeProMise
Copy link
Member

Description of PR

How was this patch tested?

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

KeeProMise and others added 17 commits February 20, 2025 14:13
@KeeProMise
HDFS-17543. [ARR] AsyncUtil makes asynchronous code more concise and …
cc47c69 
…easier. (apache#6868). Contributed by Jian Zhang.

Reviewed-by: hfutatzhanghb <hfutzhanghb@163.com>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@KeeProMise
HADOOP-19235. IPC client uses CompletableFuture to support asynchrono…
66a5815 
…us operations. (apache#6888)
@KeeProMise
HDFS-17544. [ARR] The router client rpc protocol PB supports asynchro…
598dfb1 
…ny. (apache#6870). Contributed by Jian Zhang.

Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@KeeProMise
HDFS-17545. [ARR] router async rpc client. (apache#6871). Contributed…
173ea30 
… by Jian Zhang.

Reviewed-by: hfutatzhanghb <hfutzhanghb@163.com>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@Archie-wang @KeeProMise
HDFS-17594. [ARR] RouterCacheAdmin supports asynchronous rpc. (apache…
9ad36ce 
…#6986). Contributed by Archie73.

Reviewed-by: Jian Zhang <keepromise@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@LeoLeeeeee @KeeProMise
HDFS-17597. [ARR] RouterSnapshot supports asynchronous rpc. (apache#6994
c959453 
). Contributed by Wenqi Li.

Reviewed-by: Jian Zhang <keepromise@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@hfutatzhanghb @KeeProMise
HDFS-17595. [ARR] ErasureCoding supports asynchronous rpc. (apache#6983…
b404311 
…). Contributed by hfutatzhanghb.

Reviewed-by: Jian Zhang <keepromise@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@hfutatzhanghb @KeeProMise
HDFS-17601. [ARR] RouterRpcServer supports asynchronous rpc. (apache#…
4001e56 
…7108). Contributed by hfutatzhanghb.

Reviewed-by: Jian Zhang <keepromise@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@hfutatzhanghb @KeeProMise
HDFS-17596. [ARR] RouterStoragePolicy supports asynchronous rpc. (ap…
c925e29 
…ache#6988). Contributed by hfutatzhanghb.

Reviewed-by: Jian Zhang <keepromise@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@KeeProMise
HDFS-17656. [ARR] RouterNamenodeProtocol and RouterUserProtocol suppo…
a93227c 
…rts asynchronous rpc. (apache#7159). Contributed by Jian Zhang.

Reviewed-by: Jian Zhang <keepromise@apache.org>
Signed-off-by: Jian Zhang <keepromise@apache.org>
@hfutatzhanghb @KeeProMise
HDFS-17659. [ARR]Router Quota supports asynchronous rpc. (apache#7157)…
9ad73e5 
…. Contributed by hfutatzhanghb.

Reviewed-by: Jian Zhang <keepromise@apache.org>
@KeeProMise
HDFS-17672. [ARR] Move asynchronous related classes to the async pack…
477fe4b 
…age. (apache#7184). Contributed by Jian Zhang.
@hfutatzhanghb @KeeProMise
HADOOP-19361. RPC DeferredMetrics bugfix. (apache#7220). Contributed …
169ed95 
…by hfutatzhanghb.

Reviewed-by: Jian Zhang <keepromise@apache.org>
@hfutatzhanghb @KeeProMise
HDFS-17640.[ARR] RouterClientProtocol supports asynchronous rpc. (apa…
3c4e692 
…che#7188)

Co-authored-by: Jian Zhang <keepromise@apache.org>
@hfutatzhanghb @KeeProMise
HDFS-17650. [ARR] The router server-side rpc protocol PB supports asy…
310837d 
…nchrony. (apache#7139). Contributed by hfutatzhanghb.

Co-authored-by: Jian Zhang <keepromise@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@hfutatzhanghb @KeeProMise
HDFS-17651.[ARR] Async handler executor isolation (apache#7244). Cont…
812f525 
…ributed by hfutatzhanghb.

Reviewed-by: Jian Zhang <keepromise@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@KeeProMise
HDFS-17715. [ARR] Add documentation for asynchronous router. (apache#…
cc9b314 
…7318). Contributed by Jian Zhang.

Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
@KeeProMise KeeProMise closed this Feb 20, 2025
@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 50s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+0 🆗 markdownlint 0m 0s markdownlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 25 new or modified test files.
_ trunk Compile Tests _
+0 🆗 mvndep 6m 21s Maven dependency ordering for branch
+1 💚 mvninstall 36m 24s trunk passed
+1 💚 compile 17m 14s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 compile 15m 6s trunk passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 checkstyle 4m 32s trunk passed
+1 💚 mvnsite 5m 13s trunk passed
+1 💚 javadoc 4m 21s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javadoc 4m 19s trunk passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 spotbugs 10m 6s trunk passed
+1 💚 shadedclient 42m 16s branch has no errors when building and testing our client artifacts.
-0 ⚠️ patch 42m 42s Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 33s Maven dependency ordering for patch
+1 💚 mvninstall 3m 25s the patch passed
+1 💚 compile 16m 48s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javac 16m 48s the patch passed
+1 💚 compile 15m 29s the patch passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 javac 15m 29s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 4m 36s root: The patch generated 0 new + 94 unchanged - 73 fixed = 94 total (was 167)
+1 💚 mvnsite 5m 16s the patch passed
+1 💚 javadoc 4m 26s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 💚 javadoc 4m 19s the patch passed with JDK Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
+1 💚 spotbugs 10m 58s the patch passed
+1 💚 shadedclient 41m 15s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 14m 42s hadoop-common in the patch passed.
+1 💚 unit 2m 41s hadoop-hdfs-client in the patch passed.
+1 💚 unit 1m 45s hadoop-hdfs in the patch passed.
+1 💚 unit 42m 45s hadoop-hdfs-rbf in the patch passed.
+1 💚 asflicense 1m 2s The patch does not generate ASF License warnings.
320m 55s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7408/1/artifact/out/Dockerfile
GITHUB PR #7408
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint markdownlint
uname Linux e8c2043b687e 5.15.0-131-generic #141-Ubuntu SMP Fri Jan 10 21:18:28 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / cc9b314
Default Java Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06us1-0ubuntu120.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7408/1/testReport/
Max. process+thread count 3010 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-rbf U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7408/1/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
Common HDFS RBF trunk
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@KeeProMise @hadoop-yetus @Archie-wang @LeoLeeeeee @hfutatzhanghb
0