Skip to content

Conversation

@bharathv
Copy link
Contributor

  • Cleans up the method names to make more sense and adds a little
    more javadocs for context. In future patches we can revisit
    the name of the actual class to make it more self explanatory.

  • Does AsyncRegistry -> ConnectionRegistry rename.
    "async" ness of the registry is kind of implicit based on
    the interface contents and need not be reflected in the name.

Signed-off-by: Nick Dimiduk [email protected]
Signed-off-by: stack [email protected]
Signed-off-by: Viraj Jasani [email protected]

This patch implements a simple cache that all the masters
can lookup to serve cluster ID to clients. Active HMaster
is still responsible for creating it but all the masters
will read it from fs to serve clients.

RPCs exposing it will come in a separate patch as a part of
HBASE-18095.

Signed-off-by: Andrew Purtell <[email protected]>
Signed-off-by: Wellington Chevreuil <[email protected]>
Signed-off-by: Guangxu Cheng <[email protected]>
(cherry picked from commit c2e01f2)
…ache#812)

Currently we just track whether an active master exists.
It helps to also track the address of the active master in
all the masters to help serve the client RPC requests to
know which master is active.

Signed-off-by: Nick Dimiduk <[email protected]>
Signed-off-by: Andrew Purtell <[email protected]>
(cherry picked from commit efebb84)
* HBASE-23281: Track meta region changes on masters

This patch adds a simple cache that tracks the meta region replica
locations. It keeps an eye on the region movements so that the
cached locations are not stale.

This information is used for servicing client RPCs for connections
that use master based registry (HBASE-18095). The RPC end points
will be added in a separate patch.

Signed-off-by: Nick Dimiduk <[email protected]>
(cherry picked from commit 8571d38)
* HBASE-23304: RPCs needed for client meta information lookup

This patch implements the RPCs needed for the meta information
lookup during connection init. New tests added to cover the RPC
code paths. HBASE-23305 builds on this to implement the client
side logic.

Fixed a bunch of checkstyle nits around the places the patch
touches.

Signed-off-by: Andrew Purtell <[email protected]>
(cherry picked from commit 4f8fbba)
* HBASE-23604: Cleanup AsyncRegistry interface

- Cleans up the method names to make more sense and adds a little
more javadocs for context. In future patches we can revisit
the name of the actual class to make it more self explanatory.

- Does AsyncRegistry -> ConnectionRegistry rename.
"async" ness of the registry is kind of implicit based on
the interface contents and need not be reflected in the name.

Signed-off-by: Nick Dimiduk <[email protected]>
Signed-off-by: stack <[email protected]>
Signed-off-by: Viraj Jasani <[email protected]>
(cherry picked from commit 12bb41e)
@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 35s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 2s No case conflicting files found.
+0 🆗 prototool 0m 0s prototool was not available.
+1 💚 hbaseanti 0m 0s Patch does not have any anti-patterns.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 42 new or modified test files.
_ branch-2 Compile Tests _
+0 🆗 mvndep 0m 16s Maven dependency ordering for branch
+1 💚 mvninstall 5m 12s branch-2 passed
+1 💚 compile 2m 24s branch-2 passed
+1 💚 checkstyle 2m 20s branch-2 passed
+1 💚 shadedjars 4m 17s branch has no errors when building our shaded downstream artifacts.
+1 💚 javadoc 1m 33s branch-2 passed
+0 🆗 spotbugs 0m 35s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 7m 35s branch-2 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 15s Maven dependency ordering for patch
+1 💚 mvninstall 4m 53s the patch passed
+1 💚 compile 2m 22s the patch passed
+1 💚 cc 2m 22s the patch passed
+1 💚 javac 2m 22s the patch passed
+1 💚 checkstyle 0m 12s The patch passed checkstyle in hbase-protocol-shaded
+1 💚 checkstyle 0m 42s hbase-client: The patch generated 0 new + 269 unchanged - 2 fixed = 269 total (was 271)
+1 💚 checkstyle 0m 14s The patch passed checkstyle in hbase-zookeeper
+1 💚 checkstyle 1m 12s hbase-server: The patch generated 0 new + 135 unchanged - 13 fixed = 135 total (was 148)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedjars 4m 18s patch has no errors when building our shaded downstream artifacts.
+1 💚 hadoopcheck 15m 29s Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 💚 hbaseprotoc 2m 19s the patch passed
+1 💚 javadoc 1m 32s the patch passed
+1 💚 findbugs 8m 15s the patch passed
_ Other Tests _
+1 💚 unit 0m 42s hbase-protocol-shaded in the patch passed.
-1 ❌ unit 14m 10s hbase-client in the patch failed.
+1 💚 unit 0m 49s hbase-zookeeper in the patch passed.
+1 💚 unit 156m 19s hbase-server in the patch passed.
+1 💚 asflicense 2m 14s The patch does not generate ASF License warnings.
247m 37s
Reason Tests
Failed junit tests hadoop.hbase.client.TestClientNoCluster
Subsystem Report/Notes
Docker Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1099/1/artifact/out/Dockerfile
GITHUB PR #1099
JIRA Issue HBASE-23604
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile cc hbaseprotoc prototool
uname Linux 975cd9909ee4 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1099/out/precommit/personality/provided.sh
git revision branch-2 / 2d5dfeb
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1099/1/artifact/out/patch-unit-hbase-client.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1099/1/testReport/
Max. process+thread count 5185 (vs. ulimit of 10000)
modules C: hbase-protocol-shaded hbase-client hbase-zookeeper hbase-server U: .
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1099/1/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

@bharathv
Copy link
Contributor Author

bharathv commented Feb 2, 2020

Will be included in #1101

@bharathv bharathv closed this Feb 2, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants