HBASE-25071 ReplicationServer support start ReplicationSource internal #2452
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
infraio
force-pushed
the
HBASE-25071-new
branch
3 times, most recently
from
1edb685 to
8e6639e
Compare
|
🎊 +1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
|
🎊 +1 overall
This message was automatically generated. |
saintstack
reviewed
Sep 24, 2020
|
|
||
| message ListReplicationSinkServersResponse { | ||
| repeated ServerName server_name = 1; | ||
| required bool is_replication_server = 1; |
Contributor
There was a problem hiding this comment.
Is this right name for the attribute? The method name for a boolean should be isATTRIBUTE but the ATTRIBUTE itself should not have the 'is' prefix.
Contributor
There was a problem hiding this comment.
Oh, you can't change the protobuf index.... it breaks compatibility. Give the replication_server '2' and leave server_name as '1'.
Contributor
Author
There was a problem hiding this comment.
This is only for the feature branch. Not merged to any branch now.
hbase-protocol-shaded/src/main/protobuf/server/replication/ReplicationServer.proto
Show resolved
Hide resolved
| private boolean fetchServersUseZk = false; | ||
| private FetchServersChore fetchServersChore; | ||
| private int shortOperationTimeout; | ||
| private boolean isReplicationServer = false; |
Contributor
There was a problem hiding this comment.
Yeah, boolean should be named replicationServer and the method to access this data member is named isReplicationServer.
| .createBlockingRpcChannel(master, User.getCurrent(), shortOperationTimeout)); | ||
| ListReplicationSinkServersResponse resp = masterStub | ||
| .listReplicationSinkServers(null, ListReplicationSinkServersRequest.newBuilder().build()); | ||
| isReplicationServer = resp.getIsReplicationServer(); |
Contributor
There was a problem hiding this comment.
Do you have to do hasReplicationServer first? And then read it if present? Or maybe this defaults false if not present?
Contributor
Author
There was a problem hiding this comment.
This field is required. So not need to check hasReplicationServer first?
| @InterfaceAudience.Private | ||
| @SuppressWarnings({ "deprecation"}) | ||
| public class HReplicationServer extends Thread implements Server { | ||
| public class HReplicationServer extends Thread implements Server, ReplicationSourceController { |
Contributor
There was a problem hiding this comment.
Looks like ReplicationServer already committed (why have the 'H' prefix?)
Contributor
Author
There was a problem hiding this comment.
Only for the feature branch HBASE-24666.
| private UserProvider userProvider; | ||
|
|
||
| protected final ReplicationServerRpcServices rpcServices; | ||
| private final ReplicationServerRpcServices rpcServices; |
Contributor
There was a problem hiding this comment.
We have to do this? Just because we do it for HMaster and HRegionServer, it doesn't make it a good pattern. This is an Interface to pass instead of the impl?
Contributor
Author
There was a problem hiding this comment.
I am ok with this. Decouple a RpcService can make the code more clearly.
| private final ConcurrentMap<String, ReplicationSourceInterface> sources = new ConcurrentHashMap<>(); | ||
|
|
||
| private final ReplicationQueueStorage queueStorage; | ||
| private final ReplicationPeers replicationPeers; |
Contributor
There was a problem hiding this comment.
Is this stuff normally inside a ReplicationSourceManager? Or maybe the Replication instance? Can you not use these instead?
Contributor
Author
There was a problem hiding this comment.
The key thing of this feature is here. The new HReplicationServer will be a independent server which manage some ReplicationSource.
The assumption here is that: Replication is a producer-consumer module. The "producer" RegionServer write WAL to HDFS and write WAL name to a replication queue, which can be identified by <RegionServer ServerName, QueueId>. The "consumer" ReplicationSource fetch the WAL name from the replication queue and read the WAL from HDFS and replicate to other HBase Clusters or other Systems.
When replication offload enabled, ReplicationSourceManager will only wirte the WAL name to the replication queue. But not start any ReplicationSource. HMaster get all replication queues and assign them to many ReplicationServers. Same with the region balancer, HMaster called a StartReplicationSource rpc to the ReplicationServer. Then the ReplicationServer will start a ReplicationSource thread to do the replication job.
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HReplicationServer.java
Outdated
Show resolved
Hide resolved
| * @param queueStorage the replication queue storage | ||
| * @param replicationPeer the replication peer | ||
| * @param server the server which start and run this replication source | ||
| * @param producer the name of region server which produce the replication queue |
Contributor
There was a problem hiding this comment.
This is for the RecoveryReplicationSource only?
Contributor
Author
There was a problem hiding this comment.
For all ReplicationSource. The assumption here is that: all replication is a producer-consumer module.
| // init replication source | ||
| src.init(conf, fs, logDir, this, queueStorage, replicationPeer, server, queueId, clusterId, | ||
| walFileLengthProvider, metrics); | ||
| src.init(conf, fs, logDir, this, queueStorage, replicationPeer, server, server.getServerName(), |
Contributor
There was a problem hiding this comment.
There will be a time when the passed in 'server' differs from server.getServerName?
Contributor
There was a problem hiding this comment.
Perhaps say more about this?
Contributor
Author
Contributor
Author
There was a problem hiding this comment.
One replication queue can be identified by <Producer ServerName, QueueId>.
Contributor
Author
There was a problem hiding this comment.
And one ReplicationSource is responsible for one replication queue.
Contributor
Author
There was a problem hiding this comment.
When replication offload disabled, the ReplicationSource will be started in RegionServer inside. So the producer name is same with the Server's name.
infraio
force-pushed
the
HBASE-25071-new
branch
from
8e6639e to
b7e51db
Compare
|
🎊 +1 overall
This message was automatically generated. |
infraio
force-pushed
the
HBASE-25071-new
branch
from
b7e51db to
425ffb4
Compare
|
💔 -1 overall
This message was automatically generated. |
infraio
force-pushed
the
HBASE-25071-new
branch
from
425ffb4 to
bb46ef9
Compare
|
🎊 +1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
|
🎊 +1 overall
This message was automatically generated. |
infraio
force-pushed
the
HBASE-24666
branch
from
6008ffe to
662f5e1
Compare
infraio
force-pushed
the
HBASE-25071-new
branch
from
bb46ef9 to
5a39f53
Compare
|
💔 -1 overall
This message was automatically generated. |
|
🎊 +1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
infraio
force-pushed
the
HBASE-25071-new
branch
2 times, most recently
from
8a063c3 to
108dddd
Compare
|
🎊 +1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
|
🎊 +1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
infraio
force-pushed
the
HBASE-25071-new
branch
from
108dddd to
97f0c23
Compare
|
🎊 +1 overall
This message was automatically generated. |
|
🎊 +1 overall
This message was automatically generated. |
infraio
force-pushed
the
HBASE-25071-new
branch
from
97f0c23 to
7d4b041
Compare
|
💔 -1 overall
This message was automatically generated. |
|
🎊 +1 overall
This message was automatically generated. |
ddupg
reviewed
Nov 4, 2020
|
|
||
| if (conf.getBoolean(HConstants.REPLICATION_OFFLOAD_ENABLE_KEY, | ||
| HConstants.REPLICATION_OFFLOAD_ENABLE_DEFAULT)) { | ||
| fetchWALsThread = new Thread(() -> { |
Member
There was a problem hiding this comment.
interrrupt the fetchWALsThread when the ReplicationServer exits or when the peer terminates?
|
🎊 +1 overall
This message was automatically generated. |
|
🎊 +1 overall
This message was automatically generated. |
infraio
force-pushed
the
HBASE-25071-new
branch
from
7d4b041 to
a28ec44
Compare
|
🎊 +1 overall
This message was automatically generated. |
|
🎊 +1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
infraio
force-pushed
the
HBASE-25071-new
branch
from
a28ec44 to
c8537ef
Compare
|
🎊 +1 overall
This message was automatically generated. |
|
🎊 +1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
infraio
added a commit
that referenced
this pull request
Nov 9, 2020
#2452) Signed-off-by: XinSun <[email protected]>
ddupg
pushed a commit
that referenced
this pull request
Feb 23, 2021
#2452) Signed-off-by: XinSun <[email protected]>
ddupg
pushed a commit
that referenced
this pull request
Jul 9, 2021
#2452) Signed-off-by: XinSun <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.