Skip to content

HBASE-24137:The max merge count of metafixer may be remind in hbase-site.xml #1478

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
saintstack merged 6 commits into from
May 5, 2020
Merged

HBASE-24137:The max merge count of metafixer may be remind in hbase-site.xml #1478

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
c5fa7d7
The max merge count of metafixer should be configurable in MetaFixer
Apr 10, 2020
8501b9d
add description of configure the max merge count
Apr 10, 2020
3a06f41
The max merge count of metafixer may be remind in hbase-site.xml
Apr 15, 2020
50bd97c
add description to hbase-default.adoc
Apr 16, 2020
b9c9f5f
resolve conflicts
Apr 28, 2020
d72d8e1
change default value
May 5, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions hbase-common/src/main/resources/hbase-default.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1946,6 +1946,14 @@ possible configurations would overwhelm and obscure the important.
responses with complete data.
</description>
</property>
<property>
<name>hbase.master.metafixer.max.merge.count</name>
<value>10</value>
Copy link
Contributor

@saintstack saintstack May 4, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The default changed.

Copy link
Contributor Author

@gentlewangyu gentlewangyu May 5, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@saintstack I have changed the default value

Thanks

<description>
Maximum regions to merge at a time when we fix overlaps noted in
CJ consistency report, but avoid merging 100 regions in one go!
</description>
</property>
<property>
<name>hbase.rpc.rows.size.threshold.reject</name>
<value>false</value>
Expand Down
2 changes: 1 addition & 1 deletion hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ class MetaFixer {
MetaFixer(MasterServices masterServices) {
this.masterServices = masterServices;
this.maxMergeCount = this.masterServices.getConfiguration().
getInt(MAX_MERGE_COUNT_KEY, MAX_MERGE_COUNT_DEFAULT);
getInt(MAX_MERGE_COUNT_KEY, MAX_MERGE_COUNT_DEFAULT);
}

void fix() throws IOException {
Expand Down
15 changes: 15 additions & 0 deletions src/main/asciidoc/_chapters/hbase-default.adoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2246,6 +2246,20 @@ The percent of region server RPC threads failed to abort RS.
`false`



[[hbase.master.metafixer.max.merge.count]]
*`hbase.master.metafixer.max.merge.count`*::
+
.Description

Maximum regions to merge at a time when we fix overlaps noted in
CJ consistency report, but avoid merging 100 regions in one go!

+
.Default
`10`


[[hbase.rpc.rows.size.threshold.reject]]
*`hbase.rpc.rows.size.threshold.reject`*::
+
Expand All @@ -2264,3 +2278,4 @@ The percent of region server RPC threads failed to abort RS.
+
.Default
`false`