Skip to content

Commit 2b6db4e

Browse files
committed
HBASE-28841: Modify default value of hbase.bucketcache.persistence.chunksize to 10K
Currently, the default value of the configuration parameter "hbase.bucketcache.persistence.chunksize" is 10 million (10000000). This is the number of block entries that are processed during the persistence of bucket-cache backing map to the persistence file. During the testing, it was found that, this high number of chunksize resulted in high heap utilisation in region servers leading to longer GC pauses which also led to server crashes intermittently. When the value of this configuration is set to 10K(10000), the cache remains stable. No GC delays are observed. Also no server crashes are observed. The jmap outputs collected against the regionservers showed reduced memory utilisation from 4.5-5GB to 1-1.5GB for the objects related to persistence code. Change-Id: I83ea05e694fa9b76683a837f83162b6a72ef1a3c
1 parent 4446d29 commit 2b6db4e

File tree

1 file changed

+1
-1
lines changed
  • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket

1 file changed

+1
-1
lines changed

hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCache.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -148,7 +148,7 @@ public class BucketCache implements BlockCache, HeapSize {
148148
final static int DEFAULT_WRITER_THREADS = 3;
149149
final static int DEFAULT_WRITER_QUEUE_ITEMS = 64;
150150

151-
final static long DEFAULT_BACKING_MAP_PERSISTENCE_CHUNK_SIZE = 10000000;
151+
final static long DEFAULT_BACKING_MAP_PERSISTENCE_CHUNK_SIZE = 10000;
152152

153153
// Store/read block data
154154
transient final IOEngine ioEngine;

0 commit comments

Comments
 (0)