Skip to content

Commit 265a48e

Browse files
HADOOP-17869. fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max (#3337).
The value of `fs.s3a.connection.maximum` has been increased to 96 Contributed by Dongjoon Hyun
1 parent 50dda77 commit 265a48e

2 files changed

Lines changed: 2 additions & 2 deletions

File tree

hadoop-common-project/hadoop-common/src/main/resources/core-default.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1381,7 +1381,7 @@
13811381

13821382
<property>
13831383
<name>fs.s3a.connection.maximum</name>
1384-
<value>48</value>
1384+
<value>96</value>
13851385
<description>Controls the maximum number of simultaneous connections to S3.
13861386
This must be bigger than the value of fs.s3a.threads.max so as to stop
13871387
threads being blocked waiting for new HTTPS connections.

hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -147,7 +147,7 @@ private Constants() {
147147

148148
// number of simultaneous connections to s3
149149
public static final String MAXIMUM_CONNECTIONS = "fs.s3a.connection.maximum";
150-
public static final int DEFAULT_MAXIMUM_CONNECTIONS = 48;
150+
public static final int DEFAULT_MAXIMUM_CONNECTIONS = 96;
151151

152152
// connect to s3 over ssl?
153153
public static final String SECURE_CONNECTIONS =

0 commit comments

Comments
 (0)