Skip to content

Commit b037737

Browse files
authored
HADOOP-18764. fs.azure.buffer.dir to be under Yarn container path on yarn applications (#5788)
Changing fs.azure.buffer.dir for azure so things clean up better in long-lived yarn clusters. Contributed by: Mehakmeet Singh
1 parent 29362cd commit b037737

1 file changed

Lines changed: 4 additions & 2 deletions

File tree

hadoop-common-project/hadoop-common/src/main/resources/core-default.xml

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2133,9 +2133,11 @@ The switch to turn S3A auditing on or off.
21332133

21342134
<property>
21352135
<name>fs.azure.buffer.dir</name>
2136-
<value>${hadoop.tmp.dir}/abfs</value>
2136+
<value>${env.LOCAL_DIRS:-${hadoop.tmp.dir}}/abfs</value>
21372137
<description>Directory path for buffer files needed to upload data blocks
2138-
in AbfsOutputStream.</description>
2138+
in AbfsOutputStream.
2139+
Yarn container path will be used as default value on yarn applications,
2140+
otherwise fall back to hadoop.tmp.dir </description>
21392141
</property>
21402142

21412143
<property>

0 commit comments

Comments
 (0)