diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 3dfa63e1cb2e..02547b30d2e5 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -866,7 +866,7 @@ to avoid garbage collection issues during shuffle. The following extra configuration options are available when the shuffle service is running on YARN: - + @@ -875,6 +875,7 @@ The following extra configuration options are available when the shuffle service initialization. This prevents application failures caused by running containers on NodeManagers where the Spark Shuffle Service is not running. + @@ -883,6 +884,7 @@ The following extra configuration options are available when the shuffle service The namespace to use when emitting shuffle service metrics into Hadoop metrics2 system of the NodeManager. + @@ -894,6 +896,7 @@ The following extra configuration options are available when the shuffle service may expect the logger name to look like a class name, it's generally recommended to provide a value which would be a valid Java package or class name and not include spaces. +
Property NameDefaultMeaning
Property NameDefaultMeaningSince Version
spark.yarn.shuffle.stopOnFailure false2.1.0
spark.yarn.shuffle.service.metrics.namespace3.2.0
spark.yarn.shuffle.service.logs.namespace3.3.0
spark.shuffle.service.db.backend