diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 3dfa63e1cb2e..02547b30d2e5 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -866,7 +866,7 @@ to avoid garbage collection issues during shuffle. The following extra configuration options are available when the shuffle service is running on YARN:
| Property Name | Default | Meaning | |
|---|---|---|---|
| Property Name | Default | Meaning | Since Version |
spark.yarn.shuffle.stopOnFailure |
false |
@@ -875,6 +875,7 @@ The following extra configuration options are available when the shuffle service
initialization. This prevents application failures caused by running containers on
NodeManagers where the Spark Shuffle Service is not running.
+ 2.1.0 | |
spark.yarn.shuffle.service.metrics.namespace |
@@ -883,6 +884,7 @@ The following extra configuration options are available when the shuffle service
The namespace to use when emitting shuffle service metrics into Hadoop metrics2 system of the
NodeManager.
+ 3.2.0 | ||
spark.yarn.shuffle.service.logs.namespace |
@@ -894,6 +896,7 @@ The following extra configuration options are available when the shuffle service
may expect the logger name to look like a class name, it's generally recommended to provide a value which
would be a valid Java package or class name and not include spaces.
+ 3.3.0 | ||
spark.shuffle.service.db.backend |