Skip to content

Commit 39759ff

Browse files
nchammasMarcelo Vanzin
authored andcommitted
[DOCS][MINOR] Update location of Spark YARN shuffle jar
Looking at the distributions provided on spark.apache.org, I see that the Spark YARN shuffle jar is under `yarn/` and not `lib/`. This change is so minor I'm not sure it needs a JIRA. But let me know if so and I'll create one. Author: Nicholas Chammas <nicholas.chammas@gmail.com> Closes #16130 from nchammas/yarn-doc-fix. (cherry picked from commit 5a92dc7) Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com>
1 parent e23c8cf commit 39759ff

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

docs/running-on-yarn.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -518,7 +518,7 @@ instructions:
518518
pre-packaged distribution.
519519
1. Locate the `spark-<version>-yarn-shuffle.jar`. This should be under
520520
`$SPARK_HOME/common/network-yarn/target/scala-<version>` if you are building Spark yourself, and under
521-
`lib` if you are using a distribution.
521+
`yarn` if you are using a distribution.
522522
1. Add this jar to the classpath of all `NodeManager`s in your cluster.
523523
1. In the `yarn-site.xml` on each node, add `spark_shuffle` to `yarn.nodemanager.aux-services`,
524524
then set `yarn.nodemanager.aux-services.spark_shuffle.class` to

0 commit comments

Comments
 (0)