Skip to content

Commit 1d35863

Browse files
committed
Merge pull request apache#36 from mesosphere/suzanne/anchor-tags
anchor tags
2 parents 32e80a3 + e6fb08d commit 1d35863

1 file changed

Lines changed: 8 additions & 1 deletion

File tree

docs/user-docs.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,7 @@ DCOS Spark includes:
3535
* [Kafka][5]
3636
* [Zeppelin][6]
3737

38+
<a name="quick-start"></a>
3839
# Quick Start
3940

4041
1. Install DCOS Spark via the DCOS CLI:
@@ -53,6 +54,7 @@ DCOS Spark includes:
5354
5455
Visit the Spark cluster dispatcher at `http://<dcos-url>/service/spark/` to view the status of your job. Also visit the Mesos UI at `http://<dcos-url>/mesos/` to see job logs.
5556
57+
<a name="install"></a>
5658
# Install
5759
5860
To start a basic Spark cluster, run the following command on the DCOS CLI. This command installs the dispatcher, and, optionally, the history server. See [Custom Installation][7] to install the history server.
@@ -378,6 +380,7 @@ To use a specific Spark instance from the DCOS Spark CLI:
378380
$ dcos config set spark.app_id <service.name>
379381
```
380382
383+
<a name="upgrade"></a>
381384
# Upgrade
382385
383386
1. In the Marathon web interface, destroy the Spark instance to be updated.
@@ -387,7 +390,7 @@ $ dcos config set spark.app_id <service.name>
387390
```
388391
$ dcos package install spark
389392
```
390-
393+
<a name="run-a-spark-job"></a>
391394
# Run a Spark Job
392395
393396
1. Before submitting your job, upload the artifact (e.g., jar file) to a location visible to the cluster (e.g., S3 or HDFS). [Learn more][13].
@@ -437,6 +440,7 @@ $ dcos spark run --submit-args="-Dspark.executor.memory=4g --class MySampleClass
437440
438441
To set Spark properties with a configuration file, create a `spark-defaults.conf` file and set the environment variable `SPARK_CONF_DIR` to the containing directory. [Learn more][15].
439442
443+
<a name="uninstall"></a>
440444
# Uninstall
441445
442446
```
@@ -445,6 +449,7 @@ $ dcos package uninstall --app-id=&lt;app-id&gt; spark
445449
446450
The Spark dispatcher persists state in Zookeeper, so to fully uninstall the Spark DCOS package, you must go to `http://<dcos-url>/exhibitor`, click on `Explorer`, and delete the znode corresponding to your instance of Spark. By default this is `spark_mesos_Dispatcher`.
447451
452+
<a name="runtime-configuration-change"></a>
448453
# Runtime Configuration Change
449454
450455
You can customize DCOS Spark in-place when it is up and running.
@@ -459,6 +464,7 @@ You can customize DCOS Spark in-place when it is up and running.
459464
460465
5. Click `Change and deploy configuration` to apply any changes and cleanly reload Spark.
461466
467+
<a name="troubleshooting"></a>
462468
# Troubleshooting
463469
464470
## Dispatcher
@@ -485,6 +491,7 @@ To debug authentication in a Spark job, enable Java security debug output:
485491
$ dcos spark run --submit-args="-Dsun.security.krb5.debug=true..."
486492
```
487493
494+
<a name="limitations"></a>
488495
# Limitations
489496
490497
* DCOS Spark only supports submitting jars. It does not support Python or R.

0 commit comments

Comments
 (0)