Skip to content

[SPARK-24639][DOC] Add three config in the doc #21624

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
xueyumusic wants to merge 3 commits into from
Closed

[SPARK-24639][DOC] Add three config in the doc #21624

Changes from 1 commit
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
16c256d
add some configs
xueyumusic Jun 23, 2018
b7c9704
modify config meaning
xueyumusic Jun 27, 2018
6886111
Merge branch 'master' into addconfig1
xueyumusic Jun 29, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions docs/configuration.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -456,6 +456,13 @@ Apart from these, the following properties are also available, and may be useful
from JVM to Python worker for every task.
</td>
</tr>
<tr>
<td><code>spark.python.task.killTimeout</code></td>
<td>2s</td>
<td>
How long to wait before killing the python worker if a task cannot be interrupted.
Copy link
Contributor

@jiangxb1987 jiangxb1987 Jun 26, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Timeout to wait before killing the python worker when a task cannot be interrupted."

Copy link
Contributor Author

@xueyumusic xueyumusic Jun 29, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated and fix confilct, please have a review, thanks, @zsxwing @jiangxb1987

</td>
</tr>
<tr>
<td><code>spark.sql.repl.eagerEval.enabled</code></td>
<td>false</td>
Expand Down Expand Up @@ -568,6 +575,13 @@ Apart from these, the following properties are also available, and may be useful
Python binary executable to use for PySpark in both driver and executors.
</td>
</tr>
<tr>
<td><code>spark.worker.driverTerminateTimeout</code></td>
Copy link
Member

@srowen srowen Jul 31, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Likewise spark.worker.* configs are in spark-standalone.md, it appears

<td>10s</td>
<td>
Timeout to wait for when trying to terminate a driver.
</td>
</tr>
</table>

### Shuffle Behavior
Expand Down Expand Up @@ -798,6 +812,13 @@ Apart from these, the following properties are also available, and may be useful
Buffer size to use when writing to output streams, in KiB unless otherwise specified.
</td>
</tr>
<tr>
<td><code>spark.ui.consoleProgress.update.interval</code></td>
<td>200</td>
<td>
Update period of progress bar, in milliseconds
</td>
</tr>
<tr>
<td><code>spark.ui.enabled</code></td>
<td>true</td>
Expand Down