-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-25711][Core] Improve start-history-server.sh: show usage User-Friendly and remove deprecated options #22699
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 1 commit
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -28,7 +28,22 @@ if [ -z "${SPARK_HOME}" ]; then | |
| export SPARK_HOME="$(cd "`dirname "$0"`"/..; pwd)" | ||
| fi | ||
|
|
||
| # NOTE: This exact class name is matched downstream by SparkSubmit. | ||
| # Any changes need to be reflected there. | ||
| CLASS="org.apache.spark.deploy.history.HistoryServer" | ||
|
|
||
| if [[ "$@" = *--help ]] || [[ "$@" = *-h ]]; then | ||
| echo "Usage: ./sbin/start-history-server.sh [options]" | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. nit: why not have a separated
Member
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Well this is short, and I am following what
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Well, I also saw similar code in |
||
| pattern="Usage:" | ||
| pattern+="\|Using Spark's default log4j profile:" | ||
| pattern+="\|Started daemon with process name" | ||
| pattern+="\|Registered signal handler for" | ||
|
|
||
| "${SPARK_HOME}"/bin/spark-class $CLASS --help 2>&1 | grep -v "$pattern" 1>&2 | ||
| exit 1 | ||
| fi | ||
|
|
||
| . "${SPARK_HOME}/sbin/spark-config.sh" | ||
| . "${SPARK_HOME}/bin/load-spark-env.sh" | ||
|
|
||
| exec "${SPARK_HOME}/sbin"/spark-daemon.sh start org.apache.spark.deploy.history.HistoryServer 1 "$@" | ||
| exec "${SPARK_HOME}/sbin"/spark-daemon.sh start $CLASS 1 "$@" | ||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
IIUC this is not related to the PR description?
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No, it is related. For the last single argument, it is treated as the event log directory.
See the deleted code
I prefer to keep the behavior.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
sounds good.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I see. I have updated the description.