Skip to content

Conversation

@onursatici
Copy link
Contributor

What changes were proposed in this pull request?

Do not include jdbc properties which may contain credentials in logging a logical plan with SaveIntoDataSourceCommand in it.

How was this patch tested?

new tests

@onursatici
Copy link
Contributor Author

follow-up of #19708

@gatorsmile
Copy link
Member

ok to test


override def simpleString: String = {
val redacted = Utils.redact(SparkEnv.get.conf, options.toSeq).toMap
s"SaveIntoDataSourceCommand ${dataSource}, ${redacted}, ${mode}"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

dataSource does not exist in 2.2

@SparkQA
Copy link

SparkQA commented Nov 16, 2017

Test build #83922 has finished for PR 19761 at commit fd36d2f.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@onursatici onursatici changed the title [SPARK-22479][SQL][BRANCH-2.2] Exclude credentials from SaveintoDataSourceCommand.simpleString [WIP][SPARK-22479][SQL][BRANCH-2.2] Exclude credentials from SaveintoDataSourceCommand.simpleString Nov 16, 2017
@SparkQA
Copy link

SparkQA commented Nov 16, 2017

Test build #83923 has finished for PR 19761 at commit ba4d590.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Nov 16, 2017

Test build #83924 has finished for PR 19761 at commit adbf94e.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@onursatici onursatici changed the title [WIP][SPARK-22479][SQL][BRANCH-2.2] Exclude credentials from SaveintoDataSourceCommand.simpleString [SPARK-22479][SQL][BRANCH-2.2] Exclude credentials from SaveintoDataSourceCommand.simpleString Nov 16, 2017
@cloud-fan
Copy link
Contributor

thanks, merging to 2.2!

asfgit pushed a commit that referenced this pull request Nov 16, 2017
…ourceCommand.simpleString

## What changes were proposed in this pull request?

Do not include jdbc properties which may contain credentials in logging a logical plan with `SaveIntoDataSourceCommand` in it.

## How was this patch tested?
new tests

Author: osatici <[email protected]>

Closes #19761 from onursatici/os/redact-jdbc-creds-2.2.
@gatorsmile
Copy link
Member

@onursatici Could you please close it?

@jiangxb1987
Copy link
Contributor

ping @onursatici

@onursatici onursatici closed this Nov 20, 2017
MatthewRBruce pushed a commit to Shopify/spark that referenced this pull request Jul 31, 2018
…ourceCommand.simpleString

## What changes were proposed in this pull request?

Do not include jdbc properties which may contain credentials in logging a logical plan with `SaveIntoDataSourceCommand` in it.

## How was this patch tested?
new tests

Author: osatici <[email protected]>

Closes apache#19761 from onursatici/os/redact-jdbc-creds-2.2.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants