Skip to content

Commit eb57d4f

Browse files
yhuailiancheng
authored andcommitted
[SQL] Use path.makeQualified in newParquet.
Author: Yin Huai <yhuai@databricks.com> Closes #5353 from yhuai/wrongFS and squashes the following commits: 849603b [Yin Huai] Not use deprecated method. 6d6ae34 [Yin Huai] Use path.makeQualified. (cherry picked from commit da25c86) Signed-off-by: Cheng Lian <lian@databricks.com>
1 parent 3366af6 commit eb57d4f

1 file changed

Lines changed: 2 additions & 1 deletion

File tree

sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -268,7 +268,8 @@ private[sql] case class ParquetRelation2(
268268
// containing Parquet files (e.g. partitioned Parquet table).
269269
val baseStatuses = paths.distinct.map { p =>
270270
val fs = FileSystem.get(URI.create(p), sparkContext.hadoopConfiguration)
271-
val qualified = fs.makeQualified(new Path(p))
271+
val path = new Path(p)
272+
val qualified = path.makeQualified(fs.getUri, fs.getWorkingDirectory)
272273

273274
if (!fs.exists(qualified) && maybeSchema.isDefined) {
274275
fs.mkdirs(qualified)

0 commit comments

Comments
 (0)