Skip to content

Commit 43fc9aa

Browse files
committed
Update SQL migration guide
1 parent 488f8c8 commit 43fc9aa

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

docs/sql-migration-guide.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,11 @@ license: |
3131
- In Spark 3.1, `from_unixtime`, `unix_timestamp`,`to_unix_timestamp`, `to_timestamp` and `to_date` will fail if the specified datetime pattern is invalid. In Spark 3.0 or earlier, they result `NULL`.
3232

3333
- In Spark 3.1, casting numeric to timestamp will be forbidden by default. It's strongly recommended to use dedicated functions: TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS. Or you can set `spark.sql.legacy.allowCastNumericToTimestamp` to true to work around it. See more details in SPARK-31710.
34-
34+
35+
## Upgrading from Spark SQL 3.0 to 3.0.1
36+
37+
- In Spark 3.0, JSON datasource and JSON function `schema_of_json` infer TimestampType from string values if they match to the pattern defined by the JSON option `timestampFormat`. Since version 3.0.1, the timestamp type inference is disabled by default. Set the JSON option `inferTimestamp` to `true` to enable such type inference.
38+
3539
## Upgrading from Spark SQL 2.4 to 3.0
3640

3741
### Dataset/DataFrame APIs

0 commit comments

Comments
 (0)