From 777b7f75e4b2547aebdda486367168f23cdfa8c5 Mon Sep 17 00:00:00 2001 From: wforget <643348094@qq.com> Date: Tue, 16 Jul 2024 21:03:30 +0800 Subject: [PATCH 1/2] [SPARK-47307][DOCS][FOLLOWUP] Add a migration guide for the behavior change of base64 function --- docs/sql-migration-guide.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/sql-migration-guide.md b/docs/sql-migration-guide.md index 4707e491fa674..87d0b0ec733ce 100644 --- a/docs/sql-migration-guide.md +++ b/docs/sql-migration-guide.md @@ -64,6 +64,7 @@ license: | ## Upgrading from Spark SQL 3.5.1 to 3.5.2 - Since 3.5.2, MySQL JDBC datasource will read TINYINT UNSIGNED as ShortType, while in 3.5.1, it was wrongly read as ByteType. +- Since 3.5.2, the `base64` function will return a non-chunked string. To restore the previous behavior where base64 encoded strings that chunked into lines of at most 76 characters, set `spark.sql.legacy.chunkBase64String.enabled` to `true`. ## Upgrading from Spark SQL 3.5.0 to 3.5.1 From c4bc0c0ed4780630d98d67a484fcdcae9a13287c Mon Sep 17 00:00:00 2001 From: wforget <643348094@qq.com> Date: Tue, 16 Jul 2024 23:09:18 +0800 Subject: [PATCH 2/2] address comment --- docs/sql-migration-guide.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/sql-migration-guide.md b/docs/sql-migration-guide.md index 87d0b0ec733ce..b65e6527b9e0f 100644 --- a/docs/sql-migration-guide.md +++ b/docs/sql-migration-guide.md @@ -64,7 +64,7 @@ license: | ## Upgrading from Spark SQL 3.5.1 to 3.5.2 - Since 3.5.2, MySQL JDBC datasource will read TINYINT UNSIGNED as ShortType, while in 3.5.1, it was wrongly read as ByteType. -- Since 3.5.2, the `base64` function will return a non-chunked string. To restore the previous behavior where base64 encoded strings that chunked into lines of at most 76 characters, set `spark.sql.legacy.chunkBase64String.enabled` to `true`. +- Since 3.5.2, the `base64` function will return a non-chunked string. To restore the behavior of chunking base64 encoded strings into lines of at most 76 characters, set `spark.sql.legacy.chunkBase64String.enabled` to `true`. ## Upgrading from Spark SQL 3.5.0 to 3.5.1