-
Notifications
You must be signed in to change notification settings - Fork 9.2k
HADOOP-19195:Upgrade aws sdk v2 to 2.25.53 #6900
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
💔 -1 overall
This message was automatically generated. |
|
@HarshitGupta11 if possible can you please bump this to 2.25.70 instead, we are pursuing another change from s3 which is required from S3 Access grants which release contains i.e support for Copy and Delete Obj. |
|
@singhpk234 how about we merge this and you do the followup JIRA for the new update with a full qualification as per testing.md Harshit has already done a full stack regression test with this one and so while increasing the version number might seem minor, the retesting is the work. If you don't have an ASF JIRA account, follow the jira instructions, say you want to work on s3a integration issues and we will grant it. |
|
merged, will cherrypick and retest on branch-3.4. |
Contributed by Harshit Gupta
Contributed by Harshit Gupta
Contributed by Harshit Gupta
This reverts commit fc86a52. This rollback is due to: HADOOP-19272. S3A: AWS SDK 2.25.53 warnings logged about transfer manager not using CRT client Change-Id: I324f75d62daa02650ff9d199a2e0fc465a2ea28a
### What changes were proposed in this pull request? This PR aims to upgrade AWS SDK v2 to 2.25.53. ### Why are the changes needed? Like HADOOP-19195 (Apache Hadoop 3.4.2+), Apache Spark 4.0.0 had better use the latest one. - apache/hadoop#6900 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #49533 from dongjoon-hyun/SPARK-50859. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
### What changes were proposed in this pull request? This PR aims to upgrade AWS SDK v2 to 2.25.53. ### Why are the changes needed? Like HADOOP-19195 (Apache Hadoop 3.4.2+), Apache Spark 4.0.0 had better use the latest one. - apache/hadoop#6900 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #49533 from dongjoon-hyun/SPARK-50859. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]> (cherry picked from commit baf13fb) Signed-off-by: Dongjoon Hyun <[email protected]>
### What changes were proposed in this pull request? This PR aims to upgrade AWS SDK v2 to 2.25.53. ### Why are the changes needed? Like HADOOP-19195 (Apache Hadoop 3.4.2+), Apache Spark 4.0.0 had better use the latest one. - apache/hadoop#6900 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#49533 from dongjoon-hyun/SPARK-50859. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]> (cherry picked from commit 7ba7dd5) Signed-off-by: Dongjoon Hyun <[email protected]>
Description of PR
Upgrading aws sdk to 2.25.53
How was this patch tested?
The patch was tested using documentation on access points, instance profile roles and scale tests against us-west-2.
For code changes:
LICENSE,LICENSE-binary,NOTICE-binaryfiles?