chore: update to DataFusion 49.0.0

[alamb]

Description

Update to DataFusion 49.0.0

Related Issue(s)

• Related to Release DataFusion 49.0.0 (July 2025) apache/datafusion#16235

Documentation

• See https://datafusion.apache.org/library-user-guide/upgrading.html#datafusion-49-0-0

[github-actions]

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

[codecov]

Codecov Report

❌ Patch coverage is 38.46154% with 8 lines in your changes missing coverage. Please review.
✅ Project coverage is 75.43%. Comparing base (2846081) to head (b971f1e).
⚠️ Report is 3 commits behind head on main.

Files with missing lines	Patch %	Lines
crates/core/src/delta_datafusion/mod.rs	16.66%	5 Missing ⚠️
python/src/writer.rs	0.00%	2 Missing ⚠️
crates/core/src/operations/merge/barrier.rs	80.00%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3603      +/-   ##
==========================================
+ Coverage   74.52%   75.43%   +0.90%     
==========================================
  Files         146      146              
  Lines       44919    44908      -11     
  Branches    44919    44908      -11     
==========================================
+ Hits        33477    33877     +400     
+ Misses       9248     9211      -37     
+ Partials     2194     1820     -374     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[alamb]

I also updated the version of rust used due to a failing CI

https://github.com/delta-io/delta-rs/actions/runs/16379330458/job/46335659927?pr=3603

error: rustc 1.82.0 is not supported by the following packages:
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
Either upgrade rustc or select compatible dependency versions with
`cargo update <name>@<current-ver> --precise <compatible-ver>`
where `<compatible-ver>` is the latest version supporting rustc 1.82.0

error: process didn't exit successfully: `/home/runner/.rustup/toolchains/1.82-x86_64-unknown-linux-gnu/bin/cargo test --tests --manifest-path /home/runner/work/delta-rs/delta-rs/Cargo.toml --target-dir /home/runner/work/delta-rs/delta-rs/target/llvm-cov-target --features integration_test,azure,datafusion,s3,gcs,glue,hdfs --workspace --exclude delta-inspect --exclude deltalake-hdfs --exclude deltalake-lakefs` (exit status: 101)

This came in as part of

• Bump the MSRV to 1.85.1 due to transitive dependencies (aws-sdk) apache/datafusion#16728

I think it deserves a mention in the upgrade guide. I will do so

[ion-elgreco]

@alamb we pinned the aws sdk libraries actually so that we didn't have to bump our rustc version

[alamb]

🎉 thank you @rtyler