Introduce unified `DataSourceExec` for provided datasources, remove `ParquetExec`, `CsvExec`, etc#14224

Merged

ozankabak merged 86 commits intoapache:mainfrom

synnada-ai:chore/single-source-exec

Feb 6, 2025

Commits on Jan 7, 2025

unify ParquetExec, AvroExec, ArrowExec, NDJsonExec, MemoryExec into one DataSourceExec plan
mertak-synnada
committed
Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
fix license headers
mertak-synnada
committed
fix compile errors on documents
mertak-synnada
committed
separate non-parquet code
mertak-synnada
committed

Commits on Jan 8, 2025

format code
mertak-synnada
committed
fix typo
mertak-synnada
committed
fix imports
mertak-synnada
committed
fix clippy
mertak-synnada
committed
Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
add comment to the example
mertak-synnada
committed
fix cargo docs
mertak-synnada
committed
change MemoryExec with MemorySourceConfig
mertak-synnada
committed

Commits on Jan 10, 2025

Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
merge fixes
mertak-synnada
committed
change MemoryExec to DataSourceExec
mertak-synnada
committed

Commits on Jan 15, 2025

Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
fix merge conflicts
mertak-synnada
committed
apply some syntactic sugars
mertak-synnada
committed
fix imports and comment line
mertak-synnada
committed
simplify some lines
mertak-synnada
committed
rename source_config as file_source
mertak-synnada
committed
format code
mertak-synnada
committed
format code
mertak-synnada
committed
make memory metrics default behavior
mertak-synnada
committed

Commits on Jan 16, 2025

remove unnecessary cfg check
mertak-synnada
committed
format code
mertak-synnada
committed
Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
remove ParquetExec strings
mertak-synnada
committed
fix documents and imports
mertak-synnada
committed
fix imports
mertak-synnada
committed

Commits on Jan 17, 2025

Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed

Commits on Jan 20, 2025

add constraints and fix tests
mertak-synnada
committed
delete redundant file
mertak-synnada
committed
make metrics and statistics a part of File type specific configurations
mertak-synnada
committed
format code
mertak-synnada
committed
Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
fix tests
mertak-synnada
committed
format code
mertak-synnada
committed

Commits on Jan 21, 2025

split repartitioning into DataSourceExec and FileSourceConfig parts
mertak-synnada
committed
move properties into DataSourceExec and split eq_properties and output_partitioning in DataSource trait
mertak-synnada
committed
clone source with Arc
mertak-synnada
committed
return file type as enum and do not downcast if not necessary
mertak-synnada
committed
Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
format code
mertak-synnada
committed
re-add deprecated plans in order to support backward compatibility
mertak-synnada
committed
reduce diff
mertak-synnada
committed
fix doc
mertak-synnada
committed

Commits on Jan 23, 2025

Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
merge fixes
mertak-synnada
committed
remove unnecessary files
mertak-synnada
committed

Commits on Jan 24, 2025

rename config structs to source
mertak-synnada
committed
Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
remove empty files
mertak-synnada
committed
removed FileSourceConfig
mertak-synnada
committed
fix base_config formatting
mertak-synnada
committed
format code
mertak-synnada
committed
fix repartition logic
mertak-synnada
committed

Commits on Feb 3, 2025

Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
fix merge conflicts
mertak-synnada
committed
fix csv projection error
mertak-synnada
committed
clippy fix
mertak-synnada
committed
use new() on initialization
mertak-synnada
committed

Commits on Feb 4, 2025

Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
use DataSourceExec on deprecated file operators as well
mertak-synnada
committed
move ParquetSource into source.rs
mertak-synnada
committed
use ParquetSource only if parquet feature is enabled
mertak-synnada
committed
Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
fix slt tests
mertak-synnada
committed

Commits on Feb 5, 2025

add with_fetch API to MemorySourceConfig and re-add deprecated MemoryExec
mertak-synnada
committed
Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
fix merge conflicts
mertak-synnada
committed
format code
mertak-synnada
committed

Commits on Feb 6, 2025

change FileType enum into a dyn Trait so that it can be extensible
mertak-synnada
committed
remove metadata_size_hint from required ParquetSource parameters
mertak-synnada
committed
remove FileType trait and split with_predicate logic for ParquetSource
mertak-synnada
committed
remove predicate from initialization of ParquetSource
mertak-synnada
committed
remove unnecessary imports
mertak-synnada
committed
deprecate ParquetExecBuilder and add doc hints
mertak-synnada
committed
Merge branch 'refs/heads/apache_main' into chore/single-source-exec
mertak-synnada
committed
fix slt
mertak-synnada
committed
fix clippy
mertak-synnada
committed
fix fmt
mertak-synnada
committed
return reference of the Arc in source()
mertak-synnada
committed
re-add deprecated exec files
mertak-synnada
committed
fix doc error
mertak-synnada
committed