Commit c76595f
Consolidate ArrowFileSource and ArrowStreamFileSource
This commit consolidates the separate ArrowFileSource and ArrowStreamFileSource
implementations into a unified ArrowSource with an ArrowFormat enum.
Key changes:
- Removed ArrowFileSource and ArrowStreamFileSource structs
- Added ArrowFormat enum (File, Stream) to distinguish between formats
- Created unified ArrowSource struct that uses ArrowFormat to dispatch
- Kept separate ArrowFileOpener and ArrowStreamFileOpener implementations
- Consolidated all FileSource trait implementations in ArrowSource
- Format-specific behavior in repartitioned() method (Stream returns None)
This consolidation reduces code duplication while maintaining clear separation
of concerns between the file and stream format handling.
Part of apache#18627
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <[email protected]>1 parent cfb26b6 commit c76595f
1 file changed
+104
-248
lines changed
0 commit comments