Add JoinType preservation helpers and `dynamic_filter_side`; enable dynamic filter pushdown in HashJoinExec#17518

Closed

kosiew wants to merge 45 commits intoapache:mainfrom

kosiew:df-join-metadata-16973

Commits on Sep 11, 2025

Dynamic Filter and Join Handling Refactor Summary
kosiew
committed
Dynamic Filter Pushdown Enhancements
kosiew
committed
Refactor Dynamic Filter Handling in `HashJoinExec`
kosiew
committed
Refactor dynamic filter side determination in `JoinType` for clarity and correctness
kosiew
committed
Enhance dynamic filter handling in HashJoinExec to support left and right child pushdown
kosiew
committed
Remove unnecessary JoinType imports from dynamic filter pushdown tests
kosiew
committed
Refactor dynamic filter tests to use a helper function for scan creation
kosiew
committed
Refactor dynamic filter pushdown tests: remove unused CoalescePartitionsExec and improve batch creation in build_int32_scan
kosiew
committed
Enhance dynamic filter pushdown logic in HashJoinExec and SharedBoundsAccumulator
kosiew
committed
Refactor dynamic filter handling in HashJoinExec: enforce specified join side and streamline filter creation
kosiew
committed
Implement `preserves` method in `JoinType` to enhance join side preservation checks
kosiew
committed
Add test for dynamic filter pushdown in partitioned HashJoinExec
kosiew
committed
Add tests for dynamic filter pushdown in right and left mark joins in HashJoinExec
kosiew
committed
Revert "Add tests for dynamic filter pushdown in right and left mark joins in HashJoinExec"
kosiew
committed
Add LEFT_PRESERVING and RIGHT_PRESERVING constants for join type preservation checks
kosiew
committed
Add preservation checks for LeftAnti and RightAnti join types
kosiew
committed
Enhance documentation for dynamic_filter_side to clarify behavior with non-preserving join types
kosiew
committed
Refactor imports in filter_pushdown tests for clarity and consistency
kosiew
committed
Remove unused dynamic filter references from HashJoinExec and HashJoinStream
kosiew
committed
Refactor dynamic filter expression handling in HashJoinExec for clarity and maintainability
kosiew
committed
Enhance dynamic filter pushdown in HashJoinExec by adding CoalescePartitionsExec and CoalesceBatchesExec for improved partitioning and batch handling
kosiew
committed
Restore main test_hashjoin_dynamic_filter_pushdown_partitioned
kosiew
committed
Add test for nested hash join dynamic filter pushdown
kosiew
committed
Add comments for tests
kosiew
committed
Implement dynamic filter pushdown support for HashJoinExec
kosiew
committed
Refactor filter pushdown tests to utilize helper functions for building HashJoin and TopK execution plans
kosiew
committed
Enhance dynamic filter selection logic for JoinType to accurately reflect probe sides for various join types
kosiew
committed
Refactor dynamic_filter_side logic to improve join type handling and add tests for preservation logic
kosiew
committed
Fix dynamic filter creation to return an error for unspecified join side and update related logic
kosiew
committed
Clarify documentation for dynamic filter pushdown eligibility in JoinType
kosiew
committed
Add probe-side bounds accumulation for dynamic filter pushdown in HashJoin
kosiew
committed
Add test for dynamic filter bounds accumulation in HashJoinExec
kosiew
committed
Add comment to explain waits_for_all_partitions_before_updating
kosiew
committed
Implement dynamic filter handling for FULL joins and add test for skipping filter creation
kosiew
committed
Fix import path for MaxAccumulator and MinAccumulator in HashJoinStream
kosiew
committed
Merge branch 'main' into df-join-metadata-16973
kosiew
committed
Fix clippy error
kosiew
committed
Clarify comment on dynamic filter pushdown eligibility in JoinType implementation
kosiew
committed
Fix clippy error
kosiew
committed

Commits on Sep 12, 2025

Refactor TestMemoryExec initialization to use schema.clone() for clarity
kosiew
committed

Commits on Sep 13, 2025

Fix clippy error
kosiew
committed