Skip to content

Conversation

@zhuqi-lucas
Copy link
Contributor

@zhuqi-lucas zhuqi-lucas commented Sep 15, 2025

When we upgrade to DF 49.0.2, there is a critical bug due to unnest changes in DF, this PR fix it in MV.

This PR to add handling to add checking for empty columns when we pushdown partition with unnest column:

        // GUARD: if after pushdown the set of relevant unnest columns is empty,
        // avoid constructing an Unnest node with zero exec columns (which will
        // later error in Unnest::try_new). Instead, simply project the
        // desired output columns from the child plan (after pushing down the child projection).
        // Related PR: https://github.com/apache/datafusion/pull/16632, after that we must
        // also check for empty exec columns here.

@xudong963 xudong963 merged commit 540f29e into datafusion-contrib:main Sep 15, 2025
8 checks passed
@github-actions github-actions bot mentioned this pull request Sep 13, 2025
@github-actions github-actions bot mentioned this pull request Oct 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants