-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Enable Parallel Aggregation for Non-Overlapping Partitioned Data #18826
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enable Parallel Aggregation for Non-Overlapping Partitioned Data #18826
Conversation
78e9af0 to
be508b7
Compare
48b2e63 to
57aa0f1
Compare
|
cc: @NGA-TRAN |
|
Thanks @gene-bordegaray — impressive performance improvement! I’ll plan to review this during the first week of December. Adding a feature design description to the PR would be helpful for context. If you identify any follow‑up work, feel free to open tickets, link this PR there, and continue working on next PRs on top of this branch. |
57aa0f1 to
09f9570
Compare
e55b75c to
e7a2812
Compare
e7a2812 to
5bcded3
Compare
|
I am going to close this PR and open a new one with my refactored apporach and cleaner history See here: #18919 |
Will finish later
Which issue does this PR close?
Rationale for this change
What changes are included in this PR?
Are these changes tested?
Benchmark results:
TPCH remains unchange as expected since the files don't use Hive-Partitioning
I created my own benchmark using partitioned by partitioning spf1 and spf10 benches to use the optimizations. This benchmark ran the query:
Are there any user-facing changes?