Add spill support in StreamingWindow addInput() Phase

[JkSelf]

#8975

[netlify]

✅ Deploy Preview for meta-velox canceled.

Name	Link
🔨 Latest commit	47b7bf6
🔍 Latest deploy log	https://app.netlify.com/sites/meta-velox/deploys/65e9694cfbe36a0008f59381

[guhaiyan0221]

It seems that the data of a partition is preset here to be fully stored in memory. But in the case of spill, the data that comes back from the spill file often cannot fit into memory. What if part of it is in memory and part of it is in the spill file.

[JkSelf]

@guhaiyan0221 Currently, only one window partition is supported, either it is in memory or it has been spilled. It does not support a part in memory and a part has been spilled. The reason why the data needs to be loaded back into memory here is because the WindowPartition only accepts data in memory and does not accept spilled data. This is also the second step to do. Thanks.

[JkSelf]

@mbasmanova @aditi-pandit @zhztheplayer @guhaiyan0221 @zhouyuan Can you help to review? Thanks.

[mbasmanova]

@JkSelf As discussed in #8975, I do not think it is a good idea to add spilling support to StreamingWindow.

[stale]

This pull request has been automatically marked as stale because it has not had recent activity. If you'd still like this PR merged, please comment on the PR, make sure you've addressed reviewer comments, and rebase on the latest main. Thank you for your contributions!