Skip to content

[PIR] Adapt distributed API all_reduce #62694

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
SigureMo merged 9 commits into from
Mar 19, 2024
Merged

[PIR] Adapt distributed API all_reduce #62694

SigureMo merged 9 commits into from
Mar 19, 2024

Conversation

@SigureMo
Copy link
Member

@SigureMo SigureMo commented Mar 13, 2024 •
edited
Loading

PR types

Others

PR changes

Others

Description

适配分布式 API all_reduce，为 inplace 操作

参考分布式 API 动态图单测，复用起多进程逻辑，复用在动态图下起通信组逻辑，组网执行使用静态图

Pcard-67164

@paddle-bot
Copy link

paddle-bot bot commented Mar 13, 2024

你的PR提交成功，感谢你对开源项目的贡献!
请关注后续CI自动化测试结果，详情请参考Paddle-CI手册。
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@SigureMo SigureMo changed the title [PIR] Adapt distributed API allreduce [PIR] Adapt distributed API allreduce and wait Mar 15, 2024
@SigureMo SigureMo mentioned this pull request Mar 15, 2024
Closed
@SigureMo SigureMo changed the title [PIR] Adapt distributed API allreduce and wait [PIR] Adapt distributed API all_reduce and wait Mar 15, 2024
@SigureMo SigureMo changed the title [PIR] Adapt distributed API all_reduce and wait [PIR] Adapt distributed API all_reduce Mar 17, 2024
JZ-LIANG
JZ-LIANG approved these changes Mar 18, 2024
View reviewed changes
Copy link
Contributor

@JZ-LIANG JZ-LIANG left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

sunzhongkai588
sunzhongkai588 approved these changes Mar 18, 2024
View reviewed changes
Copy link
Contributor

@sunzhongkai588 sunzhongkai588 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

XiaoguangHu01
XiaoguangHu01 approved these changes Mar 19, 2024
View reviewed changes
Copy link
Contributor

@XiaoguangHu01 XiaoguangHu01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@SigureMo SigureMo merged commit 55aba83 into PaddlePaddle:develop Mar 19, 2024
@SigureMo SigureMo deleted the pir/adapt-dist-op-allreduce branch March 19, 2024 02:30
@risemeup1 risemeup1 mentioned this pull request May 21, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@YuanRisheng YuanRisheng YuanRisheng approved these changes

@XieYunshen XieYunshen XieYunshen approved these changes

@JZ-LIANG JZ-LIANG JZ-LIANG approved these changes

@XiaoguangHu01 XiaoguangHu01 XiaoguangHu01 approved these changes

@sunzhongkai588 sunzhongkai588 sunzhongkai588 approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@SigureMo @YuanRisheng @XieYunshen @JZ-LIANG @XiaoguangHu01 @sunzhongkai588