Skip to content

Intergrate GLOOParallelContext to support Multi-CPU Core for Dygraph DataParallel #35154

Merged
Aurelius84 merged 13 commits intoPaddlePaddle:developfrom
2742195759:gloo
Sep 8, 2021
Merged

Intergrate GLOOParallelContext to support Multi-CPU Core for Dygraph DataParallel #35154
Aurelius84 merged 13 commits intoPaddlePaddle:developfrom
2742195759:gloo

Conversation

@2742195759
Copy link
Contributor

PR types

New features

PR changes

APIs

Describe

add support for cpu only parallel training

@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@Aurelius84 Aurelius84 changed the title can pass the fake test Intergrate GLOOParallelContext to support Multi-CPU Core for DataParallel Aug 25, 2021
@Aurelius84 Aurelius84 changed the title Intergrate GLOOParallelContext to support Multi-CPU Core for DataParallel Intergrate GLOOParallelContext to support Multi-CPU Core for Dygraph DataParallel Aug 25, 2021
Copy link
Contributor

@XiaoguangHu01 XiaoguangHu01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LG API

Copy link

@sandyhouse sandyhouse left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Aurelius84 Aurelius84 merged commit 51cc73f into PaddlePaddle:develop Sep 8, 2021
2742195759 added a commit to 2742195759/Paddle that referenced this pull request Sep 10, 2021
…DataParallel (PaddlePaddle#35154)

* can pass the fake test

* add files

* modify cmake to pass windows-ci

* for ci pass

* WITH_GLOO=ON

* for pass coverage test

* add cpuonly testcase

* add

* disable nccl when compile with cuda

* change python version in cpuonly

* add backend argument

* add required gpu

* add required:gpu
AnnaTrainingG pushed a commit to AnnaTrainingG/Paddle that referenced this pull request Sep 29, 2021
…DataParallel (PaddlePaddle#35154)

* can pass the fake test

* add files

* modify cmake to pass windows-ci

* for ci pass

* WITH_GLOO=ON

* for pass coverage test

* add cpuonly testcase

* add

* disable nccl when compile with cuda

* change python version in cpuonly

* add backend argument

* add required gpu

* add required:gpu
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants