Skip to content

Conversation

@WorgenZhang
Copy link
Contributor

@WorgenZhang WorgenZhang commented Aug 13, 2021

PR types

Function optimization

PR changes

Others

Describe

CPU-PSLIB在config_fleet.py增加"scale_sparse_gradient_with_batch_size"配置,支持开关功能:grad乘以batch_size
image

@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

yaoxuefeng6
yaoxuefeng6 previously approved these changes Aug 16, 2021
Copy link
Contributor

@yaoxuefeng6 yaoxuefeng6 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

FetchConfig fetch_config_;
bool use_cvm_;
bool no_cvm_;
bool scale_sparse_grad_;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

scale_sparse_gradient_with_batch_size

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

have changed scale_sparse_grad to scale_sparse_gradient_with_batch_size

@yaoxuefeng6 yaoxuefeng6 merged commit d028214 into PaddlePaddle:develop Aug 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants