Skip to content

[AMP] add amp for final_state_dygraph#40945

Merged
zhangbo9674 merged 4 commits intoPaddlePaddle:developfrom
zhangbo9674:dev/amp_final
Mar 26, 2022
Merged

[AMP] add amp for final_state_dygraph#40945
zhangbo9674 merged 4 commits intoPaddlePaddle:developfrom
zhangbo9674:dev/amp_final

Conversation

@zhangbo9674
Copy link
Copy Markdown
Contributor

@zhangbo9674 zhangbo9674 commented Mar 25, 2022

PR types

New features

PR changes

Others

Describe

amp适配新动态图最终态,设计思路与amp适配中间态一致: pr 46023

利用自动代码生成在前向api插入amp执行逻辑:
图片

@paddle-bot-old
Copy link
Copy Markdown

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@PaddlePaddle PaddlePaddle locked and limited conversation to collaborators Mar 25, 2022
@PaddlePaddle PaddlePaddle unlocked this conversation Mar 25, 2022
Copy link
Copy Markdown
Contributor

@JiabinYang JiabinYang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

VLOG(6) << "AMP AmpAutoCasts:"
<< " input(" << input_name << ") dst_dtype("
<< paddle::framework::DataType2String(dst_dtype) << ").";
if (dst_dtype == paddle::experimental::DataType::FLOAT16) {
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe construct a list to solve
all corner cases

Copy link
Copy Markdown
Contributor

@zhiqiu zhiqiu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zhangbo9674 zhangbo9674 merged commit 3b89542 into PaddlePaddle:develop Mar 26, 2022
@zhangbo9674 zhangbo9674 changed the title [AMP] add amp for final_status_dygraph [AMP] add amp for final_state_dygraph Mar 26, 2022
@zhangbo9674 zhangbo9674 deleted the dev/amp_final branch March 2, 2023 02:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants