Skip to content

pipeline parallel benchmark#7759

Merged
ZHUI merged 6 commits into
PaddlePaddle:developfrom
zhangting2020:develop
Jan 9, 2024
Merged

pipeline parallel benchmark#7759
ZHUI merged 6 commits into
PaddlePaddle:developfrom
zhangting2020:develop

Conversation

@zhangting2020
Copy link
Copy Markdown
Contributor

@zhangting2020 zhangting2020 commented Jan 2, 2024

PR types

Others

PR changes

Others

Description

pipeline parallel benchmark

pp8下设置seed原因是受参数初始化影响,某些seed下收敛到单卡的效果可能需要较多的步数,pr中设置的seed可以保证在较少步数下,得到较为对称的loss diff曲线

@paddle-bot
Copy link
Copy Markdown

paddle-bot Bot commented Jan 2, 2024

Thanks for your contribution!

@codecov
Copy link
Copy Markdown

codecov Bot commented Jan 2, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (dab175b) 57.12% compared to head (d65e020) 57.12%.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop    #7759   +/-   ##
========================================
  Coverage    57.12%   57.12%           
========================================
  Files          587      587           
  Lines        88190    88190           
========================================
  Hits         50376    50376           
  Misses       37814    37814           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@ZHUI ZHUI merged commit d51edd0 into PaddlePaddle:develop Jan 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants