[AutoParallel] pp dataloader align mode#73941
[AutoParallel] pp dataloader align mode#73941xuxinyi389 merged 9 commits intoPaddlePaddle:developfrom
Conversation
|
你的PR提交成功，感谢你对开源项目的贡献! |
… add_align_mode_for_data_process
Codecov Report❌ Patch coverage is
❌ Your patch status has failed because the patch coverage (21.42%) is below the target coverage (90.00%). You can increase the patch coverage or adjust the target coverage. Additional details and impacted files@@ Coverage Diff @@
## develop #73941 +/- ##
==========================================
Coverage ? 21.42%
==========================================
Files ? 1
Lines ? 14
Branches ? 0
==========================================
Hits ? 3
Misses ? 11
Partials ? 0 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
CI单测有点问题，这里放本地测试coverage的截图
|
|
Sorry to inform you that b2b9f60's CIs have passed for more than 7 days. To prevent PR conflicts, you need to re-run all CIs manually. |
… add_align_mode_for_data_process
| dp_pp_align_mode_losses, | ||
| dp_pp_losses, | ||
| rtol=1e-5, | ||
| ) |
There was a problem hiding this comment.
喂入顺序完全一致时，是否第一个step的前向loss，两种情况下的md5需要完全相同？
|
/re-run all-failed |
|
/re-run all-failed |
5 participants
PR Category
Auto Parallel
PR Types
Others
Description
添加动半向动手对齐时，dp下dataloader的逻辑对齐，当前两种模式的逻辑如下图所示：
