Skip to content

[AutoParallel] update naive data parallel completion #47578

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Nov 7, 2022
Merged

[AutoParallel] update naive data parallel completion #47578

merged 3 commits into from
Nov 7, 2022

Conversation

@zhaoyinglia
Copy link
Contributor

@zhaoyinglia zhaoyinglia commented Nov 2, 2022 •
edited
Loading

PR types

Others

PR changes

Others

Describe

  • 纯数据并行的补全规则修改为：递推过程从前往后仅走一遍，避免类似 transpose op 修改了 batch 维度后的错误。
  • expand op 及其类似的 op，必须通过多次迭代才能正确补全，不能走纯数据并行的补全规则

@paddle-bot
Copy link

paddle-bot bot commented Nov 2, 2022

你的PR提交成功，感谢你对开源项目的贡献!
请关注后续CI自动化测试结果，详情请参考Paddle-CI手册。
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

JZ-LIANG
JZ-LIANG approved these changes Nov 7, 2022
View reviewed changes
Copy link
Contributor

@JZ-LIANG JZ-LIANG left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@JZ-LIANG JZ-LIANG merged commit 9db507f into PaddlePaddle:develop Nov 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@JZ-LIANG JZ-LIANG JZ-LIANG approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@zhaoyinglia @JZ-LIANG