Skip to content

Conversation

@SigureMo
Copy link
Member

@SigureMo SigureMo commented Sep 2, 2024

PR Category

Execute Infrastructure

PR Types

Performance

Description

之前 SOT 生成代码中的 Symbol 使用 to_tensor 转为 Tensor,但这有一个问题是会产生额外的 memcpy,因此本 PR 使用 full 替换掉 to_tensor 以消除 memcpy 的开销

优化前:

image

优化后:

image

Pcard-67164

@paddle-bot
Copy link

paddle-bot bot commented Sep 2, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@SigureMo SigureMo merged commit 3426069 into PaddlePaddle:develop Sep 3, 2024
@SigureMo SigureMo deleted the sot/use-full-instead-of-to-tensor branch September 3, 2024 11:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants