Update Gelu Fusion to support new graph pattern from PyTorch 1.4 #3148
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
yufenglee
pushed a commit
that referenced
this pull request
Mar 6, 2020
* update GeluFusion to support pattern from PyTorch 1.4; * Fix a bug that missing the check of an edge between mul2 and root. * update script to fuse gelu from PyTorch 1.4 * Add test for python optimizer
yufenglee
added a commit
that referenced
this pull request
Mar 7, 2020
* Publish release symbols (#3152) * Publish release symbols * Publish symbols if IsReleaseBuild * Disable delayload for cuda dlls (#3147) This change fixes #3129. When running onnxruntime as dll on Windows, CUDA does some internal cleanups when process exits. After this, any call to CUDA would cause crash. Delayload makes thread_local destructor to happen after CUDA cleanup, thus the crash. * Update Gelu Fusion to support new graph pattern from PyTorch 1.4 (#3148) * update GeluFusion to support pattern from PyTorch 1.4; * Fix a bug that missing the check of an edge between mul2 and root. * update script to fuse gelu from PyTorch 1.4 * Add test for python optimizer Co-authored-by: Tiago Koji Castro Shibata <[email protected]> Co-authored-by: KeDengMS <[email protected]> Co-authored-by: Tianlei Wu <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description:
Gelu subgraph exported from PyTorch 1.4 is different from previous version. Update the Gelu Fusion to support the new pattern.
Motivation and Context
Without this change, BERT model exported by PyTorch cannot be fully optimized since Gelu cannot be fused.