-
-
Notifications
You must be signed in to change notification settings - Fork 9.8k
[Misc] Move M-RoPE init logic to _init_mrope_positions #23422
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: Woosuk Kwon <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request refactors the M-RoPE initialization logic from the _update_states
method into a new dedicated private method, _init_mrope_positions
. This is a good code improvement that enhances readability and modularity by isolating a specific piece of functionality. The implementation is a direct move of the existing logic, so correctness is maintained and there are no performance implications. Overall, this is a clean and beneficial refactoring.
…23422) Signed-off-by: Woosuk Kwon <[email protected]> Signed-off-by: FFFfff1FFFfff <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]> Signed-off-by: Xiao Yu <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]> Signed-off-by: Xiao Yu <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]>
…23422) Signed-off-by: Woosuk Kwon <[email protected]>
A simple code cleanup.