Skip to content

[Patch] Remove spec_decode.metrics patch #1016

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 9, 2025

Conversation

shen-shanshan
Copy link
Collaborator

@shen-shanshan shen-shanshan commented May 29, 2025

What this PR does / why we need it?

Remove spec_decode.metrics patch as this has been resolved in vllm-project/vllm#16983 (include in vllm v0.9.0).

Returns a CUDA event recording when the copy is complete --after modified--> Returns a device event (NPU Event for vllm-ascend) recording when the copy is complete.

Does this PR introduce any user-facing change?

How was this patch tested?

@wangxiyuan wangxiyuan added long-term-test enable long term test for PR ready-for-test start test by label for PR labels May 30, 2025
@Yikun
Copy link
Collaborator

Yikun commented May 31, 2025

the pr number in commit msg seems wrong? pls update, and update commit msg completely, especially, note the existing or new added test

@shen-shanshan
Copy link
Collaborator Author

the pr number in commit msg seems wrong?

The cuda hard code of _copy_rejsample_metrics_async() is resolved in https://github.com/vllm-project/vllm/pull/16983/files#diff-15ed4bf92a11a0999f2f83239709135c6ef61bdf05fdb08a41c9c57598411439L129-R145.

@shen-shanshan shen-shanshan force-pushed the patch branch 2 times, most recently from 73999f0 to 2e7dbc1 Compare June 3, 2025 06:31
@Yikun Yikun added ready-for-test start test by label for PR and removed ready-for-test start test by label for PR labels Jun 3, 2025
Copy link
Collaborator

@Yikun Yikun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM if CI passed

@wangxiyuan wangxiyuan mentioned this pull request Jun 4, 2025
76 tasks
@mengwei805
Copy link
Collaborator

approve, good change.

Signed-off-by: shen-shanshan <[email protected]>
@shen-shanshan
Copy link
Collaborator Author

@wangxiyuan The CI is finally passed and this PR can be merged.

@wangxiyuan wangxiyuan merged commit d2f87ed into vllm-project:main Jun 9, 2025
23 checks passed
@wangxiyuan
Copy link
Collaborator

Thanks for the clean up

@Yikun Yikun added ready-for-test start test by label for PR and removed ready-for-test start test by label for PR labels Jun 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
long-term-test enable long term test for PR ready-for-test start test by label for PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants