Skip to content

feat: support benchmark on scaffolding (#3328) #4286

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
May 16, 2025
Merged

feat: support benchmark on scaffolding (#3328) #4286

merged 1 commit into from
May 16, 2025

Conversation

WeiHaocheng
Copy link
Collaborator

We expose "async_scaffolding_benchmark" API to users. This API can help users to run an scaffolding instance with task collection and any concurrency.

@WeiHaocheng WeiHaocheng requested review from dc3671 and dongxuy04 May 14, 2025 03:08
@WeiHaocheng WeiHaocheng self-assigned this May 14, 2025
@WeiHaocheng
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #5151 [ run ] triggered by Bot

dongxuy04
dongxuy04 approved these changes May 14, 2025
View reviewed changes
@tensorrt-cicd
Copy link
Collaborator

PR_Github #5151 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #3756 completed with status: 'FAILURE'

@WeiHaocheng WeiHaocheng force-pushed the feat/main_itc_benchmark branch from 89e9b21 to 4cc92d3 Compare May 14, 2025 14:30
@WeiHaocheng
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #5191 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #5191 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #3788 completed with status: 'FAILURE'

@WeiHaocheng WeiHaocheng force-pushed the feat/main_itc_benchmark branch from 4cc92d3 to d5fe624 Compare May 15, 2025 05:59
@WeiHaocheng
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #5274 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #5274 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #3853 completed with status: 'FAILURE'

@WeiHaocheng WeiHaocheng force-pushed the feat/main_itc_benchmark branch from d5fe624 to 347bbcf Compare May 15, 2025 08:39
@WeiHaocheng
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #5316 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #5316 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #3876 completed with status: 'FAILURE'

@WeiHaocheng WeiHaocheng force-pushed the feat/main_itc_benchmark branch from 347bbcf to a34d284 Compare May 16, 2025 01:16
@WeiHaocheng
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #5430 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #5430 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #3964 completed with status: 'SUCCESS'

@WeiHaocheng WeiHaocheng merged commit 54d2871 into NVIDIA:main May 16, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@dongxuy04 dongxuy04 dongxuy04 approved these changes

@dc3671 dc3671 Awaiting requested review from dc3671

Assignees

@WeiHaocheng WeiHaocheng

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@WeiHaocheng @tensorrt-cicd @dongxuy04