-
Notifications
You must be signed in to change notification settings - Fork 1.8k
[test] add qa test mentioned in docs #4248
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
/bot run |
PR_Github #4958 [ run ] triggered by Bot |
tests/integration/defs/test_e2e.py
Outdated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could we make it as an accuracy test?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
do mmlu
check in test_llm_api_pytorch.py
. Could you please re-review this PR? There's some changes in accuracy_core.py
.
PR_Github #4958 [ run ] completed with state |
f295233
to
d363f00
Compare
/bot run |
PR_Github #4978 [ run ] triggered by Bot |
PR_Github #4978 [ run ] completed with state |
/bot run |
PR_Github #5094 [ run ] triggered by Bot |
PR_Github #5094 [ run ] completed with state |
/bot run |
PR_Github #5132 [ run ] triggered by Bot |
PR_Github #5132 [ run ] completed with state |
/bot run |
PR_Github #5251 [ run ] triggered by Bot |
Signed-off-by: Ivy Zhang <[email protected]>
Signed-off-by: Ivy Zhang <[email protected]>
Signed-off-by: Ivy Zhang <[email protected]>
Signed-off-by: Ivy Zhang <[email protected]>
Signed-off-by: Ivy Zhang <[email protected]>
Signed-off-by: Ivy Zhang <[email protected]>
Signed-off-by: Ivy Zhang <[email protected]>
/bot run --skip_test |
PR_Github #5269 Bot args parsing error: usage: /bot [-h] |
PR_Github #5251 [ run ] completed with state |
This PR added below test cases: