Skip to content

Conversation

zhulinJulia24
Copy link
Collaborator

  1. fix baseline because of lmdeploy/vllm/transformers version change
  2. add more bench including llmjudger and cascasd judger datasets into daily testcase
  3. add longtext datasets (using test range 0:16) into daily test
  4. support llm_evaluator use local gpu by changing opencompass/tasks/openicl_eval.py

Copy link
Collaborator

@tonysy tonysy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tonysy tonysy changed the title [ci] update testcases' baseline [CI] update testcases' baseline Jul 7, 2025
@tonysy tonysy merged commit ab801b8 into open-compass:main Jul 7, 2025
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants