Skip to content

Commit 56d7a7c

Browse files
[BFCL] Update Error Message for New Handler Mappings (#1013)
Bugfix for an issure introduced in #1008
1 parent 63442e1 commit 56d7a7c

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

berkeley-function-call-leaderboard/bfcl/_llm_response_generation.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -277,7 +277,7 @@ def main(args):
277277
) = get_involved_test_entries(args.test_category, args.run_ids)
278278

279279
for model_name in args.model:
280-
if model_name not in HANDLER_MAP:
280+
if model_name not in MODEL_CONFIG_MAPPING:
281281
raise ValueError(
282282
f"Unknown model_name '{model_name}'.\n"
283283
"• For officially supported models, please refer to `SUPPORTED_MODELS.md`.\n"

berkeley-function-call-leaderboard/bfcl/eval_checker/eval_runner.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -488,7 +488,7 @@ def main(model, test_categories, result_dir, score_dir):
488488
if model:
489489
model_names = []
490490
for model_name in model:
491-
if model_name not in HANDLER_MAP:
491+
if model_name not in MODEL_CONFIG_MAPPING:
492492
raise ValueError(f"Invalid model name '{model_name}'.")
493493
# Runner takes in the model name that contains "_", instead of "/", for the sake of file path issues.
494494
# This is differnet than the model name format that the generation script "openfunctions_evaluation.py" takes in (where the name contains "/").

0 commit comments

Comments
 (0)