Add CALM models (#900)

Add the following new models to the leaderboard:
- `uiuc-convai/CALM-8B`
- `uiuc-convai/CALM-70B`
- `uiuc-convai/CALM-405B`

---------

Co-authored-by: Huanzhi (Hans) Mao <[email protected]>

Author: jgreer013

berkeley-function-call-leaderboard/CHANGELOG.md

@@ -1,6 +1,10 @@
 # Changelog
 
 All notable changes to the Berkeley Function Calling Leaderboard will be documented in this file.
+- [Feb 5, 2025] [#900](https://github.com/ShishirPatil/gorilla/pull/900): Add the following new models to the leaderboard:
+  - `uiuc-convai/CALM-8B`
+  - `uiuc-convai/CALM-70B`
+  - `uiuc-convai/CALM-405B`
 
 - [Feb 2, 2025] [#898](https://github.com/ShishirPatil/gorilla/pull/898): Add the following new models to the leaderboard:
   - `o3-mini-2025-01-31-FC`

berkeley-function-call-leaderboard/SUPPORTED_MODELS.md

@@ -102,6 +102,7 @@ Below is a comprehensive table of models supported for running leaderboard evalu
 |Qwen/QwQ-32B-Preview 💻| Prompt|
 |NovaSky-AI/Sky-T1-32B-Preview 💻| Prompt|
 |tiiuae/Falcon3-{1B,3B,7B,10B}-Instruct 💻| Function Calling|
+|uiuc-convai/CALM-{8B,70B,405B} 💻| Function Calling|
 
 ---
 

berkeley-function-call-leaderboard/bfcl/eval_checker/model_metadata.py

@@ -865,6 +865,24 @@
         "TII UAE",
         "falcon-llm-license",
     ],
+    "uiuc-convai/CALM-8B": [
+        "CALM-8B",
+        "https://huggingface.co/uiuc-convai/CALM-8B",
+        "UIUC + Oumi"
+        "Meta Llama 3 Community"
+    ],
+    "uiuc-convai/CALM-70B": [
+        "CALM-8B",
+        "https://huggingface.co/uiuc-convai/CALM-70B",
+        "UIUC + Oumi"
+        "Meta Llama 3 Community"
+    ],
+    "uiuc-convai/CALM-405B": [
+        "CALM-8B",
+        "https://huggingface.co/uiuc-convai/CALM-405B",
+        "UIUC + Oumi"
+        "Meta Llama 3 Community"
+    ]
 }
 
 INPUT_PRICE_PER_MILLION_TOKEN = {

berkeley-function-call-leaderboard/bfcl/model_handler/handler_map.py

@@ -168,6 +168,9 @@
     "tiiuae/Falcon3-7B-Instruct-FC": Falcon3FCHandler,
     "tiiuae/Falcon3-3B-Instruct-FC": Falcon3FCHandler,
     "tiiuae/Falcon3-1B-Instruct-FC": Falcon3FCHandler,
+    "uiuc-convai/CALM-8B": LlamaHandler,
+    "uiuc-convai/CALM-70B": LlamaHandler,
+    "uiuc-convai/CALM-405B": LlamaHandler
 }
 
 # Deprecated/outdated models, no longer on the leaderboard