Add firefunction-v2 to the leaderboard #470
Conversation
pgarbacki
changed the title
There was a problem hiding this comment.
Thanks for the PR @pgarbacki. Excited to see the performance of firefunction-v2 on BFCL!
One minor issue, since the updated FireworkAIHandler still works for the old version of firefunction, we don't want to remove the mention of support for fire-function-v1-FC in the README. Could you change this line to |firefunction-{v1,v2}-FC | Function Calling|? Thanks!
Done. Thanks for the review. |
This PR adds the new model `firefunction-v2-FC` to the leaderboard, thanks to the support from @pgarbacki in #470. This PR only adds an entry in the leaderboard; the score for all other models on the leaderboard will remain unchanged.
This PR adds firefunction-v2 to the leaderboard. It also updates the fireworks handler making sure that the parameters and prompt are set correctly.