Skip to content

[BFCL] Add New Model functionary-small-v3.1, functionary-small-v3.2, functionary-medium-v3.1; Update Token Price #573

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 6 commits into from
Aug 10, 2024
Merged

[BFCL] Add New Model functionary-small-v3.1, functionary-small-v3.2, functionary-medium-v3.1; Update Token Price #573

merged 6 commits into from
Aug 10, 2024

Conversation

HuanzhiMao
Copy link
Collaborator

@HuanzhiMao HuanzhiMao commented Aug 7, 2024 •
edited
Loading

Add the following new models:

  • meetkai/functionary-small-v3.1-FC
  • meetkai/functionary-small-v3.2-FC
  • meetkai/functionary-medium-v3.1-FC

We will update the leaderboard shortly, in a different PR.

@HuanzhiMao HuanzhiMao marked this pull request as ready for review August 7, 2024 22:27
@khai-meetkai
Copy link

khai-meetkai commented Aug 8, 2024 •
edited
Loading

Thank you for your great work ! Can you also evaluate our new 70b:
meetkai/functionary-medium-v3.1

@khai-meetkai
Copy link

khai-meetkai commented Aug 8, 2024 •
edited
Loading

  • meetkai/functionary-small-v3.2-FC

Oh meetkai/functionary-small-v3.2-FC appeared twice, list of model are:
meetkai/functionary-small-v3.1
meetkai/functionary-small-v3.2
meetkai/functionary-medium-v3.1

@HuanzhiMao
Copy link
Collaborator Author

@khai-meetkai Do you want to keep both functionary-medium-v3.0-FC and functionary-medium-v3.1-FC or just upgrade functionary-medium-v3.0-FC to functionary-medium-v3.1-FC ?

@khai-meetkai
Copy link

khai-meetkai commented Aug 8, 2024 •
edited
Loading

@khai-meetkai Do you want to keep both functionary-medium-v3.0-FC and functionary-medium-v3.1-FC or just upgrade functionary-medium-v3.0-FC to functionary-medium-v3.1-FC ?

I think functionary-medium-v3.1-FC is enough so please ignore: functionary-medium-v3.0-FC

@HuanzhiMao HuanzhiMao changed the title [BFCL] Add New Model functionary-small-v3.1, functionary-small-v3.2, functionary-medium-v3.0 [BFCL] Add New Model functionary-small-v3.1, functionary-small-v3.2, functionary-medium-v3.1 Aug 8, 2024
@HuanzhiMao HuanzhiMao changed the title [BFCL] Add New Model functionary-small-v3.1, functionary-small-v3.2, functionary-medium-v3.1 [BFCL] Add New Model functionary-small-v3.1, functionary-small-v3.2, functionary-medium-v3.1; Update Token Price Aug 9, 2024
CharlieJCJ
CharlieJCJ approved these changes Aug 9, 2024
View reviewed changes
Copy link
Collaborator

@CharlieJCJ CharlieJCJ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@HuanzhiMao HuanzhiMao mentioned this pull request Aug 9, 2024
Merged
@ShishirPatil ShishirPatil merged commit 0135779 into ShishirPatil:main Aug 10, 2024
@HuanzhiMao HuanzhiMao deleted the functionary branch August 13, 2024 06:04
ShishirPatil pushed a commit that referenced this pull request Aug 15, 2024
@HuanzhiMao
[BFCL] Leaderboard Update, in sync with #557, #568, #569, #570, and #573
dd707a6 
 (Dataset Fix & New Model) (#572)

This PR updates the leaderboard to reflect the changes in score due to
the following PR merge:

- #557 
- #568 

and the addition of the following models:

- #569 
- #570 
- #573
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ShishirPatil ShishirPatil ShishirPatil approved these changes

@CharlieJCJ CharlieJCJ CharlieJCJ approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@HuanzhiMao @khai-meetkai @ShishirPatil @CharlieJCJ