Skip to content

Commit 7ef41f3

Browse files
authored
Enablement of REST API Usage within Google Colab Free Tier (#2940)
1 parent 3eea41e commit 7ef41f3

File tree

3 files changed

+350
-0
lines changed

3 files changed

+350
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -258,6 +258,7 @@ export FASTCHAT_USE_MODELSCOPE=True
258258
### OpenAI-Compatible RESTful APIs & SDK
259259
FastChat provides OpenAI-compatible APIs for its supported models, so you can use FastChat as a local drop-in replacement for OpenAI APIs.
260260
The FastChat server is compatible with both [openai-python](https://github.com/openai/openai-python) library and cURL commands.
261+
The REST API is capable of being executed from Google Colab free tier, as demonstrated in the [FastChat_API_GoogleColab.ipynb](https://github.com/lm-sys/FastChat/blob/main/playground/FastChat_API_GoogleColab.ipynb) notebook, available in our repository.
261262
See [docs/openai_api.md](docs/openai_api.md).
262263

263264
### Hugging Face Generation APIs

docs/openai_api.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,8 @@ The following OpenAI APIs are supported:
88
- Completions. (Reference: https://platform.openai.com/docs/api-reference/completions)
99
- Embeddings. (Reference: https://platform.openai.com/docs/api-reference/embeddings)
1010

11+
The REST API can be seamlessly operated from Google Colab, as demonstrated in the [FastChat_API_GoogleColab.ipynb](https://github.com/lm-sys/FastChat/blob/main/playground/FastChat_API_GoogleColab.ipynb) notebook, available in our repository. This notebook provides a practical example of how to utilize the API effectively within the Google Colab environment.
12+
1113
## RESTful API Server
1214
First, launch the controller
1315

playground/FastChat_API_GoogleColab.ipynb

Lines changed: 347 additions & 0 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)