Skip to content

Commit 776ee2f

Browse files
committed
Add a comment on the potential change about model commit id
1 parent df7c34a commit 776ee2f

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

docs/source/models/lora.rst

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -66,6 +66,9 @@ LoRA adapted models can also be served with the Open-AI compatible vLLM server.
6666
--enable-lora \
6767
--lora-modules sql-lora=$HOME/.cache/huggingface/hub/models--yard1--llama-2-7b-sql-lora-test/snapshots/0dfa347e8877a4d4ed19ee56c140fa518470028c/
6868
69+
.. note::
70+
The commit ID `0dfa347e8877a4d4ed19ee56c140fa518470028c` may change over time. Please check the latest commit ID in your environment to ensure you are using the correct one.
71+
6972
The server entrypoint accepts all other LoRA configuration parameters (``max_loras``, ``max_lora_rank``, ``max_cpu_loras``,
7073
etc.), which will apply to all forthcoming requests. Upon querying the ``/models`` endpoint, we should see our LoRA along
7174
with its base model:

0 commit comments

Comments
 (0)