Skip to content

Commit d9edcde

Browse files
e7217Um Changyong
andauthored
docs: add warnning content in vllm page (#1014)
Co-authored-by: Um Changyong <[email protected]>
1 parent 07f9752 commit d9edcde

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

docs/source/nodes/generator/vllm.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -64,3 +64,10 @@ Plus, you can use it over v0.2.16, so you must be upgrade to the latest version.
6464
We are developing multi-gpu compatibility for AutoRAG now.
6565
So, please wait for the full compatibilty to multi-gpu environment.
6666
```
67+
```{warning}
68+
When using the vllm module, errors may occur depending on the configuration of PyTorch. In such cases, please follow the instructions below:
69+
70+
1. Define the vllm module to operate in a single-case mode.
71+
2. Set the skip_validation parameter to True when using the start_trial function in the evaluator.
72+
```
73+

0 commit comments

Comments
 (0)