update quickstart md related to llama.cpp/ollama #13265
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
rnwang04
reviewed
Jul 21, 2025
| #### 16. `backend buffer base cannot be NULL` error | ||
| If you meet `ggml-backend.c:96: GGML_ASSERT(base != NULL && "backend buffer base cannot be NULL") failed`, simply adding `-c xx` parameter during inference, for example `-c 1024` would resolve this problem. | ||
|
|
||
| #### 17. `The program was built for 1 devices[/+]` error |
There was a problem hiding this comment.
17. The program was built for 1 devices error
|
|
||
| #### 17. `The program was built for 1 devices[/+]` error | ||
|
|
||
| If you meet the error `The program was built for 1 devices[/+] |
There was a problem hiding this comment.
If you meet error looks like The program was built for 1 devices. Build program log for 'Intel(R) Arc(TM) A770 Graphics':, this may be caused by the command set/export SYCL_CACHE_PERSISTENT=1. Please try unset SYCL_CACHE_PERSISTENT in the terminal. If the variable has been written into a configuration file such as ~/.bashrc, you need to manually delete or comment out the conrresponding line.
| 如果你遇到`ggml-backend.c:96: GGML_ASSERT(base != NULL && "backend buffer base cannot be NULL") failed`错误，在推理时传入参数`-c xx`，如`-c 1024`即可解决。 | ||
|
|
||
| #### 17. `The program was built for 1 devices` 错误 | ||
| 如果遇到错误`The program was built for 1 devices[/+] |
| ### Step 2: Runtime Configuration | ||
|
|
||
| - Open "Command Prompt" (cmd), and enter the extracted folder through `cd /d PATH\TO\EXTRACTED\FOLDER` | ||
| - To use GPU acceleration, several environment variables are required or recommended before running `llama.cpp`. |
| ### Step 2: Runtime Configuration | ||
|
|
||
| - Open a "Terminal", and enter the extracted folder through `cd /PATH/TO/EXTRACTED/FOLDER` | ||
| - To use GPU acceleration, several environment variables are required or recommended before running `llama.cpp`. |
| ### 步骤 2：运行时配置 | ||
|
|
||
| - 开启一个终端，输入命令 `cd /PATH/TO/EXTRACTED/FOLDER` 进入解压缩后的文件夹。 | ||
| - 要使用 GPU 加速，在运行 `llama.cpp` 之前，建议设置如下环境变量。 |
| 1. On Linux, you may run `systemctl stop ollama` to stop all ollama processes, and then rerun `ollama serve` in your current directory. | ||
| 2. On Windows, you may `set OLLAMA_HOST=0.0.0.0` to ensure that the ollama commands run on the current `ollama serve`. | ||
|
|
||
| #### 11. Error `The program was built for 1 devices[/+]` when executing `ollama serve` |
|
|
||
| #### 11. 执行 `ollama serve` 时报 `The program was built for 1 devices` 错误 | ||
| 当启动`ollama serve`或者`ollama run <model_name>`时，产生报错`The program was built for 1 devices[/+] | ||
| [+]Build program log for 'Intel(R) Arc(TM) A770 Graphics':`， 这是因为设置了`SYCL_CACHE_PERSISTENT=1`。请按照以下命令操作： |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
update quickstart md related to llama.cpp/ollama