File tree Expand file tree Collapse file tree 1 file changed +13
-0
lines changed
docs/getting_started/installation Expand file tree Collapse file tree 1 file changed +13
-0
lines changed Original file line number Diff line number Diff line change @@ -14,3 +14,16 @@ vLLM supports the following hardware platforms:
14
14
- [ Google TPU] ( google_tpu.md )
15
15
- [ Intel Gaudi] ( intel_gaudi.md )
16
16
- [ AWS Neuron] ( aws_neuron.md )
17
+
18
+ ## Hardware Plugins
19
+
20
+ The backends below live ** outside** the main ` vllm ` repository and follow the
21
+ [ Hardware-Pluggable RFC] ( ../design/plugin_system.md ) .
22
+
23
+ | Accelerator | PyPI / package | Repository |
24
+ | -------------| ----------------| ------------|
25
+ | Ascend NPU | ` vllm-ascend ` | < https://github.com/vllm-project/vllm-ascend > |
26
+ | Intel Gaudi (HPU) | N/A, install from source | < https://github.com/vllm-project/vllm-gaudi > |
27
+ | MetaX MACA GPU | N/A, install from source | < https://github.com/MetaX-MACA/vLLM-metax > |
28
+ | Rebellions ATOM / REBEL NPU | ` vllm-rbln ` | < https://github.com/rebellions-sw/vllm-rbln > |
29
+ | IBM Spyre AIU | ` vllm-spyre ` | < https://github.com/vllm-project/vllm-spyre > |
You can’t perform that action at this time.
0 commit comments