Skip to content

Commit e188592

Browse files
mgoinhmellor
andauthored
Add hardware plugins to installation doc (vllm-project#22732)
Signed-off-by: Michael Goin <[email protected]> Signed-off-by: Harry Mellor <[email protected]> Co-authored-by: Harry Mellor <[email protected]>
1 parent fde0b61 commit e188592

File tree

1 file changed

+13
-0
lines changed

1 file changed

+13
-0
lines changed

docs/getting_started/installation/README.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,3 +14,16 @@ vLLM supports the following hardware platforms:
1414
- [Google TPU](google_tpu.md)
1515
- [Intel Gaudi](intel_gaudi.md)
1616
- [AWS Neuron](aws_neuron.md)
17+
18+
## Hardware Plugins
19+
20+
The backends below live **outside** the main `vllm` repository and follow the
21+
[Hardware-Pluggable RFC](../design/plugin_system.md).
22+
23+
| Accelerator | PyPI / package | Repository |
24+
|-------------|----------------|------------|
25+
| Ascend NPU | `vllm-ascend` | <https://github.com/vllm-project/vllm-ascend> |
26+
| Intel Gaudi (HPU) | N/A, install from source | <https://github.com/vllm-project/vllm-gaudi> |
27+
| MetaX MACA GPU | N/A, install from source | <https://github.com/MetaX-MACA/vLLM-metax> |
28+
| Rebellions ATOM / REBEL NPU | `vllm-rbln` | <https://github.com/rebellions-sw/vllm-rbln> |
29+
| IBM Spyre AIU | `vllm-spyre` | <https://github.com/vllm-project/vllm-spyre> |

0 commit comments

Comments
 (0)