Skip to content

Commit 77ec021

Browse files
committed
Moved numba from common requirements to cuda/rocm specific requirements
Signed-off-by: Nishidha Panpaliya <[email protected]>
1 parent f78c0be commit 77ec021

File tree

3 files changed

+5
-2
lines changed

3 files changed

+5
-2
lines changed

requirements-common.txt

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,6 @@
11
psutil
22
sentencepiece # Required for LLaMA tokenizer.
33
numpy < 2.0.0
4-
numba == 0.60.0 # v0.61 doesn't support Python 3.9. Required for N-gram speculative decoding.
54
requests >= 2.26.0
65
tqdm
76
blake3

requirements-cuda.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,8 @@
11
# Common dependencies
22
-r requirements-common.txt
33

4+
numba == 0.60.0 # v0.61 doesn't support Python 3.9. Required for N-gram speculative decoding
5+
46
# Dependencies for NVIDIA GPUs
57
ray[cgraph] >= 2.43.0 # Ray Compiled Graph, required for pipeline parallelism in V1.
68
torch == 2.5.1

requirements-rocm.txt

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,8 @@
11
# Common dependencies
22
-r requirements-common.txt
33

4+
numba == 0.60.0 # v0.61 doesn't support Python 3.9. Required for N-gram speculative decoding
5+
46
# Dependencies for AMD GPUs
57
awscli
68
boto3
@@ -11,4 +13,4 @@ peft
1113
pytest-asyncio
1214
tensorizer>=2.9.0
1315
runai-model-streamer==0.11.0
14-
runai-model-streamer-s3==0.11.0
16+
runai-model-streamer-s3==0.11.0

0 commit comments

Comments
 (0)