FAISS GPU usage with pip #396
Description
I am trying to use ColBERT with faiss-gpu because it takes forever to index and retrieve with cpu on google collab. What Im trying to do is:
!pip install use transformers==4.49.0
!pip install colbert-ai[torch,faiss-gpu]
Error that I have:
ERROR: Cannot install colbert-ai[faiss-gpu,torch]==0.2.15, colbert-ai[faiss-gpu,torch]==0.2.16, colbert-ai[faiss-gpu,torch]==0.2.17, colbert-ai[faiss-gpu,torch]==0.2.18, colbert-ai[faiss-gpu,torch]==0.2.19, colbert-ai[faiss-gpu,torch]==0.2.20 and colbert-ai[faiss-gpu,torch]==0.2.21 because these package versions have conflicting dependencies.
The conflict is caused by:
colbert-ai[faiss-gpu,torch] 0.2.21 depends on faiss-gpu>=1.7.0; extra == "faiss-gpu"
colbert-ai[faiss-gpu,torch] 0.2.20 depends on faiss-gpu>=1.7.0; extra == "faiss-gpu"
colbert-ai[faiss-gpu,torch] 0.2.19 depends on faiss-gpu>=1.7.0; extra == "faiss-gpu"
colbert-ai[faiss-gpu,torch] 0.2.18 depends on faiss-gpu>=1.7.0; extra == "faiss-gpu"
colbert-ai[faiss-gpu,torch] 0.2.17 depends on faiss-gpu>=1.7.0; extra == "faiss-gpu"
colbert-ai[faiss-gpu,torch] 0.2.16 depends on faiss-gpu>=1.7.0; extra == "faiss-gpu"
colbert-ai[faiss-gpu,torch] 0.2.15 depends on faiss-gpu>=1.7.0; extra == "faiss-gpu"
Also is there any working code example that I can learn from that uses FAISS-GPU and how do we set it up?
Any help is appreciated.
Thanks!