blip2 environment | AttributeError: 'NoneType' object has no attribute 'from_pretrained'

[katie312]

I installed by

conda create -n lavis python=3.10
conda activate lavis

git clone https://github.com/salesforce/LAVIS.git
cd LAVIS
pip install -e .

pip install diffusers==0.16.0
pip install huggingface_hub==0.24.6
pip install spacy==3.6.0
pip install numpy==1.24.0
pip install peft==0.10.0
pip install moviepy==1.0.3 environment

I also tried different transformer versions, including 4.33.0, 4.33.2, 4.48.2, none of it can work.

error:
AttributeError: 'NoneType' object has no attribute 'from_pretrained'

Can somebody tell me the right way to install it??

[katie312]

code:

import torch
from PIL import Image
from lavis.models import load_model_and_preprocess
# setup device to use
device = torch.device("cuda") if torch.cuda.is_available() else "cpu"
# load sample image
raw_image = Image.open(",/n01440764/n01440764_18.JPEG").convert("RGB")

model, vis_processors, _ = load_model_and_preprocess(name="./blip2", model_type="pretrain_flant5xxl", is_eval=True, device=device)
# prepare the image
image = vis_processors["eval"](raw_image).unsqueeze(0).to(device)

model.generate({"image": image, "prompt": "Question: Generate a description of this photo in detail. Answer:"})