How to finetune blip2 model to output new token?

I want to extend the blip2 vocabulary to introduce a new token for the generation, is this possible in blip2 models? If so, how should I proceed this? And also, can this be done with pip installation, or it demands pull the whole project to modify? Thanks