Skip to content

Conversation

abetlen
Copy link
Owner

@abetlen abetlen commented Oct 2, 2024

Weights and example code: https://huggingface.co/abetlen/paligemma-3b-mix-224-gguf

  • the chat handler here only supports single image / single turn conversations, just did this to simplify testing but will change before merging
  • you must set n_ubatch to be sufficiently large to process both the image and text input embeddings together.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant