https image url for Google providers

[ianbbqzy]

What Happened?

Currently, if we pass an image url to Google like you do to OpenAI. Google would reject if it's an https URL

I see that the code just propagates it to upstream https://github.com/inworld-ai/portkey-ai-gateway/blob/main/src/providers/google/chatComplete.ts#L233

But I'm wondering if the gateway should first retrieve the image and format it as a data url?

What Should Have Happened?

No response

Relevant Code Snippet

No response

Your Twitter/LinkedIn

No response

[narengogi]

@ianbbqzy You could create a custom before request hook for this, it's not wise to burden the main gateway with such provider specific code

[ianbbqzy]

I see your point. but in my opinion, the goal of a unified API interface for different models would require the gateway to handle provider specific complexities so that the end user can easily test different models with the same request.

I wasn't aware of the custom before request hook, let me see if it satisfies my requirement nicely. will report back.