404 (no body)

[w520342e]

I am currently deploying Perplexica using docker and using CustomOpenAI api as the chat model.

After asking questions on chat window, there has been no answer, and I see 404 (no body) error from .next/server/chunks/587.js in docker logs.

What could be the possible reason for this and how can I resolve it? Thanks.

[ItzCrazyKns]

Can you make sure that the model name and base URL you're using is correct.

[w520342e]

Yes, before encountering the 404 (no body) issue, I did face an error from the CustomOpenAI API indicating that the X-User-Id headers were required, which should be needed for our API.

Later, I added the X-User-Id defaultHeaders each time that created a custom ChatOpenAI instance, which prevented the error about missing headers.

Although I'm not certain if this approach is correct, but I can confirm that the API URL and model name is correct.

[ItzCrazyKns]

Are you able to use the same parameters via the OpenAI package?

[w520342e]

I usually use python openai.AzureOpenAI, and except for not being able to specify the api_version, the other parameters are almost the same.

[ItzCrazyKns]

Are you using models from Azure OpenAI?

[w520342e]

Yes, I've also noticed the difference and am trying to switch to AzureChatOpenAI.
I'll let you know if it's successful. Thank you.

[ItzCrazyKns]

Same as #699