websocket example would be amazing

[robbyfrt]

Hi DevTeam,

I've noticed that before lama-deploy, there was an example using ProgressEvents with websockets here.

Would it be possible how to add an example with websockets using lama-deploy? That would likely require building a new apiserver dockerfile for including the websocket maybe under llama_deploy/apiserver/routers/deployments.py but I am not quite sure how. Any help or even links to concepts would be appreciated.

[robbyfrt]

I actually extended deployments.py by a websocket definition with success:

@deployments_router.websocket("/{deployment_name}/ws/{session_id}")
async def websocket_endpoint(
    websocket: WebSocket,
    deployment_name: str,
    session_id: str
):
...

It is now dependent on an existing HumanResponseEvent, so it won't work on every workflow as intended I suppose, but it does the trick for me.

However, events are only forwarded as dict without Event Type definition. That would be a nice feature to filter later on. Will open a ticket on this.