[Bug]: Router breaks in 1.80.8 if tools is None

[sidnarayanan]

What happened?

I unfortunately don't have a minimal repro for this, but version 1.80.8 has introduced an error when request_kwargs['tools'] is None (specifically in #17500 ).

A fix would be for this line to instead use request_kwargs.get('tools') or []:

litellm/litellm/router_utils/common_utils.py

Line 113 in dcf5217

tools = request_kwargs.get("tools", [])

Relevant log output

Are you a ML Ops Team?

Yes

What LiteLLM version are you on ?

v1.80.8

Twitter / LinkedIn details

No response

[jamesbraza]

Here's a reproducer with pytest==9.0.1 and litellm==1.80.9:

import litellm
import pytest


@pytest.mark.asyncio
async def test_17672_repro() -> None:
    router = litellm.Router(
        model_list=[
            {
                "litellm_params": {"model": "gpt-4o-mini-2024-07-18"},
                "model_name": "gpt-4o-mini-2024-07-18",
            }
        ],
    )
    await router.acompletion(
        model="gpt-4o-mini-2024-07-18",
        messages=[{"role": "user", "content": "Hi, how are you?"}],
        tools=None,
    )