Feature Request: LLM options

[atxcowboy]

Since you'll add LLM options like ChatGPT and local LLMs, I'd like to ask you to consider an ACL System so that agents or maybe even certain tasks can be assigned access to specific LLMs. Further on, it'd be nice if end users could set their own API keys for different API endpoints via the UI (after some sort of session management has been implemented).

[Eng-Elias]

This is almost what I planned to.