a stream LLM responses that fails half way should be retried #1803
Description
If a LLM starts streaming answers and fail before return, it should be possible to automatically retry.
{{ message }}
If a LLM starts streaming answers and fail before return, it should be possible to automatically retry.