OpenAI Flex Processing

[compatible9]

Flex processing provides significantly lower costs for Chat Completions requests in exchange for slower response times. It is ideal for lower-priority tasks such as parsing documents with OpenAI

Please considere this implementation, more information at https://platform.openai.com/docs/guides/flex-processing?api-mode=chat

[ZhenhangTung]

Thanks for the input. Actually most of our developers complain about low speed of parsing documents, so I'll think about it and see if there is any suitable use cases for this feature. And since we're a platform, I'll also take a look at other LLMs to see if they have similar feature.

[onestardao]

interesting to hear this is a recurring pain point — we’ve seen similar frustration from teams trying to parse PDFs, scanned documents, or hybrid-text formats using OpenAI endpoints.

the issue often isn’t just speed, but semantic loss during parsing, especially when layout-dependent meaning is involved (e.g., tables, footnotes, nested lists).

we ended up building a fault-tolerant pipeline for semantic parsing under lossy/fragmented inputs — if you’re curious, I can share the structure or failure maps we used internally. might help pressure-test flex mode too.

just let me know if it's useful.