TrOCR on ONNX runtime

[kaizengit]

Great work! Could you please provide inputs or insights on how we could run inference on ONNX? Thank you.

[NielsRogge]

Pinging @lewtun here, he's an expert regarding ONNX.

[lewtun]

Hey @kaizengit, TrOCR is currently not a supported architecture in transformers because it involves a processor for the images. We're currently working on supporting vision models, so I'll take a look at TrOCR once we have that implemented :)

[kaizengit]

@lewtun Thanks for the feedback! Looking forward to the updates!

[IlyasMoutawwakil]

@lewtun thank you for all the work and effort. Can you tell me if it's possible to export TrOCR to ONNX with the current available tools on transformers, like by inheriting from the pre built seq2seq onnx configuration?

[nextbelkadi]

@lewtun Hello , how i can speed my inference prediction in TrOCR ?

[NielsRogge]

Hi,

We know support TrOCR for ONNX! See huggingface/transformers#19254.