using TorchMetrics

[Borda]

Hello,
I am curious if you would be interested in using TorchMetrics which has recently implemented various Text-related metrics?
One of your students, @stancld have helped us with adding these metrics, so he may also advise of any potential integration... :)

Thank you for your consideration 🐰

[tuetschek]

Hi @Borda , thanks for the pointer and apologies for a rather negative reply. I haven't been developing this repo any further for the past ~2 years, so I'm not planning to include any new metrics here.

You might try asking at (or get involved in) https://github.com/GEM-benchmark/GEM-metrics, which is basically an evolution of this. (Note that there probably would need to be a metric in TorchMetrics, not yet included in GEM, for the project to consider using it.)