You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Whisper works great for well-trained languages like German, Chinese, English....
But I'm learning a bunch of languages that aren't in high-demand, i.e. there isn't much training data for Whisper, so it cannot produce accurate subtitles for them. (Specifically: Arabic, Hindi and Thai)
Whenever I have tried getting Whisper to make subtitles for movies spoken in these languages, I am lucky if even half of the lines are usable. The rest is mostly just incomprehensible gibberish, it routinely has strokes where it spams the same letter or word over and over again or routinely hallucinates foreign words into the sentences that have nothing to do with what is being said. Some examples:
On the other hand, I found that Google's speech to text engine works marvelously well for videos I throw at it in these languages. I was able to make an account to access the API and I have tried uploading clips from some of the movies into it - and I have gotten surprisingly accurate subtitles that are leagues better than whatever garbage Whisper makes.
Is there a way for the Google speech to text API to be implemented into the Subtitle Edit software? It would make my life a lot easier.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Whisper works great for well-trained languages like German, Chinese, English....
But I'm learning a bunch of languages that aren't in high-demand, i.e. there isn't much training data for Whisper, so it cannot produce accurate subtitles for them. (Specifically: Arabic, Hindi and Thai)
Whenever I have tried getting Whisper to make subtitles for movies spoken in these languages, I am lucky if even half of the lines are usable. The rest is mostly just incomprehensible gibberish, it routinely has strokes where it spams the same letter or word over and over again or routinely hallucinates foreign words into the sentences that have nothing to do with what is being said. Some examples:
On the other hand, I found that Google's speech to text engine works marvelously well for videos I throw at it in these languages. I was able to make an account to access the API and I have tried uploading clips from some of the movies into it - and I have gotten surprisingly accurate subtitles that are leagues better than whatever garbage Whisper makes.
Is there a way for the Google speech to text API to be implemented into the Subtitle Edit software? It would make my life a lot easier.
Beta Was this translation helpful? Give feedback.
All reactions