You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Vertex embeddings transformer currently uses character count instead of token count for usage.total_tokens. To keep it OpenAI schema compliant and to avoid confusion, it should use the token count.
If any user wants to get the character count, its easy to calculate by getting length of each input.