Estimate cost of request

[tomsib2001]

Could there be away to estimate the cost of a request before making it? Apologies if this is already possible, I couldn't find it. I'm thinking of something similar to the -t option of https://github.com/npiv/chatblade

[sigoden]

#82 support inspect the token usage of request/prompt message.

actual_fee = prompt_tokens * prompt_price + completion_tokens * completion_price.
Usually completion_tokens has a greater impact. Merely evaluating the cost of request messages is not meaningful.

[tomsib2001]

For costly models such as GPT4 - 32K, it could be that the prompt cost is greater than the completion cost.