g "ddlmZmZmZmZddlZddlmZddlmZ ddgZ de de d eed e fd ed fd Z dde de de de dee dee d ee e ffdZ de de de de d ee e ff dZy))LiteralOptionalTupleUnionN)verbose_logger)_is_above_128kzgemini-1.0-proz gemini-promodelcustom_llm_provider call_type) embedding aembeddingreturn)cost_per_charactercost_per_tokencX|dk(rd|vsd|vs d|vsd|vsd|vry|dk(r |dk(s|d k(ryy ) z Route the cost calc to the right place, based on model/call_type/etc. Returns - str, the specific google cost calc function it should route to. vertex_aiclaudellamamistraljamba codestralrr r r)r r r s [/var/www/openai/venv/lib/python3.12/site-packages/litellm/llms/vertex_ai/cost_calculator.py cost_routerrsTk)E e    e  %   +[ I$=  prompt_tokenscompletion_tokensprompt_characterscompletion_charactersctj||}tj||}|t||||\}}nj t|dzr2|tvr*d|vr|d Jdj ||||dz}n(d|vr|dJd j ||||dz}|t||||\}} || fS t|dzr2|tvr*d |vr|d  Jd j ||||d z} n(d |vr|d Jdj ||||d z} || fS#t $rI} tjd j t| t||||\}}Yd} ~ d} ~ wwxYw#t $rL} tjd j t| t||||\}} Yd} ~ || fSd} ~ wwxYw)a# Calculates the cost per character for a given VertexAI model, input messages, and response object. Input: - model: str, the model name without provider prefix - custom_llm_provider: str, "vertex_ai-*" - prompt_characters: float, the number of input characters - completion_characters: float, the number of output characters Returns: Tuple[float, float] - prompt_cost_in_usd, completion_cost_in_usd Raises: Exception if model requires >128k pricing, but model cost not mapped r r N)r r rrtokens*input_cost_per_character_above_128k_tokenszzmodel info for model={} does not have 'input_cost_per_character_above_128k_tokens'-pricing for > 128k tokens model_info={}input_cost_per_characterzVmodel info for model={} does not have 'input_cost_per_character'-pricing model_info={}zslitellm.litellm_core_utils.llm_cost_calc.google.py::cost_per_character(): Exception occured - {} Defaulting to None+output_cost_per_character_above_128k_tokenszimodel info for model={} does not have 'output_cost_per_character_above_128k_tokens' pricing model_info={}output_cost_per_characterzWmodel info for model={} does not have 'output_cost_per_character'-pricing model_info={}) litellmget_model_inforrmodels_without_dynamic_pricingformat Exceptionrdebugstr) r r rrrr model_info prompt_cost_ecompletion_costs rrr4s.'')<J '')<J  ' 3'/   Q$ &7!&;<!??AJN"#OP QXX:  & !MNO /*<"#=>Jmss:K 0*=W2XX $+ 3'/  ?\  ''O% &;a&?@!??BZO"#PQ @GG:  & !NOP 0:="#>?Kntt:L *J7R,SS  ''{   GNNF  ,$7+"3 NK `   GNNF  "0$7+"3 " A  '' s2A)D4A)F 4 F=?FF G?GGcRtj||}t|r1|tvr)d|vr|dJdj ||||dz}n||dz}t|r4|tvr,d|vr|dJdj ||||dz}||fS||dz}||fS)a Calculates the cost per token for a given model, prompt tokens, and completion tokens. Input: - model: str, the model name without provider prefix - custom_llm_provider: str, either "vertex_ai-*" or "gemini" - prompt_tokens: float, the number of input tokens - completion_tokens: float, the number of output tokens Returns: Tuple[float, float] - prompt_cost_in_usd, completion_cost_in_usd Raises: Exception if model requires >128k pricing, but model cost not mapped r!r#&input_cost_per_token_above_128k_tokenszMmodel info for model={} does not have pricing for > 128k tokens model_info={}input_cost_per_token'output_cost_per_token_above_128k_tokensoutput_cost_per_token)r)r*rr+r,)r r rrr0r1r4s rrrs,'')<J m, 7 7 5 BCDP  \ b b :   Q J'OP P $j1G&HH  /0 7 7 6 CDEQ  \ b b :   R  +T U U   '',j9P.QQ  ''r)NN)typingrrrrr)r.litellm.litellm_core_utils.llm_cost_calc.utilsrr+r/rfloatrrrrrr=s32"I #3L!A   W67<=  34  >*.-1 ( ((( (   ( $E? ( 5%<(D<( <(<(<( <(  5%< <(r