gUdZddlZddlmZmZddlmZddlmZddlm Z ddl m Z m Z edZ eeed<ed Zeeed <e e j" Zd efd Zd ZdefdZdeefdZy)z* Helper functions to query prometheus API N)datetime timedelta)Optional) get_secret)verbose_logger)get_async_httpx_clienthttpxSpecialProviderPROMETHEUS_URLPROMETHEUS_SELECTED_INSTANCE) llm_provider metric_namecBKt td|d}ttj}tj td||dd{}|j }tjd||j dd}|S7Bw) N=PROMETHEUS_URL not set please set 'PROMETHEUS_URL=<>' in .envz[24h]z /api/v1/query)querytimeparams+json response from prometheus /query api %sdataresult) r ValueErrorintrasync_http_handlergetjsonrdebug)r rnowresponse_json_responseresultss k/var/www/openai/venv/lib/python3.12/site-packages/litellm/integrations/prometheus_helpers/prometheus_api.pyget_metric_from_prometheusr"s K  m5 !E diik C'++  -(5#1N,H]]_NFWmmof%h/G N sABBABc Kd}ddg}|D]}t|d{}|rtjd||D]}tjd||d}|d }|d }t|j d tk7rGt t |d }|j d d}|j dd} |d|d|d| dz }|dz }tjd||S7Эw)zE Gets fallback metrics from prometheus for the last 24 hours -litellm_deployment_successful_fallbacks_total)litellm_deployment_failed_fallbacks_total)r Nzresponse json %sz result= %smetricvaluesrinstance primary_modelUnknownfallback_model`z3 successful fallback requests` with primary model=`z` -> fallback model=` zresponse message %s)r"rrr rrfloat) response_messagerelevant_metricsr' response_jsonr metric_valuesmost_recent_valuevaluer+r-s r!#get_fallback_metric_from_prometheusr7+sC73#8     !3] C'$$\6:) &x 0 $1!$4!/;zz*-1MM E"3A"678 & ?I F !',r]s (+ !++; < <.89W.XhsmX+%55 ( F 58C=5r;