gtddlZddlmZmZmZmZddlZddlmZddl m Z ddl m Z eddgZ e jd ee g d Ze j!d dgee g defdZe jdee g dZe j!ddgee g dZy)N) APIRouterDepends HTTPExceptionRequest)verbose_proxy_logger) RedisCache)user_api_key_authz/cachecaching)prefixtagsz/ping) dependenciesc Ki}i} tj tddttjj D]-\}} |dk(r t t j|||</ttjjj D]\}} t |||<tjjdk(rtjjd{}tjdt |ztjjd d d d d gd{tjddtjjdd||dSdtjj|dS#t$r d||<YowxYw#t$r d||<Y#wxYw77#t$r$}tddt |d|d|d}~wwxYww)z6 Endpoint for checking if cache can be pinged N,Cache not initialized. litellm.cache is None status_codedetailcachezredisz/cache/ping: ping_response: test_keyz test-modeluserztest from litellm)rolecontent)resultmodelmessagesz"/cache/ping: done with set_cache()healthyTsuccess)status cache_type ping_responseset_cache_responselitellm_cache_paramsredis_cache_params)rr r#Service Unhealthy (z).Cache parameters: z.specific_cache_params: )litellmrrvarsitemsstrcopydeepcopy Exceptiontypepingrdebugasync_add_cache)r#specific_cache_paramskvr!es Q/var/www/openai/venv/lib/python3.12/site-packages/litellm/proxy/caching_routes.py cache_pingr6s3 == (V '--/DAq H<*-dmmA.>*?$Q' 0,,-335DAq I+.q6%a(6 ==   (")--"4"4"66M & &.]1CC  --//!"#)6IJK0   ! & &'K L#%mm00!%&/(<&;  $%mm00(< = H*G$Q' H  I+H%a( I7  (  (Q0DEYDZZrtIsJK   sHA GF*G!F*:9G4F?AGGAGG9G H G)H*F<8G;F<<G?G GGGG H!HHHz/delete)r r requestcK tj tdd|jd{}|j dd}tjj dk(r,tjj |d{dd iStd d tjj d 773#t$r}td d t|dd}~wwxYww)a Endpoint for deleting a key from the cache. All responses from litellm proxy have `x-litellm-cache-key` in the headers Parameters: - **keys**: *Optional[List[str]]* - A list of keys to delete from the cache. Example {"keys": ["key1", "key2"]} ```shell curl -X POST "http://0.0.0.0:4000/cache/delete" -H "Authorization: Bearer sk-1234" -d '{"keys": ["key1", "key2"]}' ``` Nrrrkeysr)r9rr Cache type z; does not support deleting a key. only `redis` is supportedzCache Delete Failed()) r&rrjsongetr-delete_cache_keysr,r))r7 request_datar9r4s r5 cache_deleterAPs& == (V %\\^+ - ==   (--11t1< < <)  $W]]%7%7$88st , =  )#a&3   sKC,0CB=AC B? CC,*C?C C) C$$C))C,z /redis/infoc:K tj tddtjjdk(rt tjjt ratjjj }tjjj}t|}|||dStddtjjd #t$r}tdd t|d d}~wwxYww) z* Endpoint for getting /redis/info Nrrrr) num_clientsclientsinfor:r; does not support flushingr%r<) r&rrr- isinstancer client_listrElenr,r))rH redis_inforCr4s r5cache_redis_inforK}s == (V  ==   (Z MM  . "----99;K ,,113Jk*K*&"   $W]]%7%7$88RS   (Q2   s/DCC0D)C00 D9DDDz /flushallcK tj tddtjjdk(rTt tjjt r,tjjj ddiStdd tjjd #t$r}tdd t|d d}~wwxYww) a A function to flush all items from the cache. (All items will be deleted from the cache with this) Raises HTTPException if the cache is not initialized or if the cache type does not support flushing. Returns a dictionary with the status of the operation. Usage: ``` curl -X POST http://0.0.0.0:4000/cache/flushall -H "Authorization: Bearer sk-1234" ``` Nrrrrrrr:r;rFr%r<) r&rrr-rGrflushallr,r))r4s r5cache_flushallrNs  == (V  ==   (Z MM  .  MM   ( ( *)  $W]]%7%7$88RS   (Q2   s/C&B B;C&)B;; C#CC##C&)r*fastapirrrrr&litellm._loggingrlitellm.caching.cachingr$litellm.proxy.auth.user_api_key_authr routerr>r6postrArKrNr5rWs >>1.B      +,- 9 9 x +,-  % %  % P+,-   @ +,-     rV