gjddlmZmZmZddlZddlmZddlmZddl m Z m Z ddl m Z Gdde Zy) )LiteralOptionalUnionN)verbose_proxy_logger) DualCache)CustomGuardraillog_guardrail_information)UserAPIKeyAuthceZdZfdZedededededde e e e eff dZ edededed fd Zededefd ZxZS) myCustomGuardrailc 2||_t|di|y)N)optional_paramssuper__init__)selfkwargs __class__s n/var/www/openai/venv/lib/python3.12/site-packages/litellm/proxy/guardrails/guardrail_hooks/custom_guardrail.pyrzmyCustomGuardrail.__init__s & "6"user_api_key_dictcachedata call_type) completiontext_completion embeddingsimage_generation moderationaudio_transcriptionpass_through_endpointrerankreturncK|jd}|rS|D]N}|jd}t|ts%d|jvs8|j dd}||d<Pt j d||Sw)zz Runs before the LLM API call Runs on only Input Use this if you want to MODIFY the input messagescontentlitellmz********z-async_pre_call_hook: Message after masking %s)get isinstancestrlowerreplacerdebug)rrrrr _messagesmessage_contents rasync_pre_call_hookz%myCustomGuardrail.async_pre_call_hooks0HHZ( $";;y1h, HNN$44#+#3#3Iz#J-5 * % "" ;Y  s:BB1B)rrrrr cK|jd}|rG|D]A}|jd}t|ts%d|jvs8t dyyw)z Runs in parallel to LLM API call Runs on only Input This can NOT modify the input, only used to reject or accept a call before going to LLM API r%r&r'z+Guardrail failed words - `litellm` detectedN)r(r)r*r+ ValueError)rrrrr.r/r0s rasync_moderation_hookz'myCustomGuardrail.async_moderation_hook>s[,HHZ( $";;y1h, HNN$44()VWW % s:AAAcKtjd|t|tjr|j D]}t|tj stjd||jjsKt|jjtspd|jjvstdyyw)z Runs on response from LLM API call It can be used to reject a response If a response contains the word "coffee" -> we will raise an exception z async_pre_call_hook response: %szasync_pre_call_hook choice: %scoffeez Guardrail failed Coffee DetectedN) rr-r)r' ModelResponsechoicesChoicesr/r&r*r3)rrrresponsechoices rasync_post_call_success_hookz.myCustomGuardrail.async_post_call_success_hook\s ""#ExP h 5 5 6"**fgoo6(../OQWX..&v~~'='=sC$(>(>>()KLL+ 7sAC,C $C/CC)__name__ __module__ __qualname__rr r rdictrrr Exceptionr*r1r4r< __classcell__)rs@rr r s#$)$$ $    $ % 3,- .$$LXX*X # XX:MM*MMrr )typingrrrr'litellm._loggingrlitellm.caching.cachingr%litellm.integrations.custom_guardrailrr litellm.proxy._typesr r rrrrHs.++1-0gMgMr