g<dZddlZddlZddlmZddlmZmZmZm Z m Z m Z ddl m Z ddlmZmZmZmZmZddlmZddlmZeZej3d d geeg eeeedd fdede dededeef dZej3dd geeg eeefde dedefdZej;d d geeg eeefde dedefdZy)zc Endpoints to control callbacks per team Use this when each team should control its own callbacks N)Optional) APIRouterDependsHeader HTTPExceptionRequeststatus)verbose_proxy_logger)AddTeamCallbackProxyErrorTypesProxyExceptionTeamCallbackMetadataUserAPIKeyAuth)user_api_key_auth)management_endpoint_wrapperz/team/{team_id:path}/callbackzteam management)tags dependencieszThe litellm-changed-by header enables tracking of actions performed by authorized users on behalf of other users, providing an audit trail for accountability) descriptiondata http_requestteam_iduser_api_key_dictlitellm_changed_byc K ddlm}|tdddi|j|dd d{}|td dd |d i|j}|j di}t d&i|} |jdk(r| jg| _|j| jvrHtd|jd|d| jtjtjd| jj|jn|jdk(r| j g| _|j| j vrHtd|jd|d| j tjtjd| j j|jn@|jdk(r0| jg| _| j g| _|j| jvrHtd|jd|d| jtjtjd|j| j vrHtd|jd|d| j tjtjd| jj|j| j j|j|j"j%D]'\} } | j"i| _| | j"| <)| j'} | |d<t)j*|} |j,j.j1d|id| id{}d|dS7{7 #t2$r*}t5j6dj9t;|t5j<t?j@tC|trcttE|ddt;|d tjFjHtE|d!d"tE|d#tjJ$tC|tr|td%t;|ztjFjHtE|d!d"tjJ$d}~wwxYww)'a_ Add a success/failure callback to a team Use this if if you want different teams to have different success/failure callbacks Parameters: - callback_name (Literal["langfuse", "langsmith", "gcs"], required): The name of the callback to add - callback_type (Literal["success", "failure", "success_and_failure"], required): The type of callback to add. One of: - "success": Callback for successful LLM calls - "failure": Callback for failed LLM calls - "success_and_failure": Callback for both successful and failed LLM calls - callback_vars (StandardCallbackDynamicParams, required): A dictionary of variables to pass to the callback - langfuse_public_key: The public key for the Langfuse callback - langfuse_secret_key: The secret key for the Langfuse callback - langfuse_secret: The secret for the Langfuse callback - langfuse_host: The host for the Langfuse callback - gcs_bucket_name: The name of the GCS bucket - gcs_path_service_account: The path to the GCS service account - langsmith_api_key: The API key for the Langsmith callback - langsmith_project: The project for the Langsmith callback - langsmith_base_url: The base URL for the Langsmith callback Example curl: ``` curl -X POST 'http:/localhost:4000/team/dbe2f686-a686-4896-864a-4c3924458709/callback' -H 'Content-Type: application/json' -H 'Authorization: Bearer sk-1234' -d '{ "callback_name": "langfuse", "callback_type": "success", "callback_vars": {"langfuse_public_key": "pk-lf-xxxx1", "langfuse_secret_key": "sk-xxxxx"} }' ``` This means for the team where team_id = dbe2f686-a686-4896-864a-4c3924458709, all LLM calls will be logged to langfuse using the public key pk-lf-xxxx1 and the secret key sk-xxxxx r prisma_clientNerrorNo db connected status_codedetailteam find_uniquer table_name query_typei Team id = z0 does not exist. Please use a different team id.callback_settingssuccesszcallback_name = z3 already exists in failure_callback, for team_id = z . Existing failure_callback = callback_name)messagecodetypeparamfailuresuccess_and_failurez3 already exists in success_callback, for team_id = z . Existing success_callback = rmetadatawhererr rzGlitellm.proxy.proxy_server.add_team_callbacks(): Exception occured - {}r"Internal Server Error()r/Noner!r,r.r/r-Internal Server Error, )&litellm.proxy.proxy_serverrrget_datar2getr callback_typesuccess_callbackr+r r HTTP_400_BAD_REQUESTr bad_request_errorappendfailure_callback callback_varsitems model_dumpjsondumpsdblitellm_teamtableupdate Exceptionr rformatstrdebug traceback format_exc isinstancegetattrinternal_server_errorvalueHTTP_500_INTERNAL_SERVER_ERROR)rrrrrr_existing_team team_metadatateam_callback_settingsteam_callback_settings_objvarrVteam_callback_settings_obj_dictteam_metadata_json new_team_rowes o/var/www/openai/venv/lib/python3.12/site-packages/litellm/proxy/management_endpoints/team_callback_endpoints.pyadd_team_callbacksrbs1lo <  CBS8TU U -55= 6    !z'2bc '// !.!2!23F!K%9%S@*;!!%?%P%PP$.t/A/A.BBuv}u~`a{aLaL`MN44(::)  ' 7 7 > >t?Q?Q R   9 ,)::B>@*;!!%?%P%PP$.t/A/A.BBuv}u~`a{aLaL`MN44(::)  ' 7 7 > >t?Q?Q R   #8 8)::B>@*;)::B>@*;!!%?%P%PP$.t/A/A.BBuv}u~`a{aLaL`MN44(::) !!%?%P%PP$.t/A/A.BBuv}u~`a{aLaL`MN44(::)  ' 7 7 > >t?Q?Q R & 7 7 > >t?Q?Q R,,224JC)77?;=*8 *G-A6 66<<!Wf-66   ! sLS).N2N-M0N2#N0$N2,S)-N20N22 S&rr@rDrGrHrIrJrKrLrrMr rrOrPrQrRrSr rTr rUrVr rW) rrrrrXrYrZr[r^ updated_teamr`s radisable_team_loggingriss2G <  CBS8TU U -55= 6    !:gY6F!GH  '// !.!2!23F!K%9%S *G-A6 66<<!Wf-66    sLH9.DD B&DD /D H9 D D H6DH11H66H9c K ddlm}|tdddi|j|dd d{}|td dd |d i|j}|j di}t di|}d||j|j|jddS7j#t$r*}tjdjt|tjt!j"t%|trct't)|ddt|dt*j,j.t)|ddt)|dt0j2t%|t&r|t'dt|zt*j,j.t)|ddt0j2d}~wwxYww)a Get the success/failure callbacks and variables for a team Parameters: - team_id (str, required): The unique identifier for the team Example curl: ``` curl -X GET 'http://localhost:4000/team/dbe2f686-a686-4896-864a-4c3924458709/callback' -H 'Authorization: Bearer sk-1234' ``` This will return the callback settings for the team with id dbe2f686-a686-4896-864a-4c3924458709 Returns { "status": "success", "data": { "team_id": team_id, "success_callbacks": team_callback_settings_obj.success_callback, "failure_callbacks": team_callback_settings_obj.failure_callback, "callback_vars": team_callback_settings_obj.callback_vars, }, } rrNrrrr r#r$r%rdr(rer)r*)rrfrgrEr5zHlitellm.proxy.proxy_server.get_team_callbacks(): Exception occurred - {}r"r6r7r/r8r!r9r:r;)r<rrr=r2r>rr@rDrErMr rrNrOrPrQrRrSr rTr rUrVr rW) rrrrrXrYrZr[r`s raget_team_callbacksrk&sF6 <  CBS8TU U -55= 6    !:gY6F!GH  '// !.!2!23F!K&:%S *G-A6 66<<!Wf-66   ! s:G.BBA)BGB G)D%GGG)__doc__rHrQtypingrfastapirrrrrr litellm._loggingr litellm.proxy._typesr r r rr$litellm.proxy.auth.user_api_key_authr&litellm.proxy.management_helpers.utilsrrouterpostrOrbrir>rkr;rarvs  NN1CN #  +,-   )00A(B(. t) _ _ _ _ & _ ! _   _ D%  +,-  )00A(BZ Z Z &Z   Z z#  +,-  )00A(BS S S &S   S ru