g@ dZddlZddlmZmZmZddlmZmZm Z m Z m Z ddl ddl mZddlmZmZddlmZeZej+d d geege eefd ed efdZej+dd geegdZej+dd geegdZej9dd geegeefd efdZej+dd geegd efdZej+dd geege eeefd e!de d ede fdZ"de#de$dedee%e&ffdZ'y) z Endpoints for /organization operations /organization/new /organization/update /organization/delete /organization/member_add /organization/info /organization/list N)ListOptionalTuple) APIRouterDepends HTTPExceptionRequeststatus)*)user_api_key_auth)get_new_internal_user_defaultsmanagement_endpoint_wrapper) PrismaClientz/organization/newzorganization management)tags dependenciesresponse_modeldatauser_api_key_dictc Kddlm}m}|tdddi|j|jt j k7rtddd |ji|j tjj}|jd }|jDcic] \}}||vs ||}}}tdi|} |j| jd } |jjj!i| |j"xs||j"xs|d  d{} | j|_ t%|j&dk(rnet%|j&dk(rtdddi|j&D]/} | |j&vstddd| d|j&it)di|jd |j"xs||j"xs|d } |j| jd }|jj*j!i| d{}|Scc}}w7*7w)a Allow orgs to own teams Set org level budgets + model access. Only admins can create orgs. # Parameters - organization_alias: *str* - The name of the organization. - models: *List* - The models the organization has access to. - budget_id: *Optional[str]* - The id for a budget (tpm/rpm/max budget) for the organization. ### IF NO BUDGET ID - CREATE ONE WITH THESE PARAMS ### - max_budget: *Optional[float]* - Max budget for org - tpm_limit: *Optional[int]* - Max tpm limit for org - rpm_limit: *Optional[int]* - Max rpm limit for org - max_parallel_requests: *Optional[int]* - [Not Implemented Yet] Max parallel requests for org - soft_budget: *Optional[float]* - [Not Implemented Yet] Get a slack alert when this soft budget is reached. Don't block requests. - model_max_budget: *Optional[dict]* - Max budget for a specific model - budget_duration: *Optional[str]* - Frequency of reseting org budget - metadata: *Optional[dict]* - Metadata for team, store information for team. Example metadata - {"extra_info": "some info"} - blocked: *bool* - Flag indicating if the org is blocked or not - will stop all calls from keys with this org_id. - tags: *Optional[List[str]]* - Tags for [tracking spend](https://litellm.vercel.app/docs/proxy/enterprise#tracking-spend-for-custom-tags) and/or doing [tag-based routing](https://litellm.vercel.app/docs/proxy/tag_routing). - organization_id: *Optional[str]* - The organization id of the team. Default is None. Create via `/organization/new`. - model_aliases: Optional[dict] - Model aliases for the team. [Docs](https://docs.litellm.ai/docs/proxy/team_based_routing#create-team-with-model-alias) Case 1: Create new org **without** a budget_id ```bash curl --location 'http://0.0.0.0:4000/organization/new' --header 'Authorization: Bearer sk-1234' --header 'Content-Type: application/json' --data '{ "organization_alias": "my-secret-org", "models": ["model1", "model2"], "max_budget": 100 }' ``` Case 2: Create new org **with** a budget_id ```bash curl --location 'http://0.0.0.0:4000/organization/new' --header 'Authorization: Bearer sk-1234' --header 'Content-Type: application/json' --data '{ "organization_alias": "my-secret-org", "models": ["model1", "model2"], "budget_id": "428eeaa8-f3ac-4e85-a8fb-7dc8d7aa8689" }' ``` r)litellm_proxy_admin_name prisma_clientNerrorNo db connected status_codedetailz,Only admins can create orgs. Your role is = T) exclude_none) created_by updated_byrz\User not allowed to give access to all models. Select models you want org to have access to.z)User not allowed to give access to model=z. Models you have access to = )litellm.proxy.proxy_serverrrr user_roleLitellmUserRoles PROXY_ADMIN budget_idLiteLLM_BudgetTable model_fieldskeysjsonitemsjsonify_objectdblitellm_budgettablecreateuser_idlenmodelsLiteLLM_OrganizationTablelitellm_organizationtable)rrrr budget_params _json_datakv _budget_data budget_row new_budget_budgetmorganization_rownew_organization_rowresponses n/var/www/openai/venv/lib/python3.12/site-packages/litellm/proxy/management_endpoints/organization_endpoints.pynew_organizationrEsNSW>O4PQQ ##+  & &*:*F*F FGHYHcHcGde   ~~ ,88==? YYDY1 )3)9)9);R);AqM?Q1); R(8<8 "11*//t/2TU %((<<CC/77S;S/77S;SD  !**  # #$) t{{ q {  A)000# ##LQCOmnoGoGnH"I1 ))) &$,,H0H$,,H0H )7740#%%??FF " GH OeS  Ns?B/I-1 I">I"A;I->I(?A3I-3B(I-I+ I-+I-z/organization/update)rrc Ktdwzd[TODO] Not Implemented yet. Let us know if you need this - https://github.com/BerriAI/litellm/issueszNot Implemented YetNotImplementedErrorr$rDupdate_organizationrK 3 44 z/organization/deletec KtdwrGrHr$rJrDdelete_organizationrOrLrMz/organization/listc|Kddlm}|tdddi|j|jtj k7rtddd |ji|'td dt jji|jjjd d i d{}|S7w)z ``` curl --location --request GET 'http://0.0.0.0:4000/organization/list' --header 'Authorization: Bearer sk-1234' ``` rrNrrrrrz*Only admins can list orgs. Your role is = r#membersT)include) r%rrr&r'r(CommonProxyErrorsdb_not_connected_errorvaluer0r7 find_many)rrrCs rDlist_organizationrXs9W>O4PQQ ##+  & &*:*F*F FEFWFaFaEbc  .EEKKL  #%%??IID!JH O sB1B<3B:4B<z/organization/infoc&Kddlm}|tdddit|jdk(rtddd |ji|j j jd d |jiid d id{}|S7w)z* Get the org specific information rrQNrrrrr#z6Specify list of organization id's to query. Passed in=organization_idinlitellm_budget_tableT)whererS)r%rrr4 organizationsr0r7rW)rrrCs rDinfo_organizationr_s9W>O4PQQ 4  !#QRVRdRdQef  #%%??II 4););"<='.JH O sBBB Bz/organization/member_add http_requestreturnc K ddlm}|tdddi|jjj d|j i d{}|td dd t|ddit|jtr |j}n |jg}g}g}|D]G}t||j | d{\} } |j| |j| It|j || S77E#t$r} t| trYtt| ddt!| dt"j$t| ddt| dt&j(t| tr| tdt!| zt"j$t| ddt&j(d} ~ wwxYww)a [BETA] Add new members (either via user_email or user_id) to an organization If user doesn't exist, new user row will also be added to User Table Only proxy_admin or org_admin of organization, allowed to access this endpoint. # Parameters: - organization_id: str (required) - member: Union[List[Member], Member] (required) - role: Literal[LitellmUserRoles] (required) - user_id: Optional[str] - user_email: Optional[str] Note: Either user_id or user_email must be provided for each member. Example: ``` curl -X POST 'http://0.0.0.0:4000/organization/member_add' -H 'Authorization: Bearer sk-1234' -H 'Content-Type: application/json' -d '{ "organization_id": "45e3e396-ee08-4a61-a88e-16b3ce7e0849", "member": { "role": "internal_user", "user_id": "krrish247652@berri.ai" }, "max_budget_in_organization": 100.0 }' ``` The following is executed in this function: 1. Check if organization exists 2. Creates a new Internal User if the user_id or user_email is not found in LiteLLM_UserTable 3. Add Internal User to the `LiteLLM_OrganizationMembership` table rrQNrrrrrZr]z+Organization not found for organization_id=)memberrZr)rZ updated_users updated_organization_membershipsrzAuthentication Error()paramNoner)messagetypericodezAuthentication Error, )r%rrr0r7 find_uniquerZgetattr isinstancereradd_member_to_organizationappendOrganizationAddMemberResponse ExceptionProxyExceptionstrProxyErrorTypes auth_errorr HTTP_500_INTERNAL_SERVER_ERROR) rr`rrexisting_organization_rowrRrfrgre updated_userupdated_organization_membershipes rDorganization_member_addr~sh= <  CBS8TU U ""<<HH($*>*>?I  " % ,J7SWYjlpKqJrs  dkk4 (kkG{{mG13 VX(F0!$($8$8"/ :L9   . , 3 34S T- 00'-M  C .  a ' 8/DSVHA-NO$//a&1Q v/T/TU   > *G,s1v5 ++!Wf-66    sPG"A DDA;D D ADG"DD GB=GGG"rerZrcK d}d}d}|j:|jjjd|jid{}|j:|jjjd|jid{}|{|y|jxst t j}t||j}|j|dd{}|tdi|j}n|t|dkDrtd d d i |tdi|j}nE|tdi|j}n)td d d|jd|ji |%td|jd|j|jjj!||j|j"dd{} t%di| j} || fS77717*#t&$r} td| d} ~ wwxYww)z Add a member to an organization - Checks if member.user_id or member.user_email is in LiteLLM_UserTable - If not found, create a new user in LiteLLM_UserTable - Add user to organization in LiteLLM_OrganizationMembership Nr3rc user_email)r3ruser)r table_namer#rzIMultiple users with this email found in db. Please use 'user_id' instead.rrdzUser not found for user_id=z and user_email=z2User does not exist in LiteLLM_UserTable. user_id=)rZr3r&r"z%Error adding member to organization: r$)r3r0litellm_usertablernrrvuuiduuid4r insert_dataLiteLLM_UserTable model_dumpr4r ValueErrorlitellm_organizationmembershipr2role#LiteLLM_OrganizationMembershipTablert) rerZr user_objectexisting_user_id_rowexisting_user_email_rowr3new_user_defaults_returned_user_organization_membershiporganization_membershipr}s rDrqrqsEF37 #"& >> %)6)9)9)K)K)W)W &..1*X*$     (#&&88DD'):):;E $ ',C,K!>>>S->G >!,,!  $1#<#>:JJZ[a[l[lZmn   DV^^DTTdekevevdwx   ""AAHH'6*22!'I  !#F# &113# 333y$ h:  F@DEEFstIAH( H AH(H A H(2H#3DH(;H&< H(IH( H(#H(&H(( I1H??II)(__doc__rtypingrrrfastapirrrr r litellm.proxy._types$litellm.proxy.auth.user_api_key_authr &litellm.proxy.management_helpers.utilsr rlitellm.proxy.utilsrrouterpostNewOrganizationResponseNewOrganizationRequestUserAPIKeyAuthrErKrOgetrXOrganizationRequestr_rsOrganizationMemberAddRequestr~ OrgMemberrvrrrqr$rJrDrs=  ((FF"B-  # $+,-*  )00A(BM M%M  M` # $+,-  5  5  # $+,-  5  5  # $+,-  )00A(B!%!  !H # $+,-  "5  0 # $+,-0   )00A(Bj &j j &j # j  j ZRF RFRF RF A AB RFrJ