gb1ddlZddlZddlmZmZmZmZmZmZddl m Z ddl m Z ddl mZmZddlddlmZmZerddlmZneZd ZGd d e Zy) N) TYPE_CHECKINGAnyDictOptionalTupleUnion)verbose_logger)CustomBatchLogger)get_async_httpx_clienthttpxSpecialProvider)*)StandardCallbackDynamicParamsStandardLoggingPayload VertexBaseIAM_AUTHc &eZdZddeeddffd Z ddeedeedeeeffdZdeeeffdZ ded ede eeffd Z ifd eeee fde fd Zd eedefdZd eedefdZd efdZd efdZdeeefded edeeeffdZxZS) GCSBucketBaseN bucket_namereturnc ttj|_t j d}|xst j d}||_||_i|_t|(di|y)N) llm_providerGCS_PATH_SERVICE_ACCOUNTGCS_BUCKET_NAME) r r LoggingCallbackasync_httpx_clientosgetenvpath_service_account_json BUCKET_NAMEvertex_instancessuper__init__)selfrkwargs_path_service_account _bucket_name __class__s d/var/www/openai/venv/lib/python3.12/site-packages/litellm/integrations/gcs_bucket/gcs_bucket_base.pyr$zGCSBucketBase.__init__sg"8-==# !# *D E"Bbii0A&B 8M&*679 "6"service_account_jsonvertex_instancec Kddlm}||}|j|ddd{\}}|jd|||ddddd \}}t j d|d|d d }|S7Dw Nr)vertex_chat_completion vertex_ai credentials project_idcustom_llm_providerz gcs-bucket) model auth_headervertex_credentialsvertex_projectvertex_locationgemini_api_keystreamr5api_basezconstructed auth_header %szBearer zapplication/json) Authorizationz Content-Type)litellmr0_ensure_access_token_async_get_token_and_urlr debug) r%r,r-r0 _auth_headerr9r7_headerss r*construct_request_headersz'GCSBucketBase.construct_request_headers!s 3  "4O-<-W-W, +.X. ( $ n );;$3)  +<   Q 9;G&{m4.  /( s"A+A)AA+c ddlm}|j|jdd\}}|j d||j|ddddd \}}t j d|d|d d }|Sr/)r?r0_ensure_access_tokenr rAr rB)r%r0rCr9r7rDrEs r*sync_construct_request_headersz,GCSBucketBase.sync_construct_request_headersDs2'='R'R66 +(S( $ n 0BB$#==)  +C   Q 9;G&{m4.  r+ object_namecRd|vr |jdd\}}|d|}||fS||fS)a Handles when the user passes a bucket name with a folder postfix Example: - Bucket name: "my-bucket/my-folder/dev" - Object name: "my-object" - Returns: bucket_name="my-bucket", object_name="my-folder/dev/my-object" /)split)r%rrJprefixs r*_handle_folders_in_bucket_namez,GCSBucketBase._handle_folders_in_bucket_name`sI + "-"3"3C"; K#HAk]3K + +K''r+r&cK|i}|jdd}|tjdtjd||jddxs |j}|jddxs |j}| t d|}|}|j |d{}nI|j t d|j}|j}|j |d{}t||| S7\7w) a This function is used to get the GCS logging config for the GCS Bucket Logger. It checks if the dynamic parameters are provided in the kwargs and uses them to get the GCS logging config. If no dynamic parameters are provided, it uses the default values. N standard_callback_dynamic_paramszUsing dynamic GCS loggingz$standard_callback_dynamic_params: %sgcs_bucket_namegcs_path_service_accountzGCS_BUCKET_NAME is not set in the environment, but GCS Bucket is being used as a logging callback. Please set 'GCS_BUCKET_NAME' in the environment.)r3)rr-path_service_account)getr rBr!r ValueErrorget_or_create_vertex_instanceGCSLoggingConfig)r%r&rRr(r'rrUr-s r*get_gcs_logging_configz$GCSBucketBase.get_gcs_logging_configusa >F JJ94 @ ) , 7  !< =  68X  1445FM$##  1445OQUV211 " # j'K#8 $($F$F0%G%O ' j**K#'#A#A $($F$F0%G%O #+!5  s%B*D ,D -A D 6D 7D  D r3cKddlm}|j|}||jvr2|}|j |ddd{||j|<|j|S7"w)z This function is used to get the Vertex instance for the GCS Bucket Logger. It checks if the Vertex instance is already created and cached, if not it creates a new instance and caches it. rrNr1r2)&litellm.llms.vertex_ai.vertex_llm_baser&_get_in_memory_key_for_vertex_instancer"r@)r%r3r_in_memory_keyr-s r*rXz+GCSBucketBase.get_or_create_vertex_instances FDD[Q !6!6 6(lO!<<'$/=   5DD ! !. 1$$^44  sAA+A)#A+c|xstS)aH Returns key to use for caching the Vertex instance in-memory. When using Vertex with Key based logging, we need to cache the Vertex instance in-memory. - If a credentials string is provided, it is used as the key. - If no credentials string is provided, "IAM_AUTH" is used as the key. ) IAM_AUTH_KEY)r%r3s r*r]z4GCSBucketBase._get_in_memory_key_for_vertex_instances*l*r+cTK |j|d{}|j|d|dd{}|d}|j||\}}d|d |d }|jj || d{}|j d k7r*t jd t|jyt jd|j |jS777m#t$r)}t jd t|Yd}~yd}~wwxYww)z Download an object from GCS. https://cloud.google.com/storage/docs/downloading-objects#download-object-json r&Nr-rUr-r,rrrJ,https://storage.googleapis.com/storage/v1/b//o/z ?alt=mediaurlrEGCS object download error: %sz,GCS object download response status code: %s) rZrFrPrrV status_coder errorstrtextrBcontent Exception r%rJr&gcs_logging_configrErrhresponsees r*download_gcs_objectz!GCSBucketBase.download_gcs_objectsP " 9=9T9T:U:4 !:: 23D E%78N%O;G-];K'+'J'J''(K( $K A SQ\P]]ghC"4488S'8RRH##s*$$3S5G  >@T@T  ## #;4S   !@#a& I smD(C3C- C3C/AC3C1rsC CC+F4UAJ q%qr+