g)ddlZddlZddlZddlmZmZmZmZddlZddl m Z ddl Z ddl m Z ddlmZddlmZmZddlmZdd lmZdd lmZerdd lmZneZGd d e ZGddeZy)N) TYPE_CHECKINGAnyOptionalUnion) BaseModel)verbose_logger)Logging)_get_httpx_clientget_async_httpx_client) ImageResponse) BaseAWSLLM) BedrockError)AWSPreparedRequestc:eZdZUdZeed<eed<eed<eed<y)BedrockImagePreparedRequestzV Internal/Helper class for preparing the request for bedrock image generation endpoint_urlpreppedbodydataN) __name__ __module__ __qualname____doc__str__annotations__rbytesdict]/var/www/openai/venv/lib/python3.12/site-packages/litellm/llms/bedrock/image/image_handler.pyrrs  K Jr rc<eZdZdZ ddedededededee e e jfd e d eed eefd Zd edee e e jfdededededefdZdeded eed eedededefdZdedededefdZdedededede j&dedefdZy)BedrockImageGenerationz* Bedrock Image Generation handler Nmodelpromptmodel_responseoptional_params logging_objtimeoutaimg_generationapi_base extra_headersc <|j|||| ||} |dur|j| |||||St} | j| j| j j | j} | j|j!||||| | j"}|S#tj$r<} | jj}t|| jjd} ~ wtj$rtddwxYw) N)r$r'r+r,r(r%T)prepared_requestr)r$r(r%r&urlheadersr status_codemessageTimeout error occurred.)r&r$r(r%responser)_prepare_requestasync_image_generationr postrrr1rraise_for_statushttpxHTTPStatusErrorr7r3rtextTimeoutException+_transform_response_dict_to_openai_responser)selfr$r%r&r'r(r)r*r+r,r.clientr7err error_codes r!image_generationz'BedrockImageGeneration.image_generation+sO 00+'# 1  d "..!1'- / #$ S{{'7'D'DN^NfNfNnNnvFvKvK{LH  % % 'II)#!&& J $$ R11J:s||?P?PQ Q%% S38QR R SsA B--D7C77$Dr.returnc.Kttjjd|i} |j |j |j j|jd{}|j|j#|||||j$|}|S77#tj$r<} | jj} t| | jjd} ~ wtj $rtddwxYww) z Asynchronous handler for bedrock image generation Awaits the response from the bedrock image generation endpoint r)) llm_providerparamsr/Nr2r5r6)r$r(r%r7rr&)r litellm LlmProvidersBEDROCKr:rrr1rr;r<r=r7r3rr>r?r@r) rAr.r)r$r(r%r& async_clientr7rCrDs r!r9z-BedrockImageGeneration.async_image_generation^s. --55w'  S)..3C3P3PZjZrZrZzZzBRBWBW.XXH  % % 'II#!&&) J #X$$ R11J:s||?P?PQ Q%% S38QR R Ss:(D?B$*B"+B$?#D"B$$D77C..$DDc ddlm}ddlm}|j |} |} |j || j| j\} } | d| d} || jd| j} |j||| }tj|jd }d d i}|d d i|}|d | ||}| j||d|vr|d|jd<|j!}|j#|d|| |jdt%| |||S#t$r t dwxYw)a Prepare the request body, headers, and endpoint URL for the Bedrock Image Generation API Args: model (str): The model to use for the image generation optional_params (dict): The optional parameters for the image generation api_base (Optional[str]): The base URL for the Bedrock API extra_headers (Optional[dict]): The extra headers to include in the request logging_obj (LitellmLogging): The logging object to use for logging prompt (str): The prompt to use for the image generation Returns: BedrockImagePreparedRequest: The prepared request object The BedrockImagePreparedRequest contains: endpoint_url (str): The endpoint URL for the Bedrock Image Generation API prepped (httpx.Request): The prepared request object body (bytes): The request body r) SigV4Auth) AWSRequestz7Missing boto3 to call bedrock. Run 'pip install boto3'.)r+aws_bedrock_runtime_endpointaws_region_namez/model/z/invokebedrock)r$r%r'zutf-8z Content-Typezapplication/jsonPOST)methodr0rr1 Authorization)complete_input_dictr+r1)inputapi_keyadditional_args)rrrr) botocore.authrObotocore.awsrequestrP ImportError*_get_boto_credentials_from_optional_paramsget_runtime_endpointrQrR credentials_get_request_bodyjsondumpsencodeadd_authr1preparepre_callr)rAr$r'r+r,r(r%rOrPboto3_credentials_infomodelId_proxy_endpoint_urlsigv4rrr1requestrs r!r8z'BedrockImageGeneration._prepare_requests6 Y / 6"&!P!P "   $ 9 9)?)\)\2BB!:!   !3377)7K " . .  " 2 2  %%&  zz$&&w/!#56  $%'9K]KG1g  w  %/]*J/<_/MGOOO ,//# '+."??  ++   e YWX X Ys D,,Ec|jdd}tj|}|jddi}|dk(rtj j |r,tj j||}t|S|jtjd}tjj}|jD]\} } | |vs | || <d|d d gi|}|Std d |d )z Get the request body for the Bedrock Image Generation API Checks the model/provider and transforms the request body accordingly Returns: dict: The request body to use for the Bedrock Image Generation API .ruserN stability)r%r' text_prompts)r>weightizUnsupported model=z , passed inr2)splitcopydeepcopypoprJAmazonStability3Config_is_stability_3_modeltransform_request_bodyrreplaceoslinesepAmazonStabilityConfig get_configitemsr) rAr$r%r'providerinference_paramsr request_bodyconfigkvs r!rbz(BedrockImageGeneration._get_request_bodys;;s#A&==9 D  { "--CCEJ&==TT!? U  L)) C8 66AAC"LLNDAq!11./(+ + #f%B$C& +=eWK)P r r7rcl|!|j|d|jd|itjd|j|j }| t dt jj|rt jnt j}|j|||S)zX Transforms the Image Generation response from Bedrock to OpenAI format rWrX)rYrZoriginal_responser[zraw model_response: %sz)Error in response object format, got None)r$)r& response_dict) post_callr>rdebugrc ValueErrorrJr{r|r*transform_response_dict_to_openai_response) rAr&r$r(r%r7rr config_classs r!r@zBBedrockImageGeneration._transform_response_dict_to_openai_response s  "  ! !"*--!6 = "  5x}}E   HI I--CC%CP  * *..  ??)' @ r )FNN)rrrrrr rLitellmLoggingrrfloatr<TimeoutboolrErr9r8rbResponser@rr r!r#r#&s!&"&(,111& 1  1 $ 1%u}} 456113-1 ~1f%5%%u}} 456% % $ %  %&% %NU U U 3- U  ~ U $ U U  %U n+++ +  +Z$%$$$ $  $ .. $$ $r r#)rxrcrtypingrrrrr<pydanticrrJlitellm._loggingr*litellm.litellm_core_utils.litellm_loggingr r&litellm.llms.custom_httpx.http_handlerr r litellm.types.utilsr base_aws_llmr common_utilsrr]rrr#rr r!rsY 66 +P.%'6)GZGr