gVddlZddlmZddlmZddlmZmZmZddl GddZ y)N)Dict)+_convert_vertex_datetime_to_openai_datetime)BatchBatchJobStatusCreateBatchRequest)*ceZdZdZededefdZedede fdZ edede fdZ edede fdZ edede fd Zededefd Zed e de fd Zed e de fdZy)VertexAIBatchTransformationz Transforms OpenAI Batch requests to Vertex AI Batch requests API Ref: https://cloud.google.com/vertex-ai/generative-ai/docs/multimodal/batch-prediction-gemini requestreturnc&dtj}|jd}| tdt t |d}|j |}tdt|j|}t|||| S) zN Transforms OpenAI Batch requests to Vertex AI Batch requests zlitellm-vertex-batch- input_file_idz+input_file_id is required, but not provided)urisjsonl) gcsSourceinstancesFormat)outputUriPrefix)predictionsFormatgcsDestination) inputConfig outputConfigmodel displayName) uuiduuid4get ValueError InputConfig GcsSource_get_model_from_gcs_file OutputConfigGcsDestination_get_gcs_uri_prefix_from_fileVertexAIBatchPredictionJob)clsr request_display_namer input_configr output_configs b/var/www/openai/venv/lib/python3.12/site-packages/litellm/llms/vertex_ai/batches/transformation.py9transform_openai_batch_request_to_vertex_ai_batch_requestzUVertexAIBatchTransformation.transform_openai_batch_request_to_vertex_ai_batch_requests"7tzz|nE O4  JK K$/]3W% 11-@&2%) # A A- P' *$&,   responsec t|j|dt|jddd|j |d|j |d|j | S)N24hrs createTime)vertex_datetimebatch) idcompletion_window created_atendpointrobjectstatus error_file_idoutput_file_id)r+_get_batch_id_from_vertex_ai_batch_responserr0_get_input_file_id_from_vertex_ai_batch_response3_get_batch_job_status_from_vertex_ai_batch_response1_get_output_file_id_from_vertex_ai_batch_response)r%r,s r);transform_vertex_ai_batch_response_to_openai_batch_responsezWVertexAIBatchTransformation.transform_vertex_ai_batch_response_to_openai_batch_response/su>>xH%B ( \2 >NNJJ8TPP  r+c`|jdd}|sy|jd}|r|dS|S)z Gets the batch id from the Vertex AI Batch response safely vertex response: `projects/510528649030/locations/us-central1/batchPredictionJobs/3814889423749775360` returns: `3814889423749775360` namer0/)rsplit)r%r,_namepartss r)r;zGVertexAIBatchTransformation._get_batch_id_from_vertex_ai_batch_responseEs; VR( C !uRy,u,r+cd}|jd}||S|jd}||S|jdd}t|dk(r|S|dS)zJ Gets the input file id from the Vertex AI Batch response r0rrrr)rlen)r%r,rr' gcs_sourcers r)r<zLVertexAIBatchTransformation._get_input_file_id_from_vertex_ai_batch_responseWsi ||M2   !%%k2   ~~fb) t9> Awr+cd}|jd}||S|jd}||S|jdd}|S)zK Gets the output file id from the Vertex AI Batch response r0rrrr)r%r,r:r(gcs_destinationoutput_uri_prefixs r)r>zMVertexAIBatchTransformation._get_output_file_id_from_vertex_ai_batch_responsemsZ! ^4  ! !'++,<=  "! !+//0A2F  r+c Nddddddddddddd }|jd d }||S) z Gets the batch job status from the Vertex AI Batch response ref: https://cloud.google.com/vertex-ai/docs/reference/rest/v1/JobState failed validating in_progress completed cancelling cancelledexpired) JOB_STATE_UNSPECIFIEDJOB_STATE_QUEUEDJOB_STATE_PENDINGJOB_STATE_RUNNINGJOB_STATE_SUCCEEDEDJOB_STATE_FAILEDJOB_STATE_CANCELLINGJOB_STATE_CANCELLEDJOB_STATE_PAUSEDJOB_STATE_EXPIREDJOB_STATE_UPDATINGJOB_STATE_PARTIALLY_SUCCEEDEDstaterVrK)r%r, state_mapping vertex_states r)r=zOVertexAIBatchTransformation._get_batch_job_status_from_vertex_ai_batch_responsesM&. ,!-!.#. ($0#. -!*"/-8 4  ||G-DE \**r+rc0|jdd}|dS)aK Gets the gcs uri prefix from the input file id Example: input_file_id: "gs://litellm-testing-bucket/vtx_batch.jsonl" returns: "gs://litellm-testing-bucket" input_file_id: "gs://litellm-testing-bucket/batches/vtx_batch.jsonl" returns: "gs://litellm-testing-bucket/batches" rBr)rsplit)r%r path_partss r)r#z9VertexAIBatchTransformation._get_gcs_uri_prefix_from_files #))#q1 !}r+ gcs_file_uricddlm}||}|jdd}|jd}ddj|dd}|S)a Extracts the model from the gcs file uri When files are uploaded using LiteLLM (/v1/files), the model is stored in the gcs file uri Why? - Because Vertex Requires the `model` param in create batch jobs request, but OpenAI does not require this gcs_file_uri format: gs://litellm-testing-bucket/litellm-vertex-files/publishers/google/models/gemini-1.5-flash-001/e9412502-2c91-42a6-8e61-f5c294cc0fc8 returns: "publishers/google/models/gemini-1.5-flash-001" r)unquotez publishers/rfrBN) urllib.parserkrDjoin)r%rirk decoded_uri model_pathrFrs r)r z4VertexAIBatchTransformation._get_model_from_gcs_filesW )l+  &&}5a8   %chhuRay123 r+N)__name__ __module__ __qualname____doc__ classmethodrr$r*VertexBatchPredictionResponserr?strr;r<r>rr=r#r r+r)r r s%  #  $  8 4   *-4- --"4 *!4! !!$+4+ ++4 # #  CCr+r ) rtypingr#litellm.llms.vertex_ai.common_utilsrlitellm.types.llms.openairrrlitellm.types.llms.vertex_air rxr+r)r}s( PO*uur+