g6=fddlZddlZddlmZddlmZmZmZmZddl Z ddl m Z ddl ddl mZddlmZeZddlmZdad Zd efd Zej1d eegd gdej1deegd gdeefdedededefdZej7deegd gdej7deegd gdeefdededed eddef dZej7d eegd gdej7deegd gdddeefdeded eddeedeedef dZej1d eegd gd!ej1d"eegd gd!eefdedededefd#Z y)$N)Optional) APIRouterDependsRequestResponse)verbose_proxy_logger)*)user_api_key_auth)handle_exception_on_proxy)LiteLLMFineTuningJobCreatec|yt|ts td|D]f}t|ts|j D]@\}}t|t s|j ds)tj|||<Bh|a y)Nz9invalid fine_tuning config, expected a list is not a listz os.environ/) isinstancelist ValueErrordictitemsstr startswithlitellm get_secretfine_tuning_config)configelementkeyvalues b/var/www/openai/venv/lib/python3.12/site-packages/litellm/proxy/fine_tuning_endpoints/endpoints.pyset_fine_tuning_configrs} ~ fd #TUU gt $%mmo UeS)e.>.>}.M#*#5#5e#djtA|tjtCjDtG|d }~wwxYww)ad Creates a fine-tuning job which begins the process of creating a new model from a given dataset. This is the equivalent of POST https://api.openai.com/v1/fine_tuning/jobs Supports Identical Params as: https://platform.openai.com/docs/api-reference/fine-tuning/create Example Curl: ``` curl http://localhost:4000/v1/fine_tuning/jobs -H "Content-Type: application/json" -H "Authorization: Bearer sk-1234" -d '{ "model": "gpt-3.5-turbo", "training_file": "file-abc123", "hyperparameters": { "n_epochs": 4 } }' ``` radd_litellm_data_to_requestgeneral_settingsget_custom_headers premium_user proxy_configproxy_logging_objversionT) exclude_none+Only premium users can use this endpoint + zRequest received by LiteLLM: {})indentdatar'r.r*r3r1Nrlitellm_call_idsuccess)r;status_hidden_paramsmodel_id cache_keyapi_baseallowed_model_regionr*r@rArBr3 model_regionr*original_exception request_datazLlitellm.proxy.proxy_server.create_fine_tuning_job(): Exception occurred - {})$litellm.proxy.proxy_serverr-r.r/r0r1r2r3 model_dumprCommonProxyErrorsnot_premium_userrrdebugformatjsondumpsr#rupdateracreate_fine_tuning_jobasyncio create_taskupdate_request_statusr!getattrheaders Exceptionpost_call_failure_hookerrorr traceback format_excr )r'r(r)r*r-r.r/r0r1r2r3r9llm_provider_configresponse hidden_paramsr@rArBes rcreate_fine_tuning_jobrb;sIL  ) )t ) O>`>`>f>f=gh  "" . 5 5djjaj6P Q 1-/%   > 3 G G   * KK+ , 88@4@@   3 3 $):B ?  4   *:B?E2  $$Z6<"!%%k48>B  $$Z6<"  '' "3!#!$%68NPRS   Y $A6  +66/ATX7    "" Z a aA  ""9#7#7#9:'** +s\%H6A4F)F$AF)"F'#CF)#H6$F)'F)) H32H. G  A$H..H33H6z./v1/fine_tuning/jobs/{fine_tuning_job_id:path}u)✨ (Enterprise) Retrieve Fine-Tuning Jobz+/fine_tuning/jobs/{fine_tuning_job_id:path}fine_tuning_job_id)openaiazurecdKddlm}m}m}m}m} m} m} i} |dur&tdtjj|| |||| | d{} t|} | | j| tjdi| d|id{}t!|d ixsi}|j#d dxsd }|j#d dxsd }|j#d dxsd }|j$j|||||| t!|dd |S77#t&$r}| j)||| d{7t+j,dj/t1|t+j2t5j6t9|d}~wwxYww)a& Retrieves a fine-tuning job. This is the equivalent of GET https://api.openai.com/v1/fine_tuning/jobs/{fine_tuning_job_id} Supported Query Params: - `custom_llm_provider`: Name of the LiteLLM provider - `fine_tuning_job_id`: The ID of the fine-tuning job to retrieve. rr,Tr5r8Nr:rcr?r@r<rArBrCrDrFKlitellm.proxy.proxy_server.list_fine_tuning_jobs(): Exception occurred - {}rI)rJr-r.r/r0r1r2r3rrLrMrr#rRraretrieve_fine_tuning_jobrWr!rXrYrZrr[rOrrNr\r]r )r'r(rcrr*r-r.r/r0r1r2r3r9r^r_r`r@rArBras rretrieve_fine_tuning_jobris6D9+ t #=>O>`>`>f>f=gh 1-/%   > 3   * KK+ , ::  1    *:B?E2  $$Z6<"!%%k48>B  $$Z6<"  '' "3!#!$%68NPRS   O " 0  +66/ATX7    "" Y ` `A  ""9#7#7#9:'** +sZF0;D#D?D#D!B D#F0D#!D## F-,F(EA$F((F--F0u&✨ (Enterprise) List Fine-Tuning JobsafterlimitcfKddlm}m}m}m} m} m} m} i} | dur&tdtjj|| |||| | d{} t|}|| j|tjdi| ||dd{}t!|d ixsi}|j#d dxsd }|j#d dxsd }|j#d dxsd }|j$j|||||| t!|dd |S77#t&$r}| j)||| d{7t+j,dj/t1|t+j2t5j6t9|d}~wwxYww)ar Lists fine-tuning jobs for the organization. This is the equivalent of GET https://api.openai.com/v1/fine_tuning/jobs Supported Query Params: - `custom_llm_provider`: Name of the LiteLLM provider - `after`: Identifier for the last job from the previous pagination request. - `limit`: Number of fine-tuning jobs to retrieve (default is 20). rr,Tr5r8Nr:)rjrkr?r@r<rArBrCrDrFrgrI)rJr-r.r/r0r1r2r3rrLrMrr#rRralist_fine_tuning_jobsrWr!rXrYrZrr[rOrrNr\r]r )r'r(rrjrkr*r-r.r/r0r1r2r3r9r^r_r`r@rArBras rlist_fine_tuning_jobsrns:D:+ t #=>O>`>`>f>f=gh 1-/%   > 3   * KK+ , 77     *:B?E2  $$Z6<"!%%k48>B  $$Z6<"  '' "3!#!$%68NPRS   Q " 2  +66/ATX7    "" Y ` `A  ""9#7#7#9:'** +s[F1;D$D AD$D"B D$F1 D$"D$$ F.-F)EA$F))F..F1z5/v1/fine_tuning/jobs/{fine_tuning_job_id:path}/cancelu(✨ (Enterprise) Cancel Fine-Tuning Jobsz2/fine_tuning/jobs/{fine_tuning_job_id:path}/cancelcKddlm}m}m}m}m}m} m} i} |dur&tdtjj|| |||| |d{} |jd{} | jdd} t| }|| j|t!j"di| d |id{}t%|d ixsi}|jd dxsd }|jd dxsd }|jddxsd }|j&j|||||| t%|dd |S777#t($r}| j+||| d{7t-j.dj1t3|t-j4t7j8t;|d}~wwxYww)a* Cancel a fine-tuning job. This is the equivalent of POST https://api.openai.com/v1/fine_tuning/jobs/{fine_tuning_job_id}/cancel Supported Query Params: - `custom_llm_provider`: Name of the LiteLLM provider - `fine_tuning_job_id`: The ID of the fine-tuning job to cancel. rr,Tr5r8Nrr:rcr?r@r<rArBrCrDrFrgrI)rJr-r.r/r0r1r2r3rrLrMrrPr!r#rRracancel_fine_tuning_jobrWrXrYrZrr[rOrrNr\r]r )r'r(rcr*r-r.r/r0r1r2r3r9 request_bodyrr^r_r`r@rArBras rcancel_fine_tuning_jobrrys 6D=+ t #=>O>`>`>f>f=gh 1-/%   %\\^+ *../DdK> 3   * KK+ , 88  1    *:B?E2  $$Z6<"!%%k48>B  $$Z6<"  '' "3!#!$%68NPRS   W , 0  +66/ATX7    "" Y ` `A  ""9#7#7#9:'** +smG;EE E+E ,AE=E >B EG E E E GG/E20A$GGG)!rTr\typingrfastapirrrrrlitellm._loggingrlitellm.proxy._types$litellm.proxy.auth.user_api_key_authr litellm.proxy.utilsr routerlitellm.types.llms.openair rrrr#postUserAPIKeyAuthrbr!LiteralriintrnrrrIrrrs991"B9 @ $  +,-  5   +,-  5  )00A(B h+ h+h+4h+& h+  h+V4+,-  7   1+,-  7  )00A(B S+ S+S+S+!!23 S+ & S+  S+l+,-  4   +,-  4   (/0A(B V+ V+V+!!23V+ C= V+ C= V+ & V+  V+r;+,-  6   8+,-  6  )00A(B W+ W+W+W+& W+  W+r