gZ$dZddlmZmZmZmZmZmZddlZddl Z ddl m Z ddl m Z mZddlmZddlmZddlmZmZd d lmZer dd lmZeZneZGd d e e Zy)z Support for gpt model family ) TYPE_CHECKINGAnyListOptionalUnioncastN)BaseLLMModelInfo) BaseConfigBaseLLMException)get_secret_str)AllMessageValues) ModelInfoBase ModelResponse) OpenAIError)LoggingcpeZdZUdZdZeeed<dZee e e fed<dZ ee ed<dZee ed<dZeeed<dZeeed<dZeeed <dZee e e fed <dZeeed <dZeeed <dZee ed < d-deedee e e fdee dee deedeed eed ee e e fd eed eed ee ddfdZefdZde de fdZde de de dede f dZde de de dede f dZdeede deefdZde deede de de de f dZ d.de de!jDde#de$d e deede de d!e%d"ee d#eede#fd$Z&d%e d&ede e e!jNfde(fd'Z) d.de de deede d"ee d(ee de fd)Z* d.d"ee d(ee dee fd*Z+ d/de d+ee,de,fd,Z-xZ.S)0OpenAIGPTConfiga Reference: https://platform.openai.com/docs/api-reference/chat/create The class `OpenAIConfig` provides configuration for the OpenAI's Chat API interface. Below are the parameters: - `frequency_penalty` (number or null): Defaults to 0. Allows a value between -2.0 and 2.0. Positive values penalize new tokens based on their existing frequency in the text so far, thereby minimizing repetition. - `function_call` (string or object): This optional parameter controls how the model calls functions. - `functions` (array): An optional parameter. It is a list of functions for which the model may generate JSON inputs. - `logit_bias` (map): This optional parameter modifies the likelihood of specified tokens appearing in the completion. - `max_tokens` (integer or null): This optional parameter helps to set the maximum number of tokens to generate in the chat completion. - `n` (integer or null): This optional parameter helps to set how many chat completion choices to generate for each input message. - `presence_penalty` (number or null): Defaults to 0. It penalizes new tokens based on if they appear in the text so far, hence increasing the model's likelihood to talk about new topics. - `stop` (string / array / null): Specifies up to 4 sequences where the API will stop generating further tokens. - `temperature` (number or null): Defines the sampling temperature to use, varying between 0 and 2. - `top_p` (number or null): An alternative to sampling with temperature, used for nucleus sampling. Nfrequency_penalty function_call functions logit_bias max_tokensnpresence_penaltystop temperaturetop_presponse_formatreturnc tj} | jD]%\} }| dk7s |t|j| |'y)Nself)localscopyitemssetattr __class__)r"rrrrrrrrrrrlocals_keyvalues `/var/www/openai/venv/lib/python3.12/site-packages/litellm/llms/openai/chat/gpt_transformation.py__init__zOpenAIGPTConfig.__init__AsA(--/!--/JCf}!2U3*c t|SN)super get_config)clsr's r+r1zOpenAIGPTConfig.get_configTsw!##r-modelcgd}g}|dk7r|dk7r|jd|tjvs|tjvr|jd||zS)N)rrlogprobs top_logprobsrmax_completion_tokens modalities predictionrrseedrstreamstream_optionsrrtools tool_choicerr max_retries extra_headersparallel_tool_callszgpt-3.5-turbo-16kzgpt-4ruser)appendlitellmopen_ai_chat_completion_modelsopen_ai_text_completion_models)r"r3 base_paramsmodel_specific_paramss r+get_supported_openai_paramsz+OpenAIGPTConfig.get_supported_openai_paramsXsm 4!# ( (Ug-= ! ( (): ; W;; ; g<< < ! ( ( 222r-non_default_paramsoptional_params drop_paramscl|j|}|jD]\}}||vs |||<|S)a If any supported_openai_params are in non_default_params, add them to optional_params, so they are use in API call Args: non_default_params (dict): Non-default parameters to filter. optional_params (dict): Optional parameters to update. model (str): Model name for parameter support check. Returns: dict: Updated optional_params with supported non-default parameters. )rIr%)r"rJrKr3rLsupported_openai_paramsparamr*s r+_map_openai_paramsz"OpenAIGPTConfig._map_openai_paramssG$#'"B"B5"I.446LE5//).&7r-c,|j||||S)N)rJrKr3rL)rP)r"rJrKr3rLs r+map_openai_paramsz!OpenAIGPTConfig.map_openai_paramss(&&1+# '  r-messagesc|Sr/)r"rSr3s r+_transform_messagesz#OpenAIGPTConfig._transform_messagess r-litellm_paramsheadersc6|j||}||d|S)z Transform the overall request to be sent to the API. Returns: dict: The transformed request. Sent as the body of the API call. )rSr3)r3rS)rV)r"r3rSrKrWrXs r+transform_requestz!OpenAIGPTConfig.transform_requests3++XU+K    r- raw_responsemodel_response logging_obj request_dataencodingapi_key json_modec t)zt Transform the response from the API. Returns: dict: The transformed response. NotImplementedError) r"r3r[r\r]r^rSrKrWr_r`ras r+transform_responsez"OpenAIGPTConfig.transform_responses ("!r- error_message status_codecNt||ttj|S)N)rgmessagerX)rrhttpxHeaders)r"rfrgrXs r+get_error_classzOpenAIGPTConfig.get_error_classs%#!0  r-api_basectr/rc)r"rXr3rSrKr`rms r+validate_environmentz$OpenAIGPTConfig.validate_environments "!r-c|d}| td}tjj|ddd|i}|jdk7rt d|j |jd }|Dcgc]}|d  c}Scc}w) zV Calls OpenAI's `/v1/models` endpoint and returns the list of models. zhttps://api.openai.comOPENAI_API_KEYz /v1/models AuthorizationzBearer )urlrXzFailed to get models: dataid)r rDmodule_level_clientgetrg Exceptiontextjson)r"r`rmresponsemodelsr3s r+ get_modelszOpenAIGPTConfig.get_modelss  /H ?$%56G..22*J'$y&9:3    3 &4X]]ODE E()/0d 000s9 Bexisting_model_infoc 0||St|dddddddS)Nopenaichatg)r)litellm_providermodeinput_cost_per_tokenoutput_cost_per_tokenrmax_input_tokensmax_output_tokens)r)r"r3rs r+get_model_infozOpenAIGPTConfig.get_model_infos5  *& &%!$"%!"  r-) NNNNNNNNNNN)NNr/)/__name__ __module__ __qualname____doc__rrint__annotations__rrstrdictrlistrrrrrrrrr, classmethodr1rIboolrPrRrr rVrZrjResponserLiteLLMLoggingObjrrerkr rlror~rr __classcell__)r's@r+rrs4(,x}+04M8E#t),-4 $Ix~$!%J% $J $Ax}&*hsm*'+D(5d# $+!%K#%E8C=&*OXd^*,048$(%)$(*.+/%)#*.4#C=4 c4i 014D> 4 TN 4 SM 4 C=4#3-4uS$Y'(4c]4}4"$4 4&$$'3'3'3R      0             -.7:     '(         @"&$(""nn"& " ' "  "'(""""#"D>" ",   /2 =B4CV=W  "&"& " " "'( "  " # "3- "  "HL1}17?}1 c10JN  /7 /F  r-r)rtypingrrrrrrrjrD litellm.llms.base_llm.base_utilsr )litellm.llms.base_llm.chat.transformationr r litellm.secret_managers.mainr litellm.types.llms.openair litellm.types.utilsrr common_utilsr*litellm.litellm_core_utils.litellm_loggingr_LiteLLMLoggingObjrrrUr-r+rsNCB =R76<&X*w & w r-