gdZddlmZmZmZddlmZddlmZm Z ddl m Z m Z m Z mZddlmZdd lmZGd d eeZy ) z Support for gpt model family )ListOptionalUnion)BaseTextCompletionConfig)AllMessageValuesOpenAITextCompletionUserMessage)ChoicesMessage ModelResponseTextCompletionResponse)OpenAIGPTConfig_transform_promptc eZdZUdZdZeeed<dZee ed<dZ eeed<dZ ee ed<dZ eeed<dZeeed<dZeeed <dZeeed <dZeeeefed <dZeeed < ddeedee deedee deedeed eed eed eeeefd eed eedeeddfdZefdZ ddeedeefdZdedefdZdedeeeee fde de de f dZ!xZ"S)OpenAITextCompletionConfiga Reference: https://platform.openai.com/docs/api-reference/completions/create The class `OpenAITextCompletionConfig` provides configuration for the OpenAI's text completion API interface. Below are the parameters: - `best_of` (integer or null): This optional parameter generates server-side completions and returns the one with the highest log probability per token. - `echo` (boolean or null): This optional parameter will echo back the prompt in addition to the completion. - `frequency_penalty` (number or null): Defaults to 0. It is a numbers from -2.0 to 2.0, where positive values decrease the model's likelihood to repeat the same line. - `logit_bias` (map): This optional parameter modifies the likelihood of specified tokens appearing in the completion. - `logprobs` (integer or null): This optional parameter includes the log probabilities on the most likely tokens as well as the chosen tokens. - `max_tokens` (integer or null): This optional parameter sets the maximum number of tokens to generate in the completion. - `n` (integer or null): This optional parameter sets how many completions to generate for each prompt. - `presence_penalty` (number or null): Defaults to 0 and can be between -2.0 and 2.0. Positive values increase the model's likelihood to talk about new topics. - `stop` (string / array / null): Specifies up to 4 sequences where the API will stop generating further tokens. - `suffix` (string or null): Defines the suffix that comes after a completion of inserted text. - `temperature` (number or null): This optional parameter defines the sampling temperature to use. - `top_p` (number or null): An alternative to sampling with temperature, used for nucleus sampling. Nbest_ofechofrequency_penalty logit_biaslogprobs max_tokensnpresence_penaltystopsuffix temperaturetop_preturnc tj} | jD]%\}}|dk7s |t|j||'y)Nself)localscopyitemssetattr __class__)r"rrrrrrrrrrrrlocals_keyvalues b/var/www/openai/venv/lib/python3.12/site-packages/litellm/llms/openai/completion/transformation.py__init__z#OpenAITextCompletionConfig.__init__9sA(--/!--/JCf}!2U3*c t|S)N)super get_config)clsr's r+r0z%OpenAITextCompletionConfig.get_configMsw!##r-response_objectmodel_response_objectcl || tdg}t|dD]7\}}t|dd}t|d||}|j |9||_d|vrt |d|dd |vr |d |_d |vr |d |_||jd <|S#t$r}|d}~wwxYw) NzError in response object formatchoicestext assistant)contentrole finish_reason)r:indexmessageusageidmodeloriginal_response) ValueError enumerater r appendr5r&r>r?_hidden_params Exception)r"r2r3 choice_listidxchoicer<es r+%convert_to_chat_model_response_objectz@OpenAITextCompletionConfig.convert_to_chat_model_response_objectQs  &*?*G !BCCK()CD V!"6N$!"("9g""6* E-8 ! )/)-w8PQ&+:4+@%(/).=g.F%+  " 0 01D E) ( G sB B## B3,B..B3r?c gdS)N) functions function_callrrrstreamstream_optionsrrrrruserresponse_formatseedtools tool_choice max_retriesr top_logprobs extra_headers)r"r?s r+get_supported_openai_paramsz6OpenAITextCompletionConfig.get_supported_openai_paramsvs   r-messagesoptional_paramsheadersc&t|}||d|S)N)r?promptr)r"r?rZr[r\r^s r+!transform_text_completion_requestzrss5)(TWWW5$L !9?L r-