g' ` d dl mZmZmZ d dlZd dlmZ G d de Zed Zg dZ de
fdZ y) )LiteralOptionalUnionN)BaseLLMExceptionc
T e Zd Z ddededeeeej f f fd
Z
xZ S )HuggingfaceError status_codemessageheadersc * t | ||| y )N)r r
r )super__init__)selfr r
r __class__s Z/var/www/openai/venv/lib/python3.12/site-packages/litellm/llms/huggingface/common_utils.pyr zHuggingfaceError.__init__ s ['7S )N) __name__
__module__ __qualname__intstrr r dicthttpxHeadersr
__classcell__)r s @r r r sF
9= TT T %emm 345 T Tr r )ztext-generation-inferenceconversationalztext-classificationztext-generationgenerated_textc g d}|D ]k }| j j | r| j |dd } | j | sG| ddd j |ddd dd ddd } m | S )z
Parse the output text to remove any special characters. In our current approach we just check for ChatML tokens.
Initial issue that prompted this - https://github.com/BerriAI/litellm/issues/763
)z
<|assistant|>z
<|system|>z<|user|>zz N)strip
startswithreplaceendswith)r chat_template_tokenstokens r
output_parserr( ! s V% ! , ,U 3 + 3 3E2q AN " "5 ) +DbD 1 9 9%"+r1 MdPRd SN &
r ) typingr r r r )litellm.llms.base_llm.chat.transformationr r hf_tasks hf_task_listr r( r r r. sD + + FT' T # r