gW|ddlZddlmZmZddlZddlmZmZmZmZm Z ddl m Z ddl m Z GddeZeZy)N)AnyOptional) CustomLLM ImageObject ImageResponse completionget_llm_provider)AsyncHTTPHandler) ModelResponsec8eZdZdefdZdejfdZy) MyCustomLLMreturnc:tjddddgdSNz gpt-3.5-turbouserz Hello world)rolecontentzHi!)modelmessages mock_responselitellmrselfargskwargss e/var/www/openai/venv/lib/python3.12/site-packages/litellm/proxy/example_config_yaml/custom_handler.pyrzMyCustomLLM.completion s&!!!%-@A  cBKtjddddgdSwrrrs r acompletionzMyCustomLLM.acompletions*!!!%-@A  sN)__name__ __module__ __qualname__r rrr rrr r s  ]  G4I4I rr )timetypingrrrrrrrr &litellm.llms.custom_httpx.http_handlerr litellm.types.utilsr r my_custom_llmr$rrr*s/ WWC-  )   r