g-dZddlmZddlmZmZddlmZm Z m Z ddl m Z m Z ddlmZddlmZddlmZmZmZdd lZd d lmZd d lmZmZd d lmZer d dlmZd dlm Z edZ! GddeZ"GddeZ#GddeZ$GddeZ%ee$e%fZ&da' ddZ(e d dZ)d!dZ*ed"d#dZ+ed$dZ,y )%zLogic related to making requests to an LLM. The aim here is to make a common interface for different LLMs, so that the rest of the code can be agnostic to the specific LLM being used. ) annotations)ABCabstractmethod) AsyncIteratorIterableIterator)asynccontextmanagercontextmanager)datetime)cache) TYPE_CHECKINGLiteralUnionN) UserError) ModelMessage ModelResponse) ModelSettings)Usage)ToolDefinition)6z openai:gpt-4ozopenai:gpt-4o-minizopenai:gpt-4-turboz openai:gpt-4zopenai:o1-previewzopenai:o1-miniz openai:o1zopenai:gpt-3.5-turbozgroq:llama-3.3-70b-versatilezgroq:llama-3.1-70b-versatilez*groq:llama3-groq-70b-8192-tool-use-previewz)groq:llama3-groq-8b-8192-tool-use-previewzgroq:llama-3.1-70b-specdeczgroq:llama-3.1-8b-instantzgroq:llama-3.2-1b-previewzgroq:llama-3.2-3b-previewz!groq:llama-3.2-11b-vision-previewz!groq:llama-3.2-90b-vision-previewzgroq:llama3-70b-8192zgroq:llama3-8b-8192zgroq:mixtral-8x7b-32768zgroq:gemma2-9b-itzgroq:gemma-7b-itzgoogle-gla:gemini-1.5-flashzgoogle-gla:gemini-1.5-prozgoogle-gla:gemini-2.0-flash-expzgoogle-vertex:gemini-1.5-flashzgoogle-vertex:gemini-1.5-proz"google-vertex:gemini-2.0-flash-expzmistral:mistral-small-latestzmistral:mistral-large-latestzmistral:codestral-latestz!mistral:mistral-moderation-latestzollama:codellamaz ollama:gemmaz ollama:gemma2z ollama:llama3zollama:llama3.1zollama:llama3.2zollama:llama3.2-visionzollama:llama3.3zollama:mistralzollama:mistral-nemozollama:mixtralz ollama:phi3z ollama:qwqz ollama:qwenz ollama:qwen2zollama:qwen2.5zollama:starcoder2z!anthropic:claude-3-5-haiku-latestz"anthropic:claude-3-5-sonnet-latestzanthropic:claude-3-opus-latesttestcDeZdZdZe ddZeddZy)ModelzAbstract class for a model.cKtw)aCreate an agent model, this is called for each step of an agent run. This is async in case slow/async config checks need to be performed that can't be done in `__init__`. Args: function_tools: The tools available to the agent. allow_text_result: Whether a plain text final response/result is permitted. result_tools: Tool definitions for the final result tool(s), if any. Returns: An agent model. NotImplementedError)selffunction_toolsallow_text_result result_toolss P/var/www/openai/venv/lib/python3.12/site-packages/pydantic_ai/models/__init__.py agent_modelzModel.agent_model\s("## ct)Nrrs r!namez Model.namers !##N)rlist[ToolDefinition]rboolr r(return AgentModelr*str)__name__ __module__ __qualname____doc__rr"r&r'r!rrYsS%$-$ $ + $  $$*$$r'rcLeZdZdZe ddZe ddZy)r+z/Model configured for each step of an Agent run.cKtw)zMake a request to the model.rrmessagesmodel_settingss r!requestzAgentModel.requestzs "##r#cNKtd|jjw)z. timeoutconnectz User-Agent)rheaders)httpx AsyncClientTimeoutget_user_agentrs r!cached_async_http_clientrDs0    gw?~/0 r'cddlm}d|S)z.Get the user agent string for the HTTP client.r __version__z pydantic-ai/)rrs r!rrUs + ''r'rT)rer)r*zIterator[None])rzModel | KnownModelNamer*r)iXrs)rintrrr*zhttpx.AsyncClientr,)-r1 __future__r _annotationsabcrrcollections.abcrrr contextlibr r r functoolsr typingr rrr exceptionsrr6rrsettingsrresultrtoolsrKnownModelNamerr+r?rZEitherStreamedResponserarcrgrrrr2r'r!rs 3#==:00 "2$&5 7p $C$<*%$%$P&$s&$R13KKL b ) )93x   ((r'