/jmSSKJr SSKrSSKJrJr SSKJrJr SSK J r SSK r SSK r SSK Jr SSKJr SSKJrJrJr SS KJrJrJrJr SS KJr SS KJr SS K J!r!J"r" S SK#J$r$J%r%J&r&J'r'J(r(J)r)J*r*J+r+J,r,J-r-J.r.J/r/J0r0J1r1 S SKJ2r2 \3"\Rh"SS55r5\Sr6\Sr7\"SS55r8"SS\Rr5r9"SS\5rg)) annotationsN)asdict dataclass)AnyLiteral)urlparse)llm) LLMStream) ChatContext ToolChoiceutils)DEFAULT_API_CONNECT_OPTIONS NOT_GIVENAPIConnectOptions NotGivenOr)is_given)ReasoningEffort)#ChatCompletionToolChoiceOptionParamcompletion_create_params)CerebrasChatModels ChatModelsCometAPIChatModelsDeepSeekChatModelsNebiusChatModelsOctoChatModelsOpenRouterProviderPreferencesOpenRouterWebPluginPerplexityChatModelsSambaNovaChatModelsTelnyxChatModelsTogetherChatModels XAIChatModels_supports_reasoning_effort)AsyncAzureADTokenProviderLK_OPENAI_DEBUG)lowmediumhigh) in_memory24hc\rSrSr%S\S'S\S'S\S'S\S'S\S 'S\S 'S \S 'S \S'S \S'S\S'S\S'S\S'S\S'S\S'S\S'S\S'S\S'S\S'Srg )! _LLMOptionsBstr | ChatModelsmodelNotGivenOr[str]usersafety_identifierprompt_cache_keyNotGivenOr[float] temperaturetop_pNotGivenOr[bool]parallel_tool_callsNotGivenOr[ToolChoice] tool_choicestoreNotGivenOr[dict[str, str]]metadataNotGivenOr[int]max_completion_tokens service_tierNotGivenOr[ReasoningEffort]reasoning_effortNotGivenOr[Verbosity] verbosity NotGivenOr[PromptCacheRetention]prompt_cache_retentionNotGivenOr[dict[str, Any]] extra_body extra_headers extra_queryN)__name__ __module__ __qualname____firstlineno____annotations____static_attributes__rLK/app/agent/.venv/lib/python3.13/site-packages/livekit/plugins/openai/llm.pyr-r-Bsn  &&%%"" ))'' ((**!!11$$<<**--++rSr-c^\rSrSrS\\S\\\\\\\\\\S\\\\\\\\\SS.S?U4SjjjrS@Sjr\SASj5r\SAS j5r \ S SSSSSSSSS\\\\\\S\\\\S .SBS jj5r \ S SSS\\\\\\\\S. SCSjj5r \ SSSS\\\S\\\\S. SDSjj5r \ SSSS\\\S\\\\S. SESjj5r\ SSSS\\\S\\\\S. SFSjj5r\ SSSSSSSSS\\\S\\\\SS.SGSjj5r\ SSSS\\\S\\\\S. SHS jj5r\ S!SS"S\\\S\\\\S. SIS#jj5r\ S$SS%S\\\S\\\\S. SJS&jj5r\ S'S(S\\S\\\\S). SKS*jj5r\ S+SS,S\\\S\\\\S. SES-jj5r\ S.SS/S\\\S\\\\S. SLS0jj5r\ S1SS2S\\\S\\\\S. SMS3jj5r\ S4SS5S\\\S\\\\S. SNS6jj5r\ S4SS7S\\\S\\\\S. SOS8jj5r\ S9SS:.SPS;jj5rS\\\\\S<.SQS=jjrS>rU=r$)RLLMXzgpt-4.1NT)r0api_keybase_urlclientr2r3r4r6r7r9r;r<r>r@timeout max_retriesrArCrErGrIrJrK _provider_fmt_strict_tool_schemac>[TU]5 [U5(d[U5(a US;aSnOSn[ S#0SU_SU_SU_SU _SU _S U _S U _S U_S U_S U_SU_SU_SU _SU_SU_SU_SU_SU_6Ul[U5(aU(d [ S5eU=(d SUlUUlUSLUl U=(d [R"[U5(aUOS[U5(aUOS[U5(aUOS[R"U(aUO[R"SSSSS9S[R"SSSS 9S!9S"9Ulg)$z Create a new instance of OpenAI LLM. ``api_key`` must be set to your OpenAI API key, either using the argument or by setting the ``OPENAI_API_KEY`` environmental variable. )zgpt-5.1zgpt-5.2zgpt-5.4noneminimalr0r2r6r9r;r<r>r@rArCr3r4r7rErGrIrJrKzYOpenAI API key is required, either as argument or set OPENAI_API_KEY environment variableopenaiNr.@@connectreadwritepoolT2x)max_connectionsmax_keepalive_connectionskeepalive_expiry)r[follow_redirectslimits)rXrYr\ http_clientrL)super__init__rr$r-_opts ValueErrorr]r^ _owns_clientrb AsyncClienthttpxTimeoutLimits_client)selfr0rXrYrZr2r3r4r6r7r9r;r<r>r@r[r\rArCrErGrIrJrKr]r^ __class__s rTrs LLM.__init__YsF ()).H.O.O99#) #,     $ !4  $     #8 & . 0 .    $: "! "(# $$%  ( G  W7  +6h#6 "dN !3!3'00Gd!)(!3!3X'/ '<'< !)) ]]4c3O!%||$&.0%(  "  rScx# UR(a#URR5IShvN ggN7fN)rvr{closer|s rTaclose LLM.acloses,   ,,$$& & &  &s /:8:c.URR$r)rtr0rs rTr0 LLM.modelszzrSc`URRRRS5$)Nzutf-8)r{ _base_urlnetlocdecoders rTprovider LLM.providers#||%%,,33G<? ?o # 3#-/- %  rSzDeepSeek-R1-0528zhttps://api.sambanova.ai/v1autoc U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U SS9 $)z Create a new instance of SambaNova LLM (OpenAI-compatible). ``api_key`` must be set to your SambaNova API key, either using the argument or by setting the ``SAMBANOVA_API_KEY`` environment variable. SAMBANOVA_API_KEYz_SambaNova API key is required, either as argument or set SAMBANOVA_API_KEY environment variableFrrrs rTwith_sambanovaLLM.with_sambanova/sg.@RZZ^^,?@ ?q # 3#-/- %  rSz1accounts/fireworks/models/llama-v3p3-70b-instructz%https://api.fireworks.ai/inference/v1c U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U S9 $)z Create a new instance of Fireworks LLM. ``api_key`` must be set to your Fireworks API key, either using the argument or by setting the ``FIREWORKS_API_KEY`` environmental variable. FIREWORKS_API_KEYzaFireworks API key is required, either as argument or set FIREWORKS_API_KEY environmental variablerrrs rTwith_fireworksLLM.with_fireworks\sd.@RZZ^^,?@ ?s # 3#-/-  rSz grok-3-fastzhttps://api.x.ai/v1c U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U S9 $)z Create a new instance of XAI LLM. ``api_key`` must be set to your XAI API key, either using the argument or by setting the ``XAI_API_KEY`` environmental variable. XAI_API_KEYzUXAI API key is required, either as argument or set XAI_API_KEY environmental variablerrrs rT with_x_ai LLM.with_x_aisc,:RZZ^^M: ?g # 3#-/-  rSzhttps://openrouter.ai/api/v1)r0rXrYrZsite_urlapp_namefallback_modelsrpluginsr2r6r9r;rCr3r4r7r[cU=(d [RRS5nUc [S5e0nU(aUUS'U(aUUS'0nU(aUUS'U(aU/UQUS'U(aMUVVVs/sH8n[ U5R 5VVs0sHunnUcM UU_M snnPM: snnnUS'[ UUUUU U U U U UUUUUUS9$s snnfs snnnf) z Create a new instance of OpenRouter LLM. ``api_key`` must be set to your OpenRouter API key, either using the argument or by setting the ``OPENROUTER_API_KEY`` environment variable. OPENROUTER_API_KEYzaOpenRouter API key is required, either as argument or set OPENROUTER_API_KEY environment variablez HTTP-RefererzX-Titlermodelsr)r0rXrZrYr2r6r9r;rCr3r4r7rIrJr[)rrrruritemsrV)r0rXrYrZrrrrrr2r6r9r;rCr3r4r7r[default_headersor_bodypkvs rTwith_openrouterLLM.with_openrouters :ARZZ^^,@A ?s  +- .6ON + )1OI &#% "*GJ  !& 9 9GH  OV"OV!&)//"3E"3$!QqA"3Ew"GI # 3#-/-)  F"s;"C C+C2CCz deepseek-chatzhttps://api.deepseek.com/v1c U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U S9 $)z Create a new instance of DeepSeek LLM. ``api_key`` must be set to your DeepSeek API key, either using the argument or by setting the ``DEEPSEEK_API_KEY`` environmental variable. DEEPSEEK_API_KEYz_DeepSeek API key is required, either as argument or set DEEPSEEK_API_KEY environmental variablerrrs rT with_deepseekLLM.with_deepseeksd.?RZZ^^,>? ?q # 3#-/-  rSzgpt-5-chat-latestzhttps://api.cometapi.com/v1/c U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U S9 $)a  Create a new instance of CometAPI LLM. ``api_key`` must be set to your CometAPI API key, either using the argument or by setting the ``COMETAPI_API_KEY`` environmental variable. CometAPI provides access to 500+ AI models from multiple providers including OpenAI, Anthropic, Google, xAI, DeepSeek, and Qwen through a unified API. Get your API key at: https://api.cometapi.com/console/token Learn more: https://www.cometapi.com/?utm_source=livekit&utm_campaign=integration&utm_medium=integration&utm_content=integration COMETAPI_API_KEYz_CometAPI API key is required, either as argument or set COMETAPI_API_KEY environmental variablerrrs rT with_cometapiLLM.with_cometapi(sd:?RZZ^^,>? ?q # 3#-/-  rSzllama-2-13b-chatzhttps://text.octoai.run/v1c U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U S9 $)z Create a new instance of OctoAI LLM. ``api_key`` must be set to your OctoAI API key, either using the argument or by setting the ``OCTOAI_TOKEN`` environmental variable. OCTOAI_TOKENzYOctoAI API key is required, either as argument or set OCTOAI_TOKEN environmental variablerrrs rT with_octo LLM.with_octoZsc.;RZZ^^N; ?k # 3#-/-  rSzllama3.1zhttp://localhost:11434/v1 r0rYrZr6r9r;rCr3r4r7c ([USUUUUUUUUU S9 $)z& Create a new instance of Ollama LLM. ollama) r0rXrYrZr6r9r;rCr3r4r7)rVrs rT with_ollamaLLM.with_ollamas2$# 3#-/-  rSz gpt-oss-120bz0https://oai.endpoints.kepler.ai.cloud.ovh.net/v1c U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U S9 $)z Create a new instance of OVHcloud AI Endpoints LLM. ``api_key`` must be set to your OVHcloud AI Endpoints API key, either using the argument or by setting the ``OVHCLOUD_API_KEY`` environmental variable. OVHCLOUD_API_KEYzlOVHcloud AI Endpoints API key is required, either as argument or set OVHCLOUD_API_KEY environmental variablerrrs rT with_ovhcloudLLM.with_ovhcloudsd.?RZZ^^,>? ?~ # 3#-/-  rSzllama-3.1-sonar-small-128k-chatzhttps://api.perplexity.aic U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U S9 $)z Create a new instance of PerplexityAI LLM. ``api_key`` must be set to your TogetherAI API key, either using the argument or by setting the ``PERPLEXITY_API_KEY`` environmental variable. PERPLEXITY_API_KEYzfPerplexity AI API key is required, either as argument or set PERPLEXITY_API_KEY environmental variablerrrs rTwith_perplexityLLM.with_perplexitysd.ARZZ^^,@A ?x # 3#-/-  rSz+meta-llama/Meta-Llama-3.1-8B-Instruct-Turbozhttps://api.together.xyz/v1c U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U S9 $)z Create a new instance of TogetherAI LLM. ``api_key`` must be set to your TogetherAI API key, either using the argument or by setting the ``TOGETHER_API_KEY`` environmental variable. TOGETHER_API_KEYzbTogether AI API key is required, either as argument or set TOGETHER_API_KEY environmental variablerrrs rT with_togetherLLM.with_togethersd.?RZZ^^,>? ?t # 3#-/-  rSz&meta-llama/Meta-Llama-3.1-70B-Instructzhttps://api.telnyx.com/v2/aic U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U S9 $)z Create a new instance of Telnyx LLM. ``api_key`` must be set to your Telnyx API key, either using the argument or by setting the ``TELNYX_API_KEY`` environmental variable. TELNYX_API_KEYz^Telnyx AI API key is required, either as argument or set TELNYX_API_KEY environmental variablerrrs rT with_telnyxLLM.with_telnyx*sd.=RZZ^^,<= ?p # 3#-/-  rSz!https://api.studio.nebius.com/v1/c U=(d [RRS5nUc [S5e[ UUUUUUUUUU U U S9 $)z Create a new instance of Nebius LLM. ``api_key`` must be set to your Nebius API key, either using the argument or by setting the ``NEBIUS_API_KEY`` environmental variable. NEBIUS_API_KEYz[Nebius API key is required, either as argument or set NEBIUS_API_KEY environmental variablerrrs rT with_nebiusLLM.with_nebiusVsd.=RZZ^^,<= ?m # 3#-/-  rSz)https://api.letta.com/v1/chat/completions)rYrXc V[U5nURS;a[SURS35eUR(d[SUS35eU=(d [R R S5nUc [S5e[UUUS[[[[S 9$) a6 Create a new Letta-backed LLM instance connected to the specified Letta agent. Args: agent_id (str): The Letta agent ID (must be prefixed with 'agent-'). base_url (str): The URL of the Letta server (e.g., http://localhost:8283/v1/chat/completions for local or https://api.letta.com/v1/chat/completions for cloud). api_key (str | None, optional): Optional API key for authentication, required if the Letta server enforces auth. Returns: LLM: A configured LLM instance for interacting with the given Letta agent. >httphttpszInvalid URL scheme: 'z'. Must be 'http' or 'https'.zURL 'z4' is missing a network location (e.g., domain name). LETTA_API_KEYNzYLetta API key is required, either as argument or set LETTA_API_KEY environmental variable)r0rXrYrZr2r6r9r;) rschemerurrrrrVr)agent_idrYrXparseds rT with_lettaLLM.with_lettas((# == 1 14V]]OC`ab b}}uXJ.bcd dr2r@r6rArCr3r4r7rErGr9functionname)typerr;)rrequiredr`rr0 provider_fmtstrict_tool_schemarZchat_ctxrrr)rupdatertrIrJrKr>r2r@r6rArCr3r4r7rErGr9r; isinstancedict llm_utilsto_openai_response_formatr r0r]r^r{) r|rrrr9r;rrextraoai_tool_choices rTchatLLM.chatsl L ! ! LL & DJJ)) * *"&**"7"7E,  DJJ,, - -%)ZZ%=%=E/ " DJJ** + +#'::#9#9E- DJJ'' ( ( $ 3 3E*  DJJOO $ $ JJOOE&M DJJ44 5 5-1ZZ-M-ME) * DJJ** + +#'::#9#9E- DJJ++ , ,$(JJ$;$;E. ! DJJ// 0 0(, (C(CE$ % DJJ00 1 1)-)E)EE% & DJJ// 0 0(, (C(CE$ % DJJ$$ % %!ZZ--E'N DJJ(( ) )!%!5!5E+  DJJ55 6 6.2jj.O.OE* +$,,?#@#@ djjFdFd  ' ( (+>' (%-k%:%:k @V@V K +t,,&!'Z)@)H I#(7m$ <<"-'6m$ O $ $'0'J'J?'[E# $ **""++#77<<+2%  rS)r{rtrvr]r^)4r0r/rXr1rYr1rZopenai.AsyncClient | Noner2r1r3r1r4r1r6r5r7r5r9r8r;r:r<r8r>r=r@r?r[httpx.Timeout | Noner\r?rAr1rCrBrErDrGrFrIrHrJr=rKr=r]r1r^boolreturnNone)rr)rstr),r0r/r str | Nonerr rr rXr rr rz AsyncAzureADTokenProvider | Nonerr rr rYr r2r1r3r1r4r1r6r5r9r8r;r:r[rrCrBr7r5rErDr@r?rrV)r0zstr | CerebrasChatModelsrXr rYrrZrr2r1r6r5r9r8r;r:rCrBr3r1r4r1r7r5rrV)r0zstr | SambaNovaChatModelsrXr rYrrZrr2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)r0rrXr rYrrZrr2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)r0zstr | XAIChatModelsrXr rYrrZrr2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)&r0rrXr rYrrZrrr rr rzlist[str] | Nonerz$OpenRouterProviderPreferences | Nonerz list[OpenRouterWebPlugin] | Noner2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5r[rrrV)r0zstr | DeepSeekChatModelsrXr rYrrZrr2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)r0zstr | CometAPIChatModelsrXr rYrrZrr2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)r0zstr | OctoChatModelsrXr rYrrZrr2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)r0rrYrrZrr6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)r0zstr | PerplexityChatModelsrXr rYrrZrr2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)r0zstr | TogetherChatModelsrXr rYrrZrr2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)r0zstr | TelnyxChatModelsrXr rYrrZrr2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)r0zstr | NebiusChatModelsrXr rYrrZrr2r1r6r5r9r8r;r rCrBr3r1r4r1r7r5rrV)rrrYrrXr rrV)rr rzlist[llm.Tool] | Nonerrr9r8r;r:rzUNotGivenOr[completion_create_params.ResponseFormat | type[llm_utils.ResponseFormatT]]rrHrr )rMrNrOrPrrsrpropertyr0r staticmethodrrrrrrrrrrrrrrrrrrrR __classcell__r}s@rTrVrVXs8#,#,$-,0 )-6,5)2#,09.7"+/81:(,'0(18A+4CL1:4=2;)2$(7W  W ! W " W * W W +W *W 'W !W .W ,W  W -W /!W "&#W $%%W &&'W (6)W *)+W ,!A-W .//W 021W 203W 4'5W 6"7W 8 9W W r'  ==#+%)'+"&"%)DH#'"# )-6,5)209.7(,8A#,+41:-AA#A% A  A  A#A"BA!AAAA+A*A'A .!A",#A$&%A&6'A(!)A*)+A, /-A. /AAF+K"4,0 ))209.78A-6,5#,* '* *  * * *  * '* .* ,* 6* +* ** !*  * * X,>"5,0 ))209"(8A-6,5#,* (* *  * * *  * '* .*  * 6* +* ** !*  * * XI"?,0 ))209"(8A-6,5#,) ) )  ) * )  ) ') .)  ) 6) +) *) !)  ) ) V&3"-,0 ))209"(8A-6,5#,) ") )  ) * )  ) ') .)  ) 6) +) *) !)  ) ) V"6,0##,09=48 ))209"(8A-6,5#,(,'E E E  E * E  E E *E 7E 2E E 'E .E  E 6E +!E "*#E $!%E &&'E ( )E E N+:"5,0 ))209"(8A-6,5#,) ') )  ) * )  ) ') .)  ) 6) +) *) !)  ) ) V+>"6,0 ))209"(8A-6,5#,/ '/ /  / * /  / '/ ./  / 6/ +/ */ !/  / / b'9"4,0 ))209"(8A-6,5#,) #) )  ) * )  ) ') .)  ) 6) +) *) !)  ) ) V 3,0)209"(8A-6,5#,   *  '  .    6 + * !    >$"J,0 ))209"(8A-6,5#,) ) )  ) * )  ) ') .)  ) 6) +) *) !)  ) ) V-N"3,0 ))209"(8A-6,5#,) )) )  ) * )  ) ') .)  ) 6) +) *) !)  ) ) V+X"5,0 ))209"(8A-6,5#,) ') )  ) * )  ) ') .)  ) 6) +) *) !)  ) ) V)Q"6,0 ))209"(8A-6,5#,) %) )  ) * )  ) ') .)  ) 6) +) *) !)  ) ) V)Q";,0 ))209"(8A-6,5#,) %) )  ) * )  ) ') .)  ) 6) +) *) !)  ) ) VD" ( ( (  ( ( ( \(,*E09.7 3<[ [ % [ ( [ . [ ,[  [ 1[  [ [ rSrVcT^\rSrSrSU4SjjrSrU=r$)r i c 0>[T U]UUUUUUUUU S9 g)Nr)rrrs) r|r r0rrrZrrrrr}s rTrsLLMStream.__init__ s2  %1%%  rSrL)r rVr0r/rrrrrZzopenai.AsyncClientrzllm.ChatContextrzlist[llm.Tool]rrrzdict[str, Any]rr)rMrNrOrPrsrRr r s@rTr r so      !  # "  ( %    rSr ): __future__rr dataclassesrrtypingrr urllib.parserrxrblivekit.agentsr livekit.agents.inference.llmr _LLMStreamlivekit.agents.llmr r r rlivekit.agents.typesrrrrlivekit.agents.utilsr openai.typesropenai.types.chatrrrrrrrrrrrrr r!r"r#r$r%intgetenv lk_oai_debug VerbosityPromptCacheRetentionr-rVrLrSrTr"s# )! @  *([ -299.23 + , 12 ,, ,*p #''p f  rS