/j)NSSKJr SSKrSSKrSSKrSSKJr SSKJr SSKJ r J r J r SSK J r Jr SSKJr SS KJrJrJrJr S S KJr S S KJrJrJr S S KJrJr \"S\R>S9r \"SS55r!\"SS55r""SS\\ S5r#"SS\5r$g)) annotationsN) AsyncIterable) dataclass)AnyClassVarLiteral)APIConnectionErrorAPIError)logger)DEFAULT_API_CONNECT_OPTIONS NOT_GIVENAPIConnectOptions NotGivenOr) ChatContext)LLM ChatChunk LLMStream)Tool ToolChoice) max_retrytimeoutc*\rSrSr%S\S'S\S'Srg) _LLMStatusbool availablezasyncio.Task[None] | Nonerecovering_taskN__name__ __module__ __qualname____firstlineno____annotations____static_attributes__r T/app/agent/.venv/lib/python3.13/site-packages/livekit/agents/llm/fallback_adapter.pyrrs O..r(rc*\rSrSr%S\S'S\S'Srg)AvailabilityChangedEventrllmrrr Nr!r r(r)r+r+s HOr(r+c^\rSrSrSSSSS.SU4Sjjjr\SSj5r\SS j5rS \\ \ \ S .SS jjr SS jr SSjr Sr U=r$)FallbackAdapter"g@rg?F)attempt_timeoutmax_retry_per_llmretry_intervalretry_on_chunk_sentcN>[U5S:a [S5e[TU] 5 XlX lX0lX@lXPlURVs/sH n[SSS9PM snUl URHnURSUR5 M! gs snf)aFallbackAdapter is an LLM that can fallback to a different LLM if the current LLM fails. Args: llm (list[LLM]): List of LLM instances to fallback to. attempt_timeout (float, optional): Timeout for each LLM attempt. Defaults to 5.0. max_retry_per_llm (int, optional): Internal retries per LLM. Defaults to 0, which means no internal retries, the failed LLM will be skipped and the next LLM will be used. retry_interval (float, optional): Interval between retries. Defaults to 0.5. retry_on_chunk_sent (bool, optional): Whether to retry when a LLM failed after chunks are sent. Defaults to False. Raises: ValueError: If no LLM instances are provided. rz+at least one LLM instance must be provided.TN)rrmetrics_collected) len ValueErrorsuper__init___llm_instances_attempt_timeout_max_retry_per_llm_retry_interval_retry_on_chunk_sentr_statuson_on_metrics_collected) selfr-r1r2r3r4_ llm_instance __class__s r)r:FallbackAdapter.__init__%s0 s8a<JK K ! /"3-$7!GKFYFY FYJt r?r@) r-z list[LLM]r1floatr2intr3rdr4rreturnNone)rfstr)rVrrPzlist[Tool] | NonerQrrRNotGivenOr[bool]rSNotGivenOr[ToolChoice]rTNotGivenOr[dict[str, Any]]rfrrfrg)rarrbrrfrg)r"r#r$r%r:propertyrJrN$DEFAULT_FALLBACK_API_CONNECT_OPTIONSrrXr]rBr' __classcell__rFs@r)r/r/"s"%!" #$)(M (M (M  (M(M"(M (M(MT!!$(*N09.73<  !  (  .  , 1   (N88r(r/llm_availability_changedc^\rSrSr%SrS\S'\\\S.SU4Sjjjr\SSj5r \SSj5r S S .SS jjr SS jr SS jr SSjrSrU=r$)rWsllm_fallback_adapterz ClassVar[str]_llm_request_span_name)rRrSrTc`>[TU]XX4S9 XlXPlX`lXplSUlg)N)rVrPrQ)r9r:_fallback_adapter_parallel_tool_calls _tool_choice _extra_kwargs_current_stream) rCr-rVrPrQrRrSrTrFs r)r:FallbackLLMStream.__init__vs7 uX!$$7!')15r(c`URc UR$URR$N)r{ _chat_ctxrVrIs r)rVFallbackLLMStream.chat_ctxs*    '>> !##,,,r(c`URc UR$URR$r~)r{_toolsrPrIs r)rPFallbackLLMStream.toolss*    ';; ##)))r(F)check_recoverycD# URURURURURUR [ R"URURRURRURRS9S9IShvN nU(+nUShvN nU(aSnX0l U7v MN,N SSS5IShvN g!,IShvN (df  g=f![RaP U(a$[ R""UR$S35 e[ R""UR$S35 e[&aRnU(a#[ R""UR$S3US9 e[ R""UR$S 3US9 eSnAf[(aP U(a$[ R*"UR$S 35 e[ R*"UR$S 35 ef=f7f) a7 Try to generate with the given LLM. Args: llm: The LLM instance to generate with check_recovery: When True, indicates this is a background recovery check and the result will not be used. Recovery checks verify if a previously failed LLM has become available again. )rrr3)rVrPrRrSrTrQNFz recovery timed outz! timed out, switching to next LLMz recovery failed)exc_infoz failed, switching to next LLMz recovery unexpected errorz( unexpected error, switching to next LLM)rXrrrxryrz dataclassesreplace _conn_optionsrwr=r<r>r{asyncio TimeoutErrorr warninglabelr Exception exception)rCr-rstreamshould_set_currentchunkes r) _try_generateFallbackLLMStream._try_generates6 xxkk$($=$= --!//(00&&"44GG 22CC#'#9#9#I#I    )7%7"#) %)-2*/5,K%  6      (## #)),?@A NN99+>?   yyk!12 NN99+;<     yyk!;<   99+EF   sH B%D)C*D- C-7C;C<C?C-DCC- D&C)'D,H -D3C6 4 DDH DA,H3A GAHH c.^^TRRTRRRU5mTRbTRR 5(a+SUU4Sjjn[ R"U"U55Tlgg)Nc ># TRUSS9ShvN nM N STl[R"SURS35 TR R S[USS95 g![a gf=f7f)NTr-rzllm.FallbackAdapter, z recoveredrqr-r) rrr inforrwr`r+r)r-rD llm_statusrCs r)_recover_llm_task:FallbackLLMStream._try_recovery.._recover_llm_tasks #'#5#5#d#5#Sa#S,0J(KK"7 {* MN**//20SDI!sCBA3" "A3"AA32B3 B=B?BBr-rrfrg)rwr@r;indexrdoner create_task)rCr-rrs` @r) _try_recoveryFallbackLLMStream._try_recoverys++33  " " 1 1 7 7 <   % % -1K1K1P1P1R1R  *1)<)<=Ns=S)TJ &!2Sr(c ># [R"5n[SURR55nU(a[R "S5 [ URR5Hup4URRUnUR(dU(aSn/nURUSS9ShvN nUR(akURR(aXhRR- nURRHn URU R5 M URR!U5 MUR/U5 GM [1S URRVs/sHoDR*PM snS [R"5U- S35eGN g!["a UR(a+SUlURR%S['USS95 U(dU(adXgS.n URR((d#[R "UR*S 3U S 9 e[R,"UR*S 3U S 9 GN-f=fs snf7f)Nc3B# UHoR(+v M g7fr~)r).0rs r) )FallbackLLMStream._run..scDbj1111Dbsz$all LLMs are unavailable, retrying..Frrqr) text_senttool_calls_sentzy failed after sending chunk, skip retrying. Set `retry_on_chunk_sent` to `True` to enable retrying after chunks are sent.)extraz' failed after sending chunk, retrying..zall LLMs failed (z) after z seconds)timeallrwr@r error enumerater;rrdeltacontent tool_callsappendname _event_ch send_nowaitrr`r+r?rrrr ) rC start_time all_failedir-rrrresult tool_callrs r)_runFallbackLLMStream._runs-YY[ cDDZDZDbDbcc  LL? @ 6 6 E EFFA//77:J##z!# -/ (,(:(:sSX(:(Y;f!<<%||33 )\\-A-A A -3\\-D-D / 6 6y~~ F.E226:4   s #OGR!d6L6L6[6[ \6[s6[ \]]efjfofofqt~f~e@H I  G;(Y !++/4 ,..3364N !O.7 \#55JJ"LL#&99+.p!p&+ ""yyk)PQ"'%4!]sbB2J5GG G G BG'4JJ 0#JGGJB8JJJJc # g7fr~r )rC event_aiters r)_metrics_monitor_task'FallbackLLMStream._metrics_monitor_task#ss)r{rzrwrxry)r-r/rVrrP list[Tool]rQrrRrirSrjrTrkrfrg)rfr)rfr)r-rrrrfAsyncIterable[ChatChunk]rrl)rrrfrg)r"r#r$r%rur&rr:rmrVrPrrrrr'rorps@r)rWrWss,BMB1:.73<6 6 6  6 ( 6.6,616 66&-- ** 38BB+/B !BHU,2 hr(rW)% __future__rrrrcollections.abcrrtypingrrr _exceptionsr r logr typesr rrr chat_contextrr-rrr tool_contextrrrrnrr+r/rWr r(r)rs" )!))6YY%***'84<<($  // /    N8*+,N8bq qr(