/j%b<%SSKJr SSKrSSKrSSKrSSKrSSKJr SSKJrJ r J r SSK J r J r SSKrSSKrSSKrSSKJr SSKJrJrJr SSKJrJrJr SS KJ r SS K!J"r" SS K#J$r$ SS K%J&r& SS K'J(r( SSK)Jr* SSK+J,r,J-r-J.r.J/r/ SSK0J1r1 SSK2J3r4J5r6J7r8J9r:J;rJ?r@ SSKAJBrBJCrC SSKDJErEJFrF SSKGJHrH SSKIJJrJ SSKKJLrLJMrM SSKNJOrO SSKPJQrQJRrR SSKSJTrT SSKUJVrVJrW SSKXJYrYJZrZ SSK[J\r\ \ (aSSK]J^r^J_r_ SS K`Jara SS!KbJcrc "S"S#\M5rd\d"S$5reS#\fS%'"S&S'\H5rg"S(S)\.5rh"S*S+\R5rj"S,S-\-5rkSS..S8S/jjrlS0S0S1.S9S2jjrmS:S3jrnS;S4jroS) annotationsN)Iterator)datetime timedeltatimezone) TYPE_CHECKINGAny) MessageToDict)contextmetricstrace) LogRecordget_logger_providerset_logger_provider)SeverityNumber) Compression)OTLPLogExporter)OTLPMetricExporter)OTLPSpanExporter)r )LoggerProviderLoggingHandlerLogRecordProcessorReadWriteLogRecord)BatchLogRecordProcessor)Counter Histogram MeterProviderObservableCounterObservableGaugeObservableUpDownCounter UpDownCounter)AggregationTemporalityPeriodicExportingMetricReader) SERVICE_NAMEResource) SpanProcessor)BatchSpanProcessor)SpanTracer)_agnosticcontextmanager) AttributesAttributeValue)api)agent_pbr ) TRACE_LEVELlogger) trace_types) ChatContextChatItem)Tagger) SessionReportcF\rSrSrSSjrS SjrS Sjr\S Sj5rSr g) _DynamicTracer;czXl[R"5Ul[R"U5UlgN)_instrumenting_module_name trace_apiget_tracer_provider_tracer_provider get_tracer_tracer)selfinstrumenting_module_names P/app/agent/.venv/lib/python3.13/site-packages/livekit/agents/telemetry/traces.py__init___DynamicTracer.__init__<s,*C':C:W:W:Y ++,EF clXl[R"URURS9Ulg)N)tracer_provider)r@r>rAr=rB)rCrJs rE set_provider_DynamicTracer.set_providerAs, / ++  + + 11  rHc:URR"U0UD6$r<)rB start_span)rCargskwargss rErN_DynamicTracer.start_spanHs||&&777rHc/# URR"U0UD6nUv SSS5 g!,(df  g=f7fr<)rBstart_as_current_span)rCrOrPspans rErS$_DynamicTracer.start_as_current_spanKs/ \\ / / @ @DJA @ @s>- > ;>)r=rBr@N)rDstrreturnNone)rJtrace_api.TracerProviderrWrX)rOr rPr rWr()rOr rPr rWzIterator[Span]) __name__ __module__ __qualname____firstlineno__rFrKrNr*rS__static_attributes__rHrEr9r9;s&G  8rHr9livekit-agentstracerc,\rSrSrSSjrSSSjjrSrg) _MetadataSpanProcessorTcXlgr< _metadatarCmetadatas rErF_MetadataSpanProcessor.__init__U!rHNc:URUR5 gr<)set_attributesrg)rCrTparent_contexts rEon_start_MetadataSpanProcessor.on_startXs DNN+rHrfrizdict[str, AttributeValue]rWrXr<)rTr(rnzotel_context.Context | NonerWrX)rZr[r\r]rFror^r_rHrErcrcTs",,rHrcc@\rSrSrSSjrS SjrS SjrS S SjjrSrg) _MetadataLogProcessor\cXlgr<rfrhs rErF_MetadataLogProcessor.__init__]rkrHcjURR(a0URRRUR5 OURURlUR(a<URRRSURR 05 gg)Nz logger.name) log_record attributesupdaterginstrumentation_scopename)rClog_datas rEon_emit_MetadataLogProcessor.on_emit`s}    ) )    * * 1 1$.. A-1^^H   *  ) )    * * 1 1 > > C CD  *rHcgr<r_rCs rEshutdown_MetadataLogProcessor.shutdownks rHcg)NTr_)rCtimeout_milliss rE force_flush!_MetadataLogProcessor.force_flushnsrHrfNrq)r}rrWrXrWrX)0u)rintrWbool) rZr[r\r]rFr~rrr^r_rHrErsrs\s"  rHrsc:^\rSrSrSrSU4SjjrSSjrSrU=r$)_BufferingHandlerrz[TU]5 /Ulgr<)superrFbuffer)rC __class__s rErF_BufferingHandler.__init__us /1 rHc:URRU5 gr<)rappend)rCrecords rEemit_BufferingHandler.emitys 6"rH)rr)rlogging.LogRecordrWrX) rZr[r\r]__doc__rFrr^ __classcell__rs@rErrrsF2##rHrc0^\rSrSrSrSU4SjjrSrU=r$)_TraceLevelLoggingHandler}zCustom LoggingHandler that properly maps TRACE_LEVEL to OTel TRACE severity. The default OTel LoggingHandler maps any log level < 10 to UNSPECIFIED, but we want TRACE_LEVEL (5) to map to TRACE for proper severity in exports. cx>[TU]U5nUR[:Xa[R UlU$r<)r _translatelevelnor0rTRACEseverity_number)rCrrxrs rEr$_TraceLevelLoggingHandler._translates4W'/  >>[ ()7)=)=J &rHr_)rrrW OTelLogRecord)rZr[r\r]rrr^rrs@rErr}s rHr)ricU(a9[U[R5(aUR[ U55 [ R U5 g)zSet the tracer provider for the livekit-agents. Args: tracer_provider (TracerProvider): The tracer provider to set. metadata (dict[str, AttributeValue] | None, optional): Metadata to set on all spans. Defaults to None. N) isinstance trace_sdkTracerProvideradd_span_processorrcrarK)rJris rEset_tracer_providerrs;J 0H0HII**+A(+KL (rHT) enable_traces enable_logscP^^[SS9m[SS9m"SS[R5n"UU4SjS5nU"5nU"U5n[Rn XS .n [ R "[S S US U05n U(Ga[[R[R[R45(a [R"U S 9n [!U 5 OJ[Rn [U [R5(aU R"R%U 5 ['US3U US9n [U [R5(a4U R)[+U 55 U R)[-U 55 [/5n[U[05(d[15n[3U5 U(a[5US3U US9nUR7[9U 55 UR7[;U55 [=[>R@US9n[>RB"5nUREU5 [FRH"5n[U[J5(d[MUS3U U[N[PRR[T[PRR[V[PRR[X[PRR[Z[PRR[\[PRR0S9n[_USS9n[KU U/S9n[FR`"U5 gg)Nhours)minutesc<^\rSrSrSU4SjjrSU4SjjrSrU=r$)3_setup_cloud_tracer.._AuthRefreshingSessionc.>[TU]5 Xlgr<)rrF_header_provider)rCheader_providerrs rErF<_setup_cloud_tracer.._AuthRefreshingSession.__init__s G  $3 !rHcv>URRUR55 [TU]"U0UD6$r<)headersrzrrrequest)rCrOrPrs rEr;_setup_cloud_tracer.._AuthRefreshingSession.requests2 LL   5 5 7 87?D3F3 3rH)r)r_AuthHeaderProviderrWrX)rOr rPr rWzrequests.Response)rZr[r\r]rFrr^rrs@rE_AuthRefreshingSessionrs 4 4 4rHrc@>\rSrSrSSjrSU4SjjrSU4SjjrSrg) 0_setup_cloud_tracer.._AuthHeaderProviderc[R"5UlSUl[R R [RS9Ul UR5 g)N)tzinfo) threadingLock_lock _auth_headerrminreplacerutc _expires_at_refreshrs rErF9_setup_cloud_tracer.._AuthHeaderProvider.__init__s?")DJ "D '||338<<3HD  MMOrHc>[R"5R[R"SS95R T5nSUR 53Ul[R"[R5T-Ul g)NTwriteBearer ) r- AccessTokenwith_observability_grantsObservabilityGrantswith_ttlto_jwtrrnowrrr)rC access_token token_ttls rEr9_setup_cloud_tracer.._AuthHeaderProvider._refreshsg!**3+B+B+NO)$  #*,*=*=*?)@ AD '||HLL9IED rHc>[R"[R5nXRT- :a7UR  XRT- :aUR 5 SSS5 SUR0$!,(df  N=f)N Authorization)rrrrrrrr)rCrrefresh_margins rE__call__9_setup_cloud_tracer.._AuthHeaderProvider.__call__sg,,x||,C&&77ZZ..??  $T%6%67 7 Zs #A== B )rrrNr)rWzdict[str, str])rZr[r\r]rFrrr^)rrsrErrs   F 8 8rHr)room_idjob_idr`rr)resourcez/observability/traces/otlp/v0)endpoint compressionsessionz/observability/logs/otlp/v0)levellogger_providerz/observability/metrics/otlp/v0)rrrpreferred_temporalityr)export_interval_millis)rmetric_readers)1rrequestsSessionrGzipr%creater$rrar@r>ProxyTracerProviderNoOpTracerProviderrrrrmergerrrcr'rrrradd_log_record_processorrsrrloggingNOTSET getLogger addHandler metrics_apiget_meter_providerSdkMeterProviderr SdkCounterr"DELTASdkUpDownCounter SdkHistogramSdkObservableCounterSdkObservableUpDownCounterSdkObservableGauger#set_meter_provider)rrobservability_urlrrrrrrotlp_compressionrirrJ span_exporterr log_exporterhandlerrootcurrent_meter_providermetric_exporterreadermeter_providerrrs @@rE_setup_cloud_tracerrs"Iq)N4!1!14880*+O$_5G"''6=*PH * w f H   # #  * *I,H,H I  (66IO  0%55O/9+C+CDD((..x8()**GH( oy'?'? @ @  . ./Eh/O P  . ./A-/P Q*+O o~ 6 6(*O,&)**EF( 001Fx1PQ001H1VW+'..Rab  "  );;= ,.> ? ?,)**HI(288 "8">">4::$&<&B&B*,B,H,H"$:$@$@ #  /W\])8VHU&&~6! @rHc [R[R[R[RS.n/nURGH%nUR S:XaLUR UR5=n(a*URUSUR=(d S045 M`UR S:Xa`UR[RS[R"URURS.URSS .5/S .45 MUR S :XdMUR[RUR URURS .45 GM( U$) N)system developeruser assistantmessagecontentr function_callr)r| argumentsfunction)ridtype)role tool_callsfunction_call_output)rr|r)r3EVENT_GEN_AI_SYSTEM_MESSAGEEVENT_GEN_AI_USER_MESSAGEEVENT_GEN_AI_ASSISTANT_MESSAGEitemsrgetrr text_contentjsondumpsr|rcall_idEVENT_GEN_AI_TOOL_MESSAGEoutput)chat_ctx role_to_eventeventsitem event_names rE_chat_ctx_to_otel_eventsr0s199 !<<55 ?? M,.F 99 !]5F5Ftyy5Q'Qz'Q MM: 43D3D3J'KL M YY/ ) MM>> + JJ9=QUQ_Q_0`*.,,,6!"'  "YY0 0 MM99 $ TYYdllS /: MrHcB [RRR5nURS:XGaUR nUR Ul[RR[RR[RR[RRS.nX0RUl URH:n[U[5(dMURR5nXElM< UR"UlUR$bUR$UlUR&R)5Hupg[U5UR&U'M UR*nSU;a4UR*R,R/[1USS-55 SU;a4UR*R2R/[1USS-55 SU;aUSUR*lSU;aUSUR*lSU;aUSUR*lS U;aUS UR*lS U;aUS UR*lS U;aUS UR*lUR@R/[1UR@S-55 GOURS :XaURBn UR U lURDU l"URFU l#URHU l$U R@R/[1UR@S-55 GO0URS :XaURJn UR U lURHU l$URDU l"URLU l&URNU l'U R@R/[1UR@S-55 OURS:Xa}URPn UR U lURRbURRU l)URTU l*U R@R/[1UR@S-55 [WUSS9$)Nr)rrrrstarted_speaking_atstopped_speaking_attranscription_delayend_of_turn_delayon_user_turn_completed_delay llm_node_ttft tts_node_ttfb e2e_latencyrr agent_handoffT)preserving_proto_field_name),r. agent_sessionr4r5rrr DEVELOPERSYSTEMUSER ASSISTANTrrrrVaddtext interruptedtranscript_confidenceextrar#r r2FromMillisecondsrr4r5r6r7r8r9r: created_atrr(rr|rr*is_errorr; old_agent_id new_agent_idr ) r.item_pbmsgrole_mapr content_pbkeyvaluer fcfcoahs rE_to_proto_chat_itemrUGs$$0099;G yyIoo"//99,,33**//!//99   II&||G'3'' [[__. ")$ **  % % 1(,(B(BC %****,JC ZCIIcN-,, G + KK + + < <G12T9:  !G + KK + + < <G12T9:  !G +.56K.LCKK + ' ),34G,HCKK ) )W 47>?]7^CKK 4 g %(/(@CKK % g %(/(@CKK % G #&-m&"5RA[<RB"SS95RE[GSS95nURI5n[JRL"TRNS9nURPRS[ TR:=(d SS-55 URU5n[VRX"S 5nUR[U5nUR]S S!S"S#9 S$UR^S%'[a[cU55UR^S&'US (a[dRf"TR RiS'S(95nUR[U5nUR]S SS)S#9 S*UR^S%'[a[cU55UR^S&'U(aTR8(a[jRl"TR8S+5IShvN nURo5IShvN nSSS5IShvN W(aRUR[U5nUR]S SS-S#9 S.UR^S%'[a[cU55UR^S&'US/3n S0U3URrS1.n![tRv"S25 URyU UU!S39IShvN n"U"R{5 SSS5IShvN [tRv"S45 gs sn n fs sn n n fGNNN!,IShvN (df  GN=f![pa S,nGNf=fN}N_!,IShvN (df  Nt=f7f)7Ncx>[5RUTRTRTRS.S9$)N)rrroom)r|ry)r get_loggerrrrX)r|reports rE _get_logger+_upload_session_report.._get_loggers;"$//!>> -- 0  rH unspecifiedc*URUUUUUS9 g)N)body timestampryr severity_text)r) otel_loggerr_r`ryseverityras rE_log$_upload_session_report.._logs& !$'  rH chat_historyzsession reportrgeA)zsession.optionszsession.report_timestampz session.tags agent_name sdk_versionusage)r_r`ry transcriptrerrorz chat itemz chat.item)r_r`ryrcra evaluationsverdictfail evaluationtag)r|rioutcomereasonaudioTrrr)rr3z form-dataheaderz header.binpb)r|filenamezapplication/protobuf Content-TypezContent-LengthF)exclude_timestampzchat_history.jsonzapplication/jsonrbrHz recording.oggz audio/oggz/observability/recordings/v0r)rrwz)uploading session report to LiveKit Cloud)datarzfinished uploading)r|rVrWr )rbr r_rVr`rrydictrcrrarVrWrX)>r UNSPECIFIEDrecording_optionsanyvaluesr started_atr`varsoptionstagssortedri model_usage model_dumpr#rfrUrrIERRORrHrmr$_tagsrirroutcome_reasonaudio_recording_pathaudio_recording_started_atr-rrrrrr proto_metricsMetricsRecordingHeaderr start_timerGSerializeToStringaiohttpMultipartWriterrset_content_dispositionrrVlenr&r'to_dictaiofilesopenread Exception content_typer1debugpostraise_for_status)#rhrrZtagger http_sessionr[rd chat_loggerr}ukvr.item_logrcra eval_loggerrprqentryis_fail outcome_data has_audiorjwt header_msg header_bytesmppartchat_history_jsonf audio_bytesurlrresps# ` rE_upload_session_reportrs3 $2#=#=*       !      n-K00  # # %&& !6,,E0@0@EALM#'#7,2,<,<7={{v{{ 3(%11 %%$///'(lln&:&:&<T&>> eoo34!CU^^#LM  +~~..F*(16>>'B  %+%:%:L " &**S01!<0-4^)).:T:T%,'-   '" .  ' ' .  - - \ *9  " "3#:#:#F G )!$ %    C55J**30Q0Q0VUVZ^/^+_`//1L   -B 99\ "D  8n U#9DLL %(\):%;DLL!"& JJv':':'B'BUZ'B'[\yy*+ $$[~Pc$d'9 ^$),S1B-C)D %&V00 }}V%@%@$GG1$%FFHn HG 99[)D  ( (7_ ( ]+6DLL (-0[1A-BDLL) *  ; :\=[>>\\\ \ \\g$@c [R"5n[UR5H+n[ U[ 5(dMUR U5 M- /n[ [5=n[5(aURU5 [ [R=n[R5(aURU5 [ [R"5=n[ 5(aURU5 S SjnUVs/sH1n["R$"UU4S['U5R(3SS9PM3 n nU Hn U R+5 M [,R."5U-n U H4n U R1[3SU [,R."5- 55 M6 [5SU 55(a[6R8"SU5 ggs snf) uIShut down OTel providers with a hard wall-clock bound. ``provider.shutdown()`` internally joins its exporter worker with a 30s default timeout per provider (and ``force_flush`` ignores its timeout arg in the current SDK — see #4623). Across tracer/logger/meter that's up to ~90s, enough to stall the caller's event loop past the supervisor's 60s ping/pong deadline when the OTLP endpoint is rate-limiting or unreachable. Each provider is shut down in its *own* daemon thread, run in parallel. That matters for two reasons: 1) Main-thread wait is bounded by ``max`` of the three, not the ``sum``. 2) ``BatchProcessor.shutdown()`` sets ``_shutdown = True`` as its first action; running in parallel guarantees that flag gets set on every provider within milliseconds, even if one hangs in ``worker_thread.join``. Any later atexit re-entry (OTel registers one, and Python's ``logging.shutdown()`` may spawn a *non-daemon* thread via ``LoggingHandler.flush`` → ``force_flush`` — see opentelemetry-python PR #4636) then short-circuits instead of hanging process exit. Any unfinished work stays on existing daemon threads and is discarded at process exit. Upstream context: - https://github.com/open-telemetry/opentelemetry-python/issues/4623 (TracerProvider.shutdown() has no configurable timeout — still open) crUR5 g![a [R"S5 gf=f)Nz&failed to shut down telemetry provider)rrr1 exception)providers rE _shutdown_one*_shutdown_telemetry.._shutdown_onexs4 G     G   E F Gs  66zlivekit-telemetry-shutdown-T)targetrOr|daemonrgc3@# UHoR5v M g7fr<)is_alive).0ts rE &_shutdown_telemetry..s )A::<<sz-telemetry shutdown exceeded %.1fs; continuingN)rr rWrX)rrlisthandlersrr removeHandlerrrrrar@rrrrrrThreadrrZstarttime monotonicjoinmaxr~r1warning) timeoutr h providerslptprrpthreadsrdeadlines rE_shutdown_telemetryrNs:    D $--  a ( (   q !!I+--"~>>///"1I1IJJ 6688":JKKGA  .tAw/?/?.@A     ~~')H  s34>>#3345 ) )))FP*!s8G%)rJrYriz dict[str, AttributeValue] | NonerWrX) rrVrrVrrVrrrrrWrX)r+r4rWzlist[tuple[str, Attributes]])r.r5rWr{) rhrVrrVrZr7rr6rzaiohttp.ClientSessionrWrX)rfloatrWrX)s __future__rr&rrrcollections.abcrrrrtypingrr rrrgoogle.protobuf.json_formatr opentelemetryr otel_contextr rr r>opentelemetry._logsrrrropentelemetry._logs.severityr&opentelemetry.exporter.otlp.proto.httpr4opentelemetry.exporter.otlp.proto.http._log_exporterr6opentelemetry.exporter.otlp.proto.http.metric_exporterr5opentelemetry.exporter.otlp.proto.http.trace_exporterropentelemetry.sdkropentelemetry.sdk._logsrrrropentelemetry.sdk._logs.exportropentelemetry.sdk.metricsrrrrrrrrrrr rr!r opentelemetry.sdk.metrics.exportr"r#opentelemetry.sdk.resourcesr$r%opentelemetry.sdk.tracer&opentelemetry.sdk.trace.exportr'opentelemetry.tracer(r)opentelemetry.util._decoratorr*opentelemetry.util.typesr+r,livekitr-livekit.protocolr.rlogr0r1rr3llmr4r5 observabilityr6 voice.reportr7r9ra__annotations__rcrsHandlerrrrrr0rUr_TELEMETRY_SHUTDOWN_TIMEOUTrr_rHrErs"  $22%5]]dd7>PUR0 Cc>1=,A??%+&,V,((899,],.,##  "`d )- )<\ )  )( {7 {7 {7 {7  {7  {7 {7|*ZLD^r'r'r'  r'  r' ( r' r'j#*EAQrH