/j5SSKJr SSKrSSKrSSKJr SSKrSSKJ r SSK J r SSK J r SSKJr SS KJrJrJrJr SS KJr S S KJrJrJrJrJr "S S\5r"SS\5r\"SS55r"SS5r g)) annotationsN) dataclass)rtc)utils) LanguageCode)logger)DEFAULT_API_CONNECT_OPTIONS NOT_GIVENAPIConnectOptions NotGivenOr)AudioByteStream)STTRecognizeStream SpeechData SpeechEventSpeechEventTypec^\rSrSrSS\SSS.S U4Sjjjr\\S.S Sjjr\\S.S S jjrS r U=r $)MultiSpeakerAdapterTF{text}detect_primary_speakersuppress_background_speakerprimary_detection_optionsprimary_formatbackground_formatc>URR(d [S5e[TU]URS9 XlX lX0lU=(d [5Ul XPl X`l g)aMultiSpeakerAdapter is an adapter that allows to detect and suppress background speakers. It needs STT with diarization capability and works for a single audio track. Args: stt (STT): STT instance to wrap detect_primary_speaker (bool, optional): Whether to detect primary speaker. Defaults to True. suppress_background_speaker (bool, optional): Whether to suppress background speaker. Defaults to False. primary_detection_options (NotGivenOr[PrimarySpeakerDetectionOptions], optional): Primary speaker detection options. If not provided, the default options will be used. primary_format (str, optional): Format for primary speaker. Supports {text} and {speaker_id} placeholders. Defaults to "{text}". background_format (str, optional): Format for background speaker. Supports {text} and {speaker_id} placeholders. Defaults to "{text}". Raises: ValueError: If the STT does not support diarization. z9MultiSpeakerAdapter needs STT with diarization capability) capabilitiesN) r diarization ValueErrorsuper__init___stt_detect_primary_suppress_backgroundPrimarySpeakerDetectionOptions_opt_primary_format_background_format)selfsttrrrrr __class__s Y/app/agent/.venv/lib/python3.13/site-packages/livekit/agents/stt/multi_speaker_adapter.pyr$MultiSpeakerAdapter.__init__sc6++XY Y c&6&67 5$?!-Q1O1Q -"3language conn_optionscR# URRXUS9IShvN $N7f)Nr2)r% recognize)r,bufferr3r4s r/_recognize_impl#MultiSpeakerAdapter._recognize_impl;s(YY((Q](^^^^s '%'c*[XRXS9$)N)r- wrapped_sttr3r4)MultiSpeakerAdapterWrapperr%)r,r3r4s r/streamMultiSpeakerAdapter.streamDs *))h  r1)r+r&r)r*r%r') r-rrboolrr?r*NotGivenOr[PrimarySpeakerDetectionOptions]rstrrrA)r7zutils.AudioBufferr3NotGivenOr[str]r4r returnr)r3rBr4r rCr) __name__ __module__ __qualname____firstlineno__r r$r r8r=__static_attributes__ __classcell__r.s@r/rrs (,,1PY&!)%4%4!% %4 &* %4 $N %4%4%4%4V%.*E _!_" _ ( _  _%.*E  " (     r1rcF^\rSrSrSU4SjjrSSjrSrU=r$)r<Oc>[TU]XS9 X lX0l[ UR UR URURURS9Ul g)N)r-r4r) r#r$ _wrapped_stt _language_PrimarySpeakerDetectorr&r'r)r*r+ _detector)r,r-r;r3r4r.s r/r$#MultiSpeakerAdapterWrapper.__init__PsW S<'!0##6(+(@(@&)hh..!44  r1c<^# SU4SjjnSU4SjjnTRRTRTRS9n[R "U"U5SS9[R "U"U5SS9/n[R "U6IShvN [RR"U6IShvN UR5IShvN gNBNN ![RR"U6IShvN UR5IShvN f=f7f)Nc># TRShvN n[U[R5(a.UR U5 TR R U5 MV[UTR5(dMsUR5 MN [R"[5 UR5 SSS5 g!,(df  g=f7f)N) _input_ch isinstancer AudioFrame push_framerQ push_audio_FlushSentinelflush contextlibsuppress RuntimeError end_input)r=framer,s r/_forward_input7MultiSpeakerAdapterWrapper._run.._forward_inputes#~~ #eeS^^44%%e,NN--e4t':':;;LLN  #~$$\2  "322sD CBBBA'CCBC2C  C CCc j># UShvN nTRRU5nUbTRRU5 MDUR[ R :XdMdTRR[[ R [[S5SS9/S95 MN g7f)N)r3text)type alternatives) rQ on_stt_event _event_ch send_nowaitrfrFINAL_TRANSCRIPTrrr)r=ev updated_evr,s r/_forward_output8MultiSpeakerAdapterWrapper._run.._forward_outputps" b!^^88< )NN..z:WW @ @@NN..#!0!A!A*4l2>NUW*X)Y Fs-B3B1B/B1AB3*AB3/B11B3r2z'DiarizationAdapterWrapper.forward_input)namez(DiarizationAdapterWrapper.forward_output)r=rrCNone) rNr=rO _conn_optionsasyncio create_taskgatherraiocancel_and_waitaclose)r,rarnr=taskss` r/_runMultiSpeakerAdapterWrapper._runds # ""))4>>PTPbPb)c   v&-V    '.X    "..%( ( ())++U3 3 3--/ ! ! ) 3 !))++U3 3 3--/ ! !slA5D9CCC D4C5D C DCDD!D9C<:DDDD)rQrOrN)r-rr;rr3rBr4r )rCrq)rDrErFrGr$rzrHrIrJs@r/r<r<Os8    "  (  (("("r1r<c\rSrSr%SrSrS\S'SrS\S'S rS\S 'S r S\S 'S r S\S'Sr S\S'S r S\S'Sr g)r(z+Configuration for primary speaker detectiondint frame_size_msg^@floatrms_buffer_durationmin_rms_samplesg?rms_smoothing_factorg?threshold_multiplier<decay_to_equal_timethreshold_min_multiplierN)rDrErFrG__doc__r__annotations__rrrrrrrHrr1r/r(r(sg5M3(!&&#OS7"%%%]#&%%Z!##N&)e)Pr1r(c\rSrSr\"SS55rSS\SSS.SSjjrSS jrSS jr SS jr SS jr SS jr Sr g)rPc<\rSrSr%S\S'SrS\S'SrS\S'Srg ) #_PrimarySpeakerDetector.SpeakerDatarA speaker_idrlast_activity_timermsrN)rDrErFrGrrrrHrr1r/ SpeakerDatars$'E'Ur1rTFrrcX@lXPlXlX lU=(d [ 5UlUR(a.UR(d[ R"S5 SUlSUlSUl 0Ul SUl /Ul UR RS- Ul[UR R UR- 5Ulg)aPrimary speaker detector. It detects the primary speaker based on RMS, formats the primary and background speakers separately, or suppresses the background speaker. Args: detect_primary_speaker (bool, optional): Whether to detect primary speaker. Defaults to True. suppress_background_speaker (bool, optional): Whether to suppress background speaker. Defaults to False. primary_detection_options (PrimaryDetectionOptions, optional): Primary speaker detection options. primary_format (str, optional): Format for primary speaker. Supports {text} and {speaker_id} placeholders. Defaults to "{text}". background_format (str, optional): Format for background speaker. Supports {text} and {speaker_id} placeholders. Defaults to "{text}". zVSuppressing background speaker is not supported when `detect_primary_speaker` is FalseFrNi)r*r+r&r'r(r)r warning_pushed_duration_primary_speaker _speaker_data_bstream _rms_bufferr _frame_sizerr _max_rms_size)r,rrrrrs r/r$ _PrimarySpeakerDetector.__init__s* ."35$?!-Q1O1Q  $ $T-A-A NNh ).D %'*,0MO04 (*9922T9 !>!>AQAQ!QRr1cUR(d U=RUR- slgUR(dY[ UR UR -5n[UR URUS9UlX!R - UlURRUR5HNnURU5nURRU5 U=RUR- slMP [UR5UR:a URUR*SUl gg)N) sample_rate num_channelssamples_per_channel)r&rdurationrrrrrrpushdata _compute_rmsrappendlenr)r,r`sample_per_channelfrs r/rY"_PrimarySpeakerDetector.push_audios##  ! !U^^ 3 ! }}!$U%6%69I9I%I!J +!--"//$6DM 24E4EED ##EJJ/A##A&C    # #C (  ! !QZZ / !0 t 4#5#5 5#//1C1C0C0EFD  6r1c2UR(dU$URSnUR[R:XaUR U5 UR b UR cU$UR UR :HUlUR(a5URRURUR S9Ul U$UR(agURRURUR S9Ul U$)Nr)rer) rgrfrrk_update_primary_speakerrris_primary_speakerr*formatrer'r+)r,rlsds r/rh$_PrimarySpeakerDetector.on_stt_eventsI __Q  77o66 6  ( ( , == D$9$9$AI " 1F1F F  **11rww2==1YBG  ((--44"''bmm4\BG r1c&[R"UR[RS9n[ U5S:Xag[R "[R "UR[R5S-55n[U5$)N)dtyperrr) np frombufferrint16rsqrtmeanastypefloat32r)r,r` audio_datars r/r$_PrimarySpeakerDetector._compute_rmss^]]5::RXX> z?a ggbggj// ;q@ABSzr1cUR(dg[URU- UR- 5n[URU- UR- 5n[ UR5U- S- n[ UR5U- nUS:dU[ UR5:ag[ US5nXC- UR R:ag[[R"URX455$)Nrr) rrrrrmaxr)rrrmedian)r, start_timeend_timestartends r/_get_rms_for_timerange._PrimarySpeakerDetector._get_rms_for_timerange sT**Z74;K;KKL4((83t7G7GGHD$$%-1$""#c) 7es4#3#344E1  ;22 2RYYt//:;<$))B_B__JJ II * *j.K L II . .  j0 $* 0$    $. ! LL35 A LL4E Br1) r+rr&rrr)r*rrrrr'N) rr?rr?rr@rrArrA)r`rtc.AudioFramerCrq)rlrrCzSpeechEvent | None)r`rrCr)rrrrrCz float | None)rrrCrq)rDrErFrGrrr r$rYrhrrrrHrr1r/rPrPs(,,1PY&!)(S!%(S&* (S $N (S  (S(STG,.=$>Cr1rP)! __future__rrsr\ dataclassesrnumpyrlivekitrrdrr3rlogr typesr r r r utils.audiorr-rrrrrrr<r(rPrr1r/rss"!#YY)OO9 #9 x="="@ QQ Q*vCvCr1