qiavdZddlZddlmZddlmZmZddlmZm Z m Z m Z m Z ddl mZddlmZGdd eZy) zVoice Activity Detection controller for managing speech state transitions. This module provides a controller that wraps a VADAnalyzer to track speech state and emit events when speech starts, stops, or is actively detected. N)Type) VADAnalyzerVADState)FrameInputAudioRawFrameSpeechControlParamsFrame StartFrameVADParamsUpdateFrame)FrameDirection) BaseObjectceZdZdZdddedeffdZdefdZde fd Z de fd Z d e d ed efdZdZej$fdedefdZdeefdZxZS) VADControllera(Manages voice activity detection state and emits speech events. Wraps a `VADAnalyzer` to process audio and trigger events based on speech state transitions. Tracks whether the user is speaking, quiet, or transitioning between states. Event handlers available: - on_speech_started: Called when speech begins. - on_speech_stopped: Called when speech ends. - on_speech_activity: Called periodically while speech is detected. - on_push_frame: Called when the controller wants to push a frame. - on_broadcast_frame: Called when the controller wants to broadcast a frame. Example:: @vad_controller.event_handler("on_speech_started") async def on_speech_started(controller): ... @vad_controller.event_handler("on_speech_stopped") async def on_speech_stopped(controller): ... @vad_controller.event_handler("on_speech_activity") async def on_speech_activity(controller): ... @vad_controller.event_handler("on_push_frame") async def on_push_frame(controller, frame: Frame, direction: FrameDirection): ... @vad_controller.event_handler("on_broadcast_frame") async def on_broadcast_frame(controller, frame_cls: Type[Frame], **kwargs): ... g?)speech_activity_period vad_analyzerrc4t|||_tj|_d|_||_|jdd|jdd|jdd|jdd|jddy ) aInitialize the VAD controller. Args: vad_analyzer: The `VADAnalyzer` instance for processing audio. speech_activity_period: Minimum interval in seconds between `on_speech_activity` events. Defaults to 0.2. ron_speech_startedT)syncon_speech_stoppedon_speech_activity on_push_frameon_broadcast_frameN) super__init__ _vad_analyzerrQUIET _vad_state_speech_activity_time_speech_activity_period_register_event_handler)selfrr __class__s R/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/audio/vad/vad_controller.pyrzVADController.__init__Bs )$,NN&'"(>$ $$%8t$D $$%8t$D $$%9$E $$_4$@ $$%9$Eframec~Kt|tr|j|d{yt|tr|j |d{yt|t rO|j j|j|jt|jd{yy77g7 w)zProcess a frame and handle VAD-related events. Handles `StartFrame` to initialize the sample rate and `InputAudioRawFrame` to analyze audio for voice activity. Args: frame: The frame to process. N vad_params) isinstancer _startr _handle_audior r set_paramsparamsbroadcast_framerr r$s r" process_framezVADController.process_frameZs eZ (++e$ $ $ 1 2$$U+ + + 3 4    ) )%,, 7&&'?ELL&Y Y Y5 % + Zs4%B=B7)B=B9AB=0B;1B=9B=;B=cK|jj|j|jt|jj d{y7w)Nr&)rset_sample_rateaudio_in_sample_rater-rr,r.s r"r)zVADController._startksF **5+E+EF""#;HZHZHaHa"bbbsAAAAcK|j|j|jd{|_|jtjk(r|j dd{yy7A7w)a Process an audio chunk and emit speech events as needed. Analyzes the audio for voice activity and triggers `on_speech_started`, `on_speech_stopped`, or `on_speech_activity` events based on state changes. Args: frame: Audio frame to process. Nr) _handle_vadaudiorrSPEAKING_call_event_handlerr.s r"r*zVADController._handle_audiops`!% 0 0doo NN ??h// /**+?@ @ @ 0O As!*A2A.:A2'A0(A20A2r5 vad_statereturnclK|jj|d{}||k7r|tjk7rn|tjk7r[|tj k(r|j dd{n,|tjk(r|j dd{|}|S7777 w)zGHandle Voice Activity Detection results and trigger appropriate events.Nrr)r analyze_audiorSTARTINGSTOPPINGr6r7r)r r5r8 new_vad_states r"r4zVADController._handle_vad~s"00>>uEE Y &!2!22!2!22 1 11../BCCC(..0../BCCC%IFDCs4B4B.AB48B09,B4%B2& B40B42B4cKtj|jz }||jk\r3tj|_|jdd{yy7w)zHandle user speaking frame.rN)timerrr7)r diff_times r"_maybe_speech_activityz$VADController._maybe_speech_activitysUIIK$"<"<< 44 4)-D &**+?@ @ @ 5 @sAA) A'!A) directioncFK|jd||d{y7w)a-Request a frame to be pushed through the pipeline. This emits an on_push_frame event that must be handled by a processor to actually push the frame into the pipeline. Args: frame: The frame to push. direction: The direction to push the frame. rNr7)r r$rCs r" push_framezVADController.push_frames &&yIIIs !! frame_clscHK|jd|fi|d{y7w)a[Request a frame to be broadcast upstream and downstream. This emits an on_broadcast_frame event that must be handled by a processor to actually broadcast the frame in the pipeline. Args: frame_cls: The class of the frame to broadcast. **kwargs: Arguments to pass to the frame constructor. rNrE)r rGkwargss r"r-zVADController.broadcast_frames&'d&&';YQ&QQQs " ")__name__ __module__ __qualname____doc__rfloatrrr/r r)rr*bytesrr4rBr DOWNSTREAMrFrr- __classcell__)r!s@r"rrs#JVYF[FUF0ZZ"c*c A); Auh AJXIbIb Je J J RtE{ Rr#r)rMr@typingrpipecat.audio.vad.vad_analyzerrrpipecat.frames.framesrrrr r "pipecat.processors.frame_processorr pipecat.utils.base_objectr rr#r"rXs7  @>0ORJORr#