qi_3ddlmZddlZddlZddlmZddlmZmZm Z ddl m Z m Z ddl mZddl mZdd lmZdd lmZmZdd lmZdd lmZdd lmZddlmZddlm Z eGddZ!eGddZ"GddZ#y)) annotationsN) dataclass)Any AsyncIteratorOptional) FfiClient FfiHandle)audio_frame_pb2)ffi_pb2) TrackSource) RingQueuetask_done_logger) AudioFrame)logger) Participant)Track)FrameProcessorceZdZUdZded<y)AudioFrameEventzyAn event representing a received audio frame. Attributes: frame (AudioFrame): The received audio frame. rframeN)__name__ __module__ __qualname____doc____annotations__J/opt/pipecat/venv/lib/python3.12/site-packages/livekit/rtc/audio_stream.pyrr"s rrc"eZdZUded<ded<y)NoiseCancellationOptionsstr module_idzdict[str, Any]optionsN)rrrrrrrr!r!-s N rr!ceZdZdZ d ddZeddddddd ddZeddddddd dd Zdd Zdd Z dd Z d Z ddZ ddZ ddZddZy) AudioStreamaOAn asynchronous audio stream for receiving audio frames from a participant or track. The `AudioStream` class provides an asynchronous iterator over audio frames received from a specific track or participant. It allows you to receive audio frames in real-time with customizable sample rates and channel configurations. Nr逻rc .||_||_||_||_|xst j |_tjjj|j d|_ t||_ d|_d|_d|_t#|t$r#|j&|_|j(|_nt#|t*r||_|j j-|j/|_|j0j3t4d} d|vr|j7|d|d} n|j9} t;| j<j>|_ | jB|_"y)aRInitialize an `AudioStream` instance. Args: track (Optional[Track]): The audio track from which to receive audio. If not provided, you must specify `participant` and `track_source` in `kwargs`. loop (Optional[asyncio.AbstractEventLoop], optional): The event loop to use. Defaults to the current event loop. capacity (int, optional): The capacity of the internal frame queue. Defaults to 0 (unbounded). sample_rate (int, optional): The sample rate for the audio stream in Hz. Defaults to 48000. num_channels (int, optional): The number of audio channels. Defaults to 1. noise_cancellation (Optional[NoiseCancellationOptions | FrameProcessor[AudioFrame]], optional): If noise cancellation is used, pass a `NoiseCancellationOptions` or `FrameProcessor[AudioFrame]` instance created by the noise cancellation module. Example: ```python audio_stream = AudioStream( track=audio_track, sample_rate=44100, num_channels=2, ) audio_stream = AudioStream.from_track( track=audio_track, sample_rate=44100, num_channels=2, ) ``` c*|jddk(S)Nmessageaudio_stream_event) WhichOneof)es rz&AudioStream.__init__..ms Y 7;O Or) filter_fnN participant track_source)r0r1)#_track _sample_rate _num_channels_frame_size_msasyncioget_event_loop_loopr instancequeue subscribe _ffi_queuer_queue_audio_filter_module_audio_filter_options _processor isinstancer!r#r$r create_task_run_taskadd_done_callbackr%_create_owned_stream_from_participant_create_owned_streamr handleid _ffi_handleinfo_info) selftrackloopcapacity sample_rate num_channels frame_size_msnoise_cancellationkwargsstreams r__init__zAudioStream.__init__;s[R%* ')+5W335 $,,22<< JJO= :C89L 04!<@"=A (*B C(:(D(DD %);)C)CD & *N ;0DOZZ++DIIK8  $$%56 F "??"=1~@V@F..0F$V]]%5%56[[ r)rOrPrQrRrSrTc *t||||d|||| S)a2Create an `AudioStream` from a participant's audio track. Args: participant (Participant): The participant from whom to receive audio. track_source (TrackSource.ValueType): The source of the audio track (e.g., microphone, screen share). loop (Optional[asyncio.AbstractEventLoop], optional): The event loop to use. Defaults to the current event loop. capacity (int, optional): The capacity of the internal frame queue. Defaults to 0 (unbounded). sample_rate (int, optional): The sample rate for the audio stream in Hz. Defaults to 48000. num_channels (int, optional): The number of audio channels. Defaults to 1. noise_cancellation (Optional[NoiseCancellationOptions], optional): If noise cancellation is used, pass a `NoiseCancellationOptions` instance created by the noise cancellation module. Returns: AudioStream: An instance of `AudioStream` that can be used to receive audio frames. Example: ```python audio_stream = AudioStream.from_participant( participant=participant, track_source=TrackSource.MICROPHONE, sample_rate=24000, num_channels=1, ) ``` N) r0r1rOrPrNrQrRrTrSr&) clsr0r1rOrPrQrRrSrTs rfrom_participantzAudioStream.from_participants-N#%#%1'  rc &t|||||||S)apCreate an `AudioStream` from an existing audio track. Args: track (Track): The audio track from which to receive audio. loop (Optional[asyncio.AbstractEventLoop], optional): The event loop to use. Defaults to the current event loop. capacity (int, optional): The capacity of the internal frame queue. Defaults to 0 (unbounded). sample_rate (int, optional): The sample rate for the audio stream in Hz. Defaults to 48000. num_channels (int, optional): The number of audio channels. Defaults to 1. noise_cancellation (Optional[NoiseCancellationOptions], optional): If noise cancellation is used, pass a `NoiseCancellationOptions` instance created by the noise cancellation module. Returns: AudioStream: An instance of `AudioStream` that can be used to receive audio frames. Example: ```python audio_stream = AudioStream.from_track( track=audio_track, sample_rate=44100, num_channels=2, ) ``` )rNrOrPrQrRrTrSrY)rZrNrOrPrQrRrSrTs r from_trackzAudioStream.from_tracks'H#%1'  rcjtjjj|jyN)r r9r: unsubscriber<rMs r__del__zAudioStream.__del__s   ,,T__=rch|jJtj}|j}|jjj |_|j|_|j|_ |jr|j|_ tjj|_|j"|j"|_|j&$t)j*|j&|_t.j0j3|}|jj4Sr_)r2 proto_ffi FfiRequestnew_audio_streamrJrH track_handler3rQr4rRr5rSproto_audio_frameAudioStreamTypeAUDIO_STREAM_NATIVEtyper>audio_filter_module_idr?jsondumpsaudio_filter_optionsr r9requestrV)rMreqrfresps rrGz AudioStream._create_owned_streams{{&&&""$//(, (?(?(F(F%'+'8'8$(,(:(:%   -1-@-@  * 1 A A U U  $ $ 06:6O6O  3  % % 148JJt?Y?Y4Z  1!!))#.$$+++rcFtj}|j}|jj|_|j |_|j|_ tjj|_ ||_|jr|j|_|j"|j"|_|j&$t)j*|j&|_t.j0j3|}|jj4Sr_)rdreaudio_stream_from_participantrJrHparticipant_handler3rQr4rRrhrirjrkr1r5rSr>rlr?rmrnror r9rprV)rMr0r1rqrtrrs rrFz1AudioStream._create_owned_stream_from_participants""$(+(I(I%;F;R;R;Y;Y%8484E4E%1595G5G%2->-N-N-b-b%*5A%2   :>:M:M ) 7  $ $ 0CGC\C\ ) @  % % 1AE**B ) >!!))#.11888rcK |jj|jd{}|j}|j dr|j j }tj|}|j2|jjr |jj|}t|}|j j#|n-|j dr|j j#dn t$j&j(j+|jy7#t$rtjddYwxYww)NTframe_receivedz7Frame processing failed, passing through original frame)exc_infoeos)r<wait_for _is_eventr+HasFieldrwrr_from_owned_infor@enabled_process Exceptionrwarningrr=putr r9r:r`)rMevent audio_eventowned_buffer_infors rrCzAudioStream._runs//224>>BBE>C>V>VK##$45$/$>$>$D$D!"334EF??.4??3J3J $ 8 8 ? (. &%%e, %'*   ,,T__=)C%U%)s5*E*EA.E*E7B E* E'$E*&E''E*clK|jj|jd{y7w)zAsynchronously close the audio stream. This method cleans up resources associated with the audio stream and waits for any pending operations to complete. N)rJdisposerDras raclosezAudioStream.aclose*s'   "jjs *424c\|jj|jjk(Sr_)r+ stream_handlerJrH)rMr-s rr{zAudioStream._is_event3s%##11T5E5E5L5LLLrc|Sr_rras r __aiter__zAudioStream.__aiter__6s rcK|jjrt|jj d{}|t|S7wr_)rDdoneStopAsyncIterationr=get)rMitems r __anext__zAudioStream.__anext__9sB ::?? $ $[[__&& <$ $ 's>AAA)Nrr'rNN)rNrrO#Optional[asyncio.AbstractEventLoop]rPintrQrrRrrS int | NonerT?Optional[NoiseCancellationOptions | FrameProcessor[AudioFrame]]returnNone)r0rr1TrackSource.ValueTyperOrrPrrQrrRrrSrrTrrr&)rNrrOrrPrrQrrRrrSrrTrrr&)rr)rr)r0rr1rrr)r-zproto_ffi.FfiEventrbool)rzAsyncIterator[AudioFrameEvent])rr)rrrrrW classmethodr[r]rbrGrFrCrr{rrrrrr&r&3s59 $(^bJ!J!2J! J!  J!  J!"J!\J! J!X 59 $(^b0 !0 , 0 2 0  0 0 0 "0 \0  0 0 d 59 $(^b+ + 2 +  +  + + "+ \+  + + Z>,"9&96K9 9,>0Mrr&)$ __future__rr6rm dataclassesrtypingrrr _ffi_clientr r _protor rhr rd_proto.track_pb2r _utilsrr audio_framerlogrr0rrNrframe_processorrrr!r&rrrrsu# !//-8()/#$+     NNr