qi dZddlZddlZddlmZddlmZmZmZm Z m Z ddl m Z ddl mZddlmZddlmZdd lmZmZmZmZmZmZmZmZmZmZmZmZm Z m!Z!dd l"m#Z#m$Z$dd l%m&Z&dd l'm(Z(dd l)m*Z*m+Z+ddl,m-Z- ddl.m/Z/ddl0m1Z2ddl3m4Z4m5Z5m6Z6ddddddddddddd Z;eGd!d"eZeGd'd(e=Z?Gd)d*e+Z@Gd+d,eZAGd-d.ZBGd/d0e&ZCGd1d2e(ZDGd3d4e*ZEy#e7$r7Z8e jrde8e jrde:de8dZ8[8wwxYw)5zLiveKit transport implementation for Pipecat. This module provides comprehensive LiveKit real-time communication integration including audio streaming, data messaging, participant management, and room event handling for conversational AI applications. N) dataclass)Any AwaitableCallableListOptional)logger) BaseModel)create_stream_resampler) VADAnalyzer) AudioRawFrameBotConnectedFrame CancelFrameClientConnectedFrameEndFrame ImageRawFrameOutputAudioRawFrameOutputDTMFFrameOutputDTMFUrgentFrameOutputTransportMessageFrame!OutputTransportMessageUrgentFrame StartFrameUserAudioRawFrameUserImageRawFrame)FrameDirectionFrameProcessorSetup)BaseInputTransport)BaseOutputTransport) BaseTransportTransportParams)BaseTaskManager)rtc)video_frame_pb2)retrystop_after_attemptwait_exponentialz Exception: zGIn order to use LiveKit, you need to `pip install pipecat-ai[livekit]`.zMissing module:  ) 0123456789*#c&eZdZUdZdZeeed<y)"LiveKitOutputTransportMessageFrameFrame for transport messages in LiveKit rooms. Parameters: participant_id: Optional ID of the participant this message is for/from. Nparticipant_id__name__ __module__ __qualname____doc__rArstr__annotations__V/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/transports/livekit/transport.pyr?r?H %)NHSM(rJr?c&eZdZUdZdZeeed<y)(LiveKitOutputTransportMessageUrgentFrameFrame for urgent transport messages in LiveKit rooms. Parameters: participant_id: Optional ID of the participant this message is for/from. NrArBrIrJrKrNrNSrLrJrNc"eZdZdZfdZxZS)LiveKitTransportMessageFramer@ct|ddl}|j5|j d|j dt ddddy#1swYyxYw)NralwayszLiveKitTransportMessageFrame is deprecated and will be removed in a future version. Instead, use LiveKitOutputTransportMessageFrame.r( stacklevelsuper __post_init__warningscatch_warnings simplefilterwarnDeprecationWarningselfrY __class__s rKrXz*LiveKitTransportMessageFrame.__post_init__fs]   $ $ &   ! !( + MMC"      *AA rCrDrErFrX __classcell__r`s@rKrQrQ^  rJrQc"eZdZdZfdZxZS)"LiveKitTransportMessageUrgentFramerOct|ddl}|j5|j d|j dt ddddy#1swYyxYw)NrrSzLiveKitTransportMessageUrgentFrame is deprecated and will be removed in a future version. Instead, use LiveKitOutputTransportMessageUrgentFrame.r(rTrVr^s rKrXz0LiveKitTransportMessageUrgentFrame.__post_init__|s]   $ $ &   ! !( + MMI"     rarbrds@rKrgrgtrerJrgceZdZdZy) LiveKitParamszConfiguration parameters for LiveKit transport. Inherits all parameters from TransportParams without additional configuration. N)rCrDrErFrIrJrKrjrjs   rJrjcBeZdZUdZegedfed<egedfed<egedfed<eegedfed<eegedfed<eegedfed<eegedfed <eegedfed <eegedfed <eeegedfed <eegedfed <y)LiveKitCallbacksaCallback handlers for LiveKit events. Parameters: on_connected: Called when connected to the LiveKit room. on_disconnected: Called when disconnected from the LiveKit room. on_participant_connected: Called when a participant joins the room. on_participant_disconnected: Called when a participant leaves the room. on_audio_track_subscribed: Called when an audio track is subscribed. on_audio_track_unsubscribed: Called when an audio track is unsubscribed. on_data_received: Called when data is received from a participant. on_first_participant_joined: Called when the first participant joins. N on_connectedon_disconnectedon_before_disconnecton_participant_connectedon_participant_disconnectedon_audio_track_subscribedon_audio_track_unsubscribedon_video_track_subscribedon_video_track_unsubscribedon_data_receivedon_first_participant_joined) rCrDrErFrrrHrGbytesrIrJrKrlrls 2y.//b)D/122"2y#677&uio'=>>!)3%4*@!AA'y(>??!)3%4*@!AA'y(>??!)3%4*@!AAs|Yt_<==!)3%4*@!AArJrlc eZdZdZdedededededef dZed efd Z ed e jfd Z d e fd ZdZdefdZeededdddZdZd?dedeefdZdefdZde j6d efd Zd eefd!Zded e fd"Z!d#efd$Z"defd%Z#defd&Z$d'e jJfd(Z&d'e jJfd)Z'd*e jPd+e jRd'e jJfd,Z*d*e jPd+e jRd'e jJfd-Z+de jXfd.Z-d/Z.d0Z/d'e jJfd1Z0d'e jJfd2Z1d*e jPd+e jRd'e jJfd3Z2d*e jPd+e jRd'e jJfd4Z3de jXfd5Z4d6Z5d?d7Z6d8e jndefd9Z8d:Z9d;e jtdefd<Z;d=ZZ=y)@LiveKitTransportClientzCore client for interacting with LiveKit rooms. Manages the connection to LiveKit rooms and handles all low-level API interactions including room management, audio streaming, data messaging, and event handling. urltoken room_nameparams callbackstransport_namecz||_||_||_||_||_||_d|_d|_d|_d|_ d|_ d|_ i|_ tj|_i|_tj|_d|_d|_tj(|_y)aInitialize the LiveKit transport client. Args: url: LiveKit server URL to connect to. token: Authentication token for the room. room_name: Name of the LiveKit room to join. params: Configuration parameters for the transport. callbacks: Event callback handlers. transport_name: Name identifier for the transport. NFr)_url_token _room_name_params _callbacks_transport_name_room_participant_id _connected_disconnect_counter _audio_source _audio_track _audio_tracksasyncioQueue _audio_queue _video_tracks _video_queue_other_participant_has_joined _task_managerLock _async_lock)r_r{r|r}r~rrs rK__init__zLiveKitTransportClient.__init__s&  # #-)- $&#$ 8<;?#MMO#MMO-2*8<"<<>rJreturnc|jS)zvGet the participant ID for this client. Returns: The participant ID assigned by LiveKit. )rr_s rKrAz%LiveKitTransportClient.participant_ids###rJcN|jst|d|jS)zGet the LiveKit room instance. Returns: The LiveKit room object. Raises: Exception: If room object is not available. z-: missing room object (pipeline not started?))r Exceptionrs rKroomzLiveKitTransportClient.rooms(zztf$QRS SzzrJsetupcK|jry|j|_tj|jj |_|j jd|j|j jd|j|j jd|j|j jd|j|j jd|j|j jd|j|j jd |jyw) zSetup the client with task manager and room initialization. Args: setup: The frame processor setup configuration. N)loopparticipant_connectedparticipant_disconnectedtrack_subscribedtrack_unsubscribed data_received connected disconnected)r task_managerr"Roomget_event_looprron!_on_participant_connected_wrapper$_on_participant_disconnected_wrapper_on_track_subscribed_wrapper_on_track_unsubscribed_wrapper_on_data_received_wrapper_on_connected_wrapper_on_disconnected_wrapper)r_rs rKrzLiveKitTransportClient.setups    "//XX4#5#5#D#D#FG  . ,-d.T.TU0 /01Z1Z[( '()J)JK* )*4+N+NO% _%d&D&DE! [!$"<"<=$ ^$T%B%BCsFFc@K|jd{y7w)zCleanup client resources.N) disconnectrs rKcleanupzLiveKitTransportClient.cleanupsoos framec^K|jjxs |j|_yw)zStart the client and initialize audio components. Args: frame: The start frame containing initialization parameters. N)raudio_out_sample_rate_out_sample_rater_rs rKstartzLiveKitTransportClient.start s% !% B B aeFaFas+-r)r'r*r0) multiplierminmax)stopwaitcK|j4d{|jr'|xjdz c_ dddd{ytjd|j  |j j|j|jtjdd{d|_|xjdz c_|j jj|_tjd|j tj|j |j"j$|_tj(j+d|j&|_tj.}tj0j2|_|j jj7|j,|d{|j8j;d{|j=}|r9|j>s-d|_|j8jA|d d{dddd{y7]7.777k7"#tB$r+}tjDd |j d |d}~wwxYw7K#1d{7swYyxYww) z-Connect to the LiveKit room with retry logic.Nr'zConnecting to T)auto_subscribe)optionsz Connected to z pipecat-audiorzError connecting to : )#rrrr inforrconnectrrr" RoomOptionslocal_participantsidr AudioSourcerraudio_out_channelsrLocalAudioTrackcreate_audio_trackrTrackPublishOptions TrackSourceSOURCE_MICROPHONEsource publish_trackrrmget_participantsrrwrerror)r_r participantses rKrzLiveKitTransportClient.connectsK##) ) ((A-( ) ) )  KK.(9: ;! ii''IIKKOO4@( #'((A-('+yy'B'B'F'F$ mDOO+<=>&)__))4<<+J+J&"%($7$7$J$J#T%7%7%!113!$!B!Bii11??@Q@QSZ[[[oo22444 $446 (J(J9=D6//EElSToVVVM) ) ) ) *\4 W  3DOO3DBqcJK O) ) ) ) sK I0K #J8 K I3K  "J8.A I?7I68D5I?-I9.!I?I;A I?I=I? K *J6+K 3K 6I?9I?;I?=I?? J3&J..J33J86K 8K >K ?K K cK|j4d{|xjdzc_|jr|jdkDr dddd{ytjd|j |j jd{|jjd{d|_tjd|j |j jd{dddd{y7 777g77#1d{7swYyxYww)z!Disconnect from the LiveKit room.Nr'rzDisconnecting from FDisconnected from ) rrrr rrrrorrrnrs rKrz!LiveKitTransportClient.disconnectBs## 4 4  $ $ ) $??d&>&>&B 4 4 4 KK-doo->? @//668 8 8))&&( ( (#DO KK,T__,=> ?//113 3 3 4 4 4 4 9 ( 4 4 4 4 4sD>DD>2D) D>DD>?D)D!!D);D#D'D>D>!D)#D)%D)'D>)D;/D2 0D;7D>NdatarAcRK|jsy |r2|jjj|d|gd{y|jjj|dd{y757#t$r"}t j d|Yd}~yd}~wwxYww)zSend data to participants in the room. Args: data: The data bytes to send. participant_id: Optional specific participant to send to. NT)reliabledestination_identities)rzError sending data: )rrr publish_datarr r)r_rrArs rK send_dataz LiveKitTransportClient.send_dataRs  5ii11>>4@P?ii11>>td>SSS T 5 LL/s3 4 4 5s]B'.A9A5A9B'*A9/A70A94B'5A97A99 B$BB'B$$B'digitc@K|jsy|tvrtjd|yt|} |jj j ||d{y7#t$r%}tjd|d|Yd}~yd}~wwxYww)zkSend DTMF tone to the room. Args: digit: The DTMF digit to send (0-9, \*, #). NzInvalid DTMF digit: )coderzError sending DTMF tone r) r DTMF_CODE_MAPr warningrr publish_dtmfrr)r_rrrs rK send_dtmfz LiveKitTransportClient.send_dtmffs    % NN1%9 : U# B))--::E:R R R B LL3E7"QC@ A A Bs@8B*A-%A+&A-*B+A-- B6BBBB audio_framecK|jr |jsy |jj|d{y7#t$r"}t j d|Yd}~yd}~wwxYww)zxPublish an audio frame to the room. Args: audio_frame: The LiveKit audio frame to publish. FNTzError publishing audio: )rr capture_framerr r)r_rrs rK publish_audioz$LiveKitTransportClient.publish_audiozsh d&8&8 $$22;? ? ? @  LL3A37 8 s>A1AAAA1A A. A)$A1)A..A1c|jjjDcgc]}|jc}Scc}wzhGet list of participant IDs in the room. Returns: List of participant IDs. )rremote_participantsvaluesr)r_ps rKrz'LiveKitTransportClient.get_participantss/ $yy<<CCEF!FFFs=cK|jjj|}|r/|j|j|j |j dSiSw)Get metadata for a specific participant. Args: participant_id: ID of the participant to get metadata for. Returns: Dictionary containing participant metadata. )idnamemetadata is_speaking)rrgetrrrr)r_rA participants rKget_participant_metadataz/LiveKitTransportClient.get_participant_metadatasXii3377G !oo#(('00*66    sAArcjK|jjj|d{y7wzmSet metadata for the local participant. Args: metadata: Metadata string to set. N)rr set_metadatar_rs rKset_participant_metadataz/LiveKitTransportClient.set_participant_metadatas& ii))66x@@@s )313cK|jjj|}|rI|jj D]+}|j dk(s|j dd{-yy7w)~Mute a specific participant's audio tracks. Args: participant_id: ID of the participant to mute. audioFNrrrtracksrkind set_enabledr_rArtracks rKmute_participantz'LiveKitTransportClient.mute_participantsm ii3377G $++224 3::(++E222 3 3AA6A6+A4, A6cK|jjj|}|rI|jj D]+}|j dk(s|j dd{-yy7w)Unmute a specific participant's audio tracks. Args: participant_id: ID of the participant to unmute. rTNrrs rKunmute_participantz)LiveKitTransportClient.unmute_participantsm ii3377G $++224 2::(++D111 2 2r rc`|jj|j||dy)z)Wrapper for participant connected events.z!::_async_on_participant_connectedN)r create_task_async_on_participant_connectedr_rs rKrz8LiveKitTransportClient._on_participant_connected_wrappers/ &&  0 0 =f5 6 rJc`|jj|j||dy)z,Wrapper for participant disconnected events.z$::_async_on_participant_disconnectedN)rr"_async_on_participant_disconnectedrs rKrz;LiveKitTransportClient._on_participant_disconnected_wrappers/ &&  3 3K @f8 9 rJr publicationcd|jj|j||||dy)z$Wrapper for track subscribed events.z::_async_on_track_subscribedN)rr_async_on_track_subscribedr_rrrs rKrz3LiveKitTransportClient._on_track_subscribed_wrappers5 &&  + +E; Lf0 1 rJcd|jj|j||||dy)z&Wrapper for track unsubscribed events.z::_async_on_track_unsubscribedN)rr_async_on_track_unsubscribedrs rKrz5LiveKitTransportClient._on_track_unsubscribed_wrappers5 &&  - -e[+ Nf2 3 rJc`|jj|j||dy)z!Wrapper for data received events.z::_async_on_data_receivedN)rr_async_on_data_receivedr_rs rKrz0LiveKitTransportClient._on_data_received_wrappers/ &&  ( ( .f- . rJc^|jj|j|dy)zWrapper for connected events.z::_async_on_connectedN)rr_async_on_connectedrs rKrz,LiveKitTransportClient._on_connected_wrappers) &&t'?'?'AdVK`CabrJc^|jj|j|dy)z Wrapper for disconnected events.z::_async_on_disconnectedN)rr_async_on_disconnectedrs rKrz/LiveKitTransportClient._on_disconnected_wrappers, &&  ' ' )dV3K+L rJc4Ktjd|j|jj |j d{|j s5d|_|jj|j d{yy7F7w)$Handle participant connected events.zParticipant connected: NT)r ridentityrrprrrwrs rKrz6LiveKitTransportClient._async_on_participant_connecteds| -k.B.B-CDEoo66{GGG1115D .//==kooN N N2 H Os$A B B?B BBBcKtjd|j|jj |j d{t |jdk(rd|_yy7)w)'Handle participant disconnected events.zParticipant disconnected: NrF) r rr"rrqrlenrrrs rKrz9LiveKitTransportClient._async_on_participant_disconnectedsf 01E1E0FGHoo99+//JJJ t$$& '1 ,16D . - KsA A9 A7*A9cK|jtjjk(rt j d|j d|j ||j|j <tj|}|jj|j||j |d|jj|j d{y|jtjjk(rt j d|j d|j ||j|j <|j j"rNtj$|}|jj|j'||j |d|jj)|j d{yy77 w)zHandle track subscribed events.zAudio track subscribed: z from participant z::_process_audio_streamNzVideo track subscribed: z::_process_video_stream)rr" TrackKind KIND_AUDIOr rrr AudioStreamrr_process_audio_streamrrr KIND_VIDEOrrvideo_in_enabled VideoStream_process_video_streamrt)r_rrr audio_stream video_streams rKrz1LiveKitTransportClient._async_on_track_subscribed s ::11 1 KK2599+=OP[P_P_O`a b27D  { /??51L    * ***<I&/0 //;;KOOL L L ZZ3==33 3 KK2599+=OP[P_P_O`a b27D  { /||,,"u5 ""....|[__Mf34//;;KOOL L L4 M Ms%C&G5(G0)DG5)G3*G53G5cKtjd|jd|j|jt j jk(r.|jj|jd{y|jt j jk(r.|jj|jd{yy7[7w)z!Handle track unsubscribed events.zTrack unsubscribed: z from N) r rrr"rr"r'r(rrsr+rurs rKrz3LiveKitTransportClient._async_on_track_unsubscribed*s  *;??*;6+BVBVAWXY ::11 1//==kooN N N ZZ3==33 3//==kooN N N4 O Ns%A?C!CAC!CC!C!cK|jj|j|jjd{y7w)Handle data received events.N)rrvrrrrs rKrz.LiveKitTransportClient._async_on_data_received7s0oo..tyy$:J:J:N:NOOOs>AAAcTK|jjd{y7w)zHandle connected events.N)rrmrs rKrz*LiveKitTransportClient._async_on_connected;soo**,,,s (&(cKd|_tjd|jd||jj d{y7w)zHandle disconnected events.Frz . Reason: N)rr rrrrn)r_reasons rKrz-LiveKitTransportClient._async_on_disconnected?sB ((9F8LMoo--///sA A A Ar/c Ktjd||23d{}t|tjr&|j j ||fd{Itjdt|k7f7)6yw)z1Process incoming audio stream from a participant.z0Started processing audio stream for participant N Received unexpected event type: ) r r isinstancer"AudioFrameEventrputrtype)r_r/rAevents rKr*z,LiveKitTransportClient._process_audio_streamE F~FVWX' Q Q%%!4!45''++UN,CDDD!A$u+OP  QD(7BB BB ;B B !'BB  B BcjK |jjd{\}}||f-7w)z(Get the next audio frame from the queue.N)rrr_rrAs rKget_next_audio_framez+LiveKitTransportClient.get_next_audio_frameN8*.*;*;*?*?*A$A !E>' '$A 313r0c Ktjd||23d{}t|tjr&|j j ||fd{Itjdt|k7f7)6yw)z1Process incoming video stream from a participant.z0Started processing video stream for participant Nr8) r rr9r"VideoFrameEventrr;rr<)r_r0rAr=s rKr.z,LiveKitTransportClient._process_video_streamTr>r?cjK |jjd{\}}||f-7w)z(Get the next video frame from the queue.N)rrrAs rKget_next_video_framez+LiveKitTransportClient.get_next_video_frame]rCrDc |jdS)z6String representation of the LiveKit transport client.z::LiveKitTransportClient)rrs rK__str__zLiveKitTransportClient.__str__cs&&''?@@rJN)>rCrDrErFrGrjrlrpropertyrAr"rrrrrrrr$r%r&rrrxrrr AudioFrameboolrrrdictrrrr RemoteParticipantrrTrackRemoteTrackPublicationrr DataPacketrrrrrrrrrrr)r*rBr-r.rHrJrIrJrKrzrzs %* %*%* %*  %* $ %*%*N$$$ chh  D!4D* bb "1%,<qVX,YZ+[+Z4 5E58C=5(BSB(s~~$ G$s)GST&AsA 3S 3 2s 2 S=R=R  @U@U   yy  //  **    yy  //  **   cnn c OAVAVO7CDYDY7MyyM//M** M: Oyy O// O** OP#..P-0 QQY\Q( QQY\Q( ArJrzceZdZdZdededeffd Zede e fdZ de ffd Z deffd Zdeffd Zd effd ZfdZdedefdZdZdZdej6defdZdej<defdZ xZ!S)LiveKitInputTransportzHandles incoming media streams and events from LiveKit rooms. Processes incoming audio streams from room participants and forwards them as Pipecat frames, including audio resampling and VAD integration. transportclientr~c t||fi|||_||_d|_d|_|j |_t|_ d|_ y)aInitialize the LiveKit input transport. Args: transport: The parent transport instance. client: LiveKitTransportClient instance. params: Configuration parameters. **kwargs: Additional arguments passed to parent class. NF) rWr _transport_client_audio_in_task_video_in_task vad_analyzer _vad_analyzerr _resampler _initializedr_rVrWr~kwargsr`s rKrzLiveKitInputTransport.__init__osW *6*# ""4:4G4G13"rJrc|jS)zzGet the Voice Activity Detection analyzer. Returns: The VAD analyzer instance if configured. )r^rs rKr]z"LiveKitInputTransport.vad_analyzers!!!rJrctKt||d{|jryd|_|jj|d{|jj d{|j s:|j jr$|j|j|_|js:|j jr$|j|j|_ |j|d{tjdy7777!w)zStart the input transport and connect to LiveKit room. Args: frame: The start frame containing initialization parameters. NTzLiveKitInputTransport started)rWrr`rZrr[raudio_in_enabledr_audio_in_task_handlerr\r,_video_in_task_handlerset_transport_readyr rr_rr`s rKrzLiveKitInputTransport.starts gmE"""     ll  '''ll""$$$""t||'D'D"&"2"243N3N3P"QD ""t||'D'D"&"2"243N3N3P"QD &&u--- 34 # ($ .sFD8D/6D8 D2!D8/D40B$D8D6D82D84D86D8cvKt||d{|jjd{|jr#|j |jd{|j r#|j |j d{tjdy77z7M7 w)zStop the input transport and disconnect from LiveKit room. Args: frame: The end frame signaling transport shutdown. NzLiveKitInputTransport stopped) rWrrZrr[ cancel_taskr\r rris rKrzLiveKitInputTransport.stops gl5!!!ll%%'''   ""4#6#67 7 7   ""4#6#67 7 7 34 "' 7 7sCB9B1!B9B3.B9'B5(.B9B7B93B95B97B9cKt||d{|jjd{|jr9|j j r#|j|jd{|jr;|j jr$|j|jd{yyy777P7 w)zCancel the input transport and disconnect from LiveKit room. Args: frame: The cancel frame signaling immediate cancellation. N) rWcancelrZrr[rrerkr\r,ris rKrmzLiveKitInputTransport.cancels gnU###ll%%'''   4<<#@#@""4#6#67 7 7   4<<#@#@""4#6#67 7 7$A  $' 7 7sECC !CC AC=C>ACCC CCCrcKt||d{|jj|d{y7(7w)zSetup the input transport with shared client setup. Args: setup: The frame processor setup configuration. NrWrrZr_rr`s rKrzLiveKitInputTransport.setup< gmE"""ll  ''' #'A?"AAAAcKt|d{|jjd{y7'7w)z-Cleanup input transport and shared resources.NrWrrYr_r`s rKrzLiveKitInputTransport.cleanup6gooo%%''' 'A=!A?AAmessagesenderc\Kt||}|j|d{y7w)zPush an application message as an urgent transport frame. Args: message: The message data to send. sender: ID of the message sender. rxrAN)rN push_frame)r_rxryrs rKpush_app_messagez&LiveKitInputTransport.push_app_messages'9Y_`ooe$$$s ",*,cKtjd|jj}|23d{}|s |\}}|j |d{}t |j dk(rCt||j |j|j}|j|d{77f7 6yw)z/Handle incoming audio frames from participants.zAudio input task startedNr)user_idr sample_rate num_channels) r rrZrB!_convert_livekit_audio_to_pipecatr%rrrrpush_audio_frame)r_audio_iterator audio_dataaudio_frame_eventrApipecat_audio_frameinput_audio_frames rKrfz,LiveKitInputTransport._audio_in_task_handlers ./::< . ? ?*4>1!>,0,R,R%-'# *001Q6$5*-33 3 ? ?!4!A!A %! ++,=>>># ?'?#!/sP2CCB>CCCCAC8C9C>CCCCcKtjd|jj}|23d{}|s |\}}|j |d{}t |j dk(rDt||j |j|j}|j|d{77f7 6yw)z/Handle incoming video frames from participants.zVideo input task startedN)video_frame_eventr)rimagesizeformat) r rrZrH!_convert_livekit_video_to_pipecatr%rrrrpush_video_frame)r_video_iterator video_datarrApipecat_video_frameinput_video_frames rKrgz,LiveKitInputTransport._video_in_task_handlers ./::< . ? ?*4>1!>,0,R,R&7-S-'# *001Q6$5*-33,11.55 %! ++,=>>># ?'?#!/sP2CCB?CCCCAC9C:C?CCCCrc K|j}|jj|jj |j |j d{}t ||j |jS7&w)z3Convert LiveKit audio frame to Pipecat audio frame.N)rrr)rr_resamplertobytesrr r)r_rrrs rKrz7LiveKitInputTransport._convert_livekit_audio_to_pipecat sw(-- ??33    $ $ & (?(?AQAQ  (($11   sABB'BrcK|jjtjj}t |j |j|jfd}|Sw)z3Convert LiveKit video frame to Pipecat video frame.RGB)rrr) rconvertproto_video_frameVideoBufferTypeRGB24rrwidthheight)r_r rgb_frame image_frames rKrz7LiveKitInputTransport._convert_livekit_video_to_pipecatsY &++334E4U4U4[4[\ #..//9#3#34 sA$A&)"rCrDrErFrrzrjrrLrr r]rrrrrrmrrrrrGr}rfrgr"r:r rrFrrrcrds@rKrUrUhs " "'" "6"h{3""55, 5 5 8+ 8(!4(( %c%3%?.?. !$!4!4  ..   rJrUceZdZdZdededeffd Zdeffd Z de ffd Z de ffd Z d effd Zfd Zdeezfd ZdedefdZdefdZdeezfdZdedej:fdZxZS)LiveKitOutputTransportzHandles outgoing media streams and events to LiveKit rooms. Manages sending audio frames and data messages to LiveKit room participants, including audio format conversion for LiveKit compatibility. rVrWr~c Pt||fi|||_||_d|_y)aInitialize the LiveKit output transport. Args: transport: The parent transport instance. client: LiveKitTransportClient instance. params: Configuration parameters. **kwargs: Additional arguments passed to parent class. FN)rWrrYrZr`ras rKrzLiveKitOutputTransport.__init__/s/ *6*# "rJrcZKt||d{|jryd|_|jj|d{|jj d{|j |d{t jdy77W777 w)zStart the output transport and connect to LiveKit room. Args: frame: The start frame containing initialization parameters. NTzLiveKitOutputTransport started)rWrr`rZrrhr rris rKrzLiveKitOutputTransport.startEs gmE"""     ll  '''ll""$$$&&u--- 45 # ($-sEB+B#6B+ B%!B+/B'0B+B) B+%B+'B+)B+cKt||d{|jjd{t j dy7<7w)zStop the output transport and disconnect from LiveKit room. Args: frame: The end frame signaling transport shutdown. NzLiveKitOutputTransport stopped)rWrrZrr rris rKrzLiveKitOutputTransport.stopWsG gl5!!!ll%%''' 45 "'sAA!AAAAcKt||d{|jjd{y7'7w)zCancel the output transport and disconnect from LiveKit room. Args: frame: The cancel frame signaling immediate cancellation. N)rWrmrZrris rKrmzLiveKitOutputTransport.cancelas: gnU###ll%%''' $'sA>!AAAArcKt||d{|jj|d{y7(7w)zSetup the output transport with shared client setup. Args: setup: The frame processor setup configuration. Nrorps rKrzLiveKitOutputTransport.setupjrqrrcKt|d{|jjd{y7'7w)z.Cleanup output transport and shared resources.Nrtrus rKrzLiveKitOutputTransport.cleanupsrvrwcK|j}t|trtj|d}t|t t fr=|jj|j|jd{y|jj|jd{y777w)zySend a transport message to participants. Args: frame: The transport message frame to send. F) ensure_asciiN) rxr9rOjsondumpsr?rNrZrencoderA)r_rrxs rK send_messagez#LiveKitOutputTransport.send_messagexs-- gt $jju=G  68`a ,,(()95;O;OP P P,,(()9: : : Q :s$BB?B;1B?5B=6B?=B?rcK|j|j}|jj|d{S7w)zWrite an audio frame to the LiveKit room. Args: frame: The audio frame to write. Returns: True if the audio frame was written successfully, False otherwise. N)!_convert_pipecat_audio_to_livekitrrZr)r_r livekit_audios rKwrite_audio_framez(LiveKitOutputTransport.write_audio_frames7>>u{{K \\// >>>>s:AAAcy)zLiveKit supports native DTMF via telephone events. Returns: True, as LiveKit supports native DTMF transmission. TrIrs rK_supports_native_dtmfz,LiveKitOutputTransport._supports_native_dtmfs rJc~K|jj|jjd{y7w)zUse LiveKit's native publish_dtmf method for telephone events. Args: frame: The DTMF frame to write. N)rZrbuttonvaluers rK_write_dtmf_nativez)LiveKitOutputTransport._write_dtmf_natives* ll$$U\\%7%7888s 3=;= pipecat_audiocd}t||z}||jjz}tj||j |jj|S)z2Convert Pipecat audio data to LiveKit audio frame.r()rrrsamples_per_channel)r%rrr"rMr)r_rbytes_per_sample total_samplesrs rKrz8LiveKitOutputTransport._convert_pipecat_audio_to_livekitsZM*.>> +t||/N/NN~~((88 3   rJ) rCrDrErFrrzrjrrrrrrrmrrrrrrrrNrrrrrrxr"rMrrcrds@rKrr(s " "'" ",66$66(+((!4(( ;03TT;& ?-@ ?T ?t9o@U.U9  u    rJrceZdZdZ d*dedededeedeedeef fd Zd efd Z d e fd Z e d efd Z d efdZd eefdZded efdZdefdZdefdZdefdZdZdZdZdefdZdefdZdefdZdefdZdefdZdefdZde defd Z!d+d!edeefd"Z"d+d!edeefd#Z#d$Z$d%Z%d&Z&d'efd(Z'defd)Z(xZ)S),LiveKitTransportaTransport implementation for LiveKit real-time communication. Provides comprehensive LiveKit integration including audio streaming, data messaging, participant management, and room event handling for conversational AI applications. Event handlers available: - on_connected: Called when the bot connects to the room. - on_disconnected: Called when the bot disconnects from the room. - on_before_disconnect: [sync] Called just before the bot disconnects. - on_call_state_updated: Called when the call state changes. Args: (state: str) - on_first_participant_joined: Called when the first participant joins. Args: (participant_id: str) - on_participant_connected: Called when a participant connects. Args: (participant_id: str) - on_participant_disconnected: Called when a participant disconnects. Args: (participant_id: str) - on_participant_left: Called when a participant leaves. Args: (participant_id: str, reason: str) - on_audio_track_subscribed: Called when an audio track is subscribed. Args: (participant_id: str) - on_audio_track_unsubscribed: Called when an audio track is unsubscribed. Args: (participant_id: str) - on_video_track_subscribed: Called when a video track is subscribed. Args: (participant_id: str) - on_video_track_unsubscribed: Called when a video track is unsubscribed. Args: (participant_id: str) - on_data_received: Called when data is received from a participant. Args: (data: bytes, participant_id: str) Example:: @transport.event_handler("on_first_participant_joined") async def on_first_participant_joined(transport, participant_id): await task.queue_frame(TTSSpeakFrame("Hello!")) @transport.event_handler("on_participant_disconnected") async def on_participant_disconnected(transport, participant_id): await task.queue_frame(EndFrame()) r{r|r}r~ input_name output_namec t|||t|j|j|j |j |j|j|j|j|j|j|j }|xs t|_t!||||j||j"|_d|_d|_|j+d|j+d|j+d|j+d|j+d|j+d |j+d |j+d |j+d |j+d |j+d|j+d|j+ddy)aInitialize the LiveKit transport. Args: url: LiveKit server URL to connect to. token: Authentication token for the room. room_name: Name of the LiveKit room to join. params: Configuration parameters for the transport. input_name: Optional name for the input transport. output_name: Optional name for the output transport. )rr) rmrnrorprqrrrsrtrurvrwNrmrnrprqrrrsrtrurvrwon_participant_lefton_call_state_updatedroT)sync)rWrrl _on_connected_on_disconnected_on_before_disconnect_on_participant_connected_on_participant_disconnected_on_audio_track_subscribed_on_audio_track_unsubscribed_on_video_track_subscribed_on_video_track_unsubscribed_on_data_received_on_first_participant_joinedrjrrzrrZ_input_output_register_event_handler) r_r{r|r}r~rrrr`s rKrzLiveKitTransport.__init__s& JKH$++ 11!%!;!;%)%C%C(,(I(I&*&E&E(,(I(I&*&E&E(,(I(I!33(,(I(I  0 -  4<<DII  8< 9=  $$^4 $$%67 $$%?@ $$%BC $$%@A $$%BC $$%@A $$%BC $$%78 $$%BC $$%:; $$%<= $$%;$$GrJrc|js2t||j|j|j|_|jS)zGet the input transport for receiving media and events. Returns: The LiveKit input transport instance. r)rrUrZr _input_namers rKinputzLiveKitTransport.inputs: {{/dllDLLt7G7GDK{{rJc|js2t||j|j|j|_|jS)zGet the output transport for sending media and events. Returns: The LiveKit output transport instance. r)rrrZr _output_namers rKoutputzLiveKitTransport.output$s: ||1dllDLLt7H7HDL||rJc.|jjS)zyGet the participant ID for this transport. Returns: The participant ID assigned by LiveKit. )rZrArs rKrAzLiveKitTransport.participant_id0s||***rJrcK|jr3|jj|tjd{yy7w)zlSend an audio frame to the LiveKit room. Args: frame: The audio frame to send. N)r queue_framer DOWNSTREAMrs rK send_audiozLiveKitTransport.send_audio9s7 <<,,**5.2K2KL L L  Ls:AAAc6|jjSr)rZrrs rKrz!LiveKitTransport.get_participantsBs ||,,..rJrAcTK|jj|d{S7w)rN)rZrr_rAs rKrz)LiveKitTransport.get_participant_metadataJs#\\::>JJJJs (&(rcVK|jj|d{y7wr)rZrrs rKrzLiveKitTransport.set_metadataUs ll33H=== )')cVK|jj|d{y7w)rN)rZrrs rKrz!LiveKitTransport.mute_participant]s ll++N;;;rcVK|jj|d{y7w)r N)rZr rs rKr z#LiveKitTransport.unmute_participantes ll--n===rcK|jdd{|jr,|jjtd{yy7=7w)zHandle room connected events.rmN)_call_event_handlerrr|rrs rKrzLiveKitTransport._on_connectedmsK&&~666 ;;++(():)<= = =  7 =s!AA6AAAAcBK|jdd{y7w)z Handle room disconnected events.rnNrrs rKrz!LiveKitTransport._on_disconnectedss&&'8999 cBK|jdd{y7w)z(Handle before disconnection room events.roNrrs rKrz&LiveKitTransport._on_before_disconnectws&&'=>>>rcK|jd|d{|jr,|jjtd{yy7=7w)r!rpN)rrr|rrs rKrz*LiveKitTransport._on_participant_connected{sO&&'A>RRR ;;++(()=)?@ @ @  S @s!AA6AAAAc~K|jd|d{|jd|dd{y7 7w)r$rqNrrrrs rKrz-LiveKitTransport._on_participant_disconnecteds@&&'DnUUU&&'>@   99%%{K   TBBA>BcDK|jd|d{y7w)z'Handle audio track unsubscribed events.rsNrrs rKrz-LiveKitTransport._on_audio_track_unsubscribed&&'DnUUU   c4K|jd|d{|jjjj |}|rG|j j D])}|jj|j||+yy7}w)z%Handle video track subscribed events.rtN) rrZrrr video_tracksrrrrs rKrz+LiveKitTransport._on_video_track_subscribedrrcDK|jd|d{y7w)z'Handle video track unsubscribed events.ruNrrs rKrz-LiveKitTransport._on_video_track_unsubscribedrrrcK|jr2|jj|j|d{|jd||d{y7 7w)r3Nrv)rr}decoder)r_rrAs rKrz"LiveKitTransport._on_data_receivedsP ;;++..t{{}nM M M&&'94PPP NPs!:A!AA!AA!A!rxcK|jr1t||}|jj|d{yy7w)zSend a message to participants in the room. Args: message: The message string to send. participant_id: Optional specific participant to send to. r{N)rr?rr_rxrArs rKrzLiveKitTransport.send_messagesB <<6E,,++E2 2 2  38AAAcK|jr1t||}|jj|d{yy7w)zSend an urgent message to participants in the room. Args: message: The urgent message string to send. participant_id: Optional specific participant to send to. r{N)rrNrrs rKsend_message_urgentz$LiveKitTransport.send_message_urgentsB <<<E,,++E2 2 2  3rc Kyw)zXHandle room events. Args: event: The room event to handle. NrIr_r=s rK on_room_eventzLiveKitTransport.on_room_event  c Kyw)zfHandle participant events. Args: event: The participant event to handle. NrIrs rKon_participant_eventz%LiveKitTransport.on_participant_eventrrc Kyw)zZHandle track events. Args: event: The track event to handle. NrIrs rKon_track_eventzLiveKitTransport.on_track_eventrrstatecDK|jd|d{y7w)z Handle call state update events.rNr)r_r s rK_on_call_state_updatedz'LiveKitTransport._on_call_state_updateds&&'>FFFrcDK|jd|d{y7w)z'Handle first participant joined events.rwNrrs rKrz-LiveKitTransport._on_first_participant_joinedrr)NNNrK)*rCrDrErFrGrrjrrUrrrrLrArrrrrOrrrr rrrrrrrrrrxrrrrrr r rrcrds@rKrrs(^+/$(%)6H 6H6H 6H ' 6H SM 6Hc]6Hp ,  . +++M&9M/$s)/ KS KT K>3>s>> :?AcA ^^ sVVsVVQEQ3Q 3# 3x} 3 3 3hsm 3   G#GVVrJr)FrFrr dataclassesrtypingrrrrrlogurur pydanticr pipecat.audio.utilsr pipecat.audio.vad.vad_analyzerr pipecat.frames.framesr rrrrrrrrrrrrr"pipecat.processors.frame_processorrrpipecat.transports.base_inputrpipecat.transports.base_outputr!pipecat.transports.base_transportrr "pipecat.utils.asyncio.task_managerr!livekitr"livekit.rtc._protor#rtenacityr$r%r&ModuleNotFoundErrorrrrrr?rNrQrgrjrlrzrUrrrIrJrKrs !;;76 S<>L>,GDD    ))D) ) )/P) ) #E * )Q * O ByB6wAwAt }.}@J 0J ZnV}nVG,FLL;qc"#FLLZ[ &qc* ++,s:D!!E&2EE