qi!XddlZddlmZddlmZddlmZmZddl m Z m Z GddZ y) N) FfiHandle)audio_frame_pb2)_ensure_compatible_buffer get_address)AnyUnionceZdZdZdddeeeefdedededee e e fdfd df d Z e dededed dfd Ze d ej d dfd Zd ej$fdZed e e e ffdZed efdZed efdZed efdZed efdZed efdZd efdZd e fdZede fdZy) AudioFramez A class that represents a frame of audio data with specific properties such as sample rate, number of channels, and samples per channel. The format of the audio data is 16-bit signed integers (int16) interleaved by channel. N)userdatadata sample_rate num_channelssamples_per_channelr returnct|tr|jd}t|}||zt j tj z}t|}||kr td|t j tj zdk7r td||_ ||_ ||_ ||_ |i|_ y||_ y)aG Initialize an AudioFrame instance. Args: data (Union[bytes, bytearray, memoryview]): The raw audio data, which must be at least `num_channels * samples_per_channel * sizeof(int16)` bytes long. sample_rate (int): The sample rate of the audio in Hz. num_channels (int): The number of audio channels (e.g., 1 for mono, 2 for stereo). samples_per_channel (int): The number of samples per channel. Raises: ValueError: If the length of `data` is smaller than the required size. BzIdata length must be >= num_channels * samples_per_channel * sizeof(int16)rz/data length must be a multiple of sizeof(int16)N) isinstance memoryviewcastrctypessizeofc_int16len ValueError_data _sample_rate _num_channels_samples_per_channel _userdata)selfr rrrr min_sizedata_lens I/opt/pipecat/venv/lib/python3.12/site-packages/livekit/rtc/audio_frame.py__init__zAudioFrame.__init__s, dJ '99S>D(."55 fnn8UUt9 h [  fmmFNN3 3q 8NO O ')$7!'/Xc||ztjtjz}t|}t ||||S)a Create a new empty AudioFrame instance with specified sample rate, number of channels, and samples per channel. Args: sample_rate (int): The sample rate of the audio in Hz. num_channels (int): The number of audio channels (e.g., 1 for mono, 2 for stereo). samples_per_channel (int): The number of samples per channel. Returns: AudioFrame: A new AudioFrame instance with uninitialized (zeroed) data. )rrr bytearrayr )rrrsizer s r$createzAudioFrame.createLs<11FMM&..4QQ$ \;NOOr& owned_infocl|j}|j|jz}tj|zj |j }t|}t|jjjt||j|j|jSN)inforrrr from_addressdata_ptrr(rhandleiddisposer r)r+r.r)cdatar s r$_from_owned_infozAudioFrame._from_owned_info^s  4#;#;;$&44T]]C*##&&'//1$ 0 0$2C2CTE]E]^^r&ctj}t|j|_|j |_|j |_|j|_|Sr-) proto_audioAudioFrameBufferInforrr0rrr)r! audio_infos r$ _proto_infozAudioFrame._proto_infogsQ 557 )$**5 !%!1!1 "&"3"3 )-)A)A &r&c|jS)zH Returns the user data associated with the audio frame. )r r!s r$r zAudioFrame.userdataos ~~r&cht|jjdjdS)z Returns a memory view of the audio data as 16-bit signed integers. Returns: memoryview: A memory view of the audio data. rh)rrrr<s r$r zAudioFrame.datavs)$**%**3/44S99r&c|jS)zw Returns the sample rate of the audio frame. Returns: int: The sample rate in Hz. )rr<s r$rzAudioFrame.sample_rates   r&c|jS)z Returns the number of channels in the audio frame. Returns: int: The number of audio channels (e.g., 1 for mono, 2 for stereo). )rr<s r$rzAudioFrame.num_channelss!!!r&c|jS)z Returns the number of samples per channel. Returns: int: The number of samples per channel. )rr<s r$rzAudioFrame.samples_per_channels(((r&c4|j|jz S)z Returns the duration of the audio frame in seconds. Returns: float: The duration in seconds. )rrr<s r$durationzAudioFrame.durations''$*:*:::r&cddl}ddl}|j5}|j|d5}|j |j |j d|j|j|j|jddd|jcdddS#1swY"xYw#1swYyxYw)z Convert the audio frame data to a WAV-formatted byte stream. Returns: bytes: The audio data encoded in WAV format. rNwb) waveioBytesIOopen setnchannelsr setsampwidth setframerater writeframesrgetvalue)r!rGrHwav_filewavs r$ to_wav_byteszAudioFrame.to_wav_bytess  ZZ\ 'X8T* ,c  !2!23  #  !1!12 +  , $$& ' ' , , ' 's#B<A#B0B<0B9 5B<<Cc rd|jd|jd|jd|jdd S)Nzrtc.AudioFrame(sample_rate=z, num_channels=z, samples_per_channel=z , duration=z.3f))rrrrCr<s r$__repr__zAudioFrame.__repr__sO)$*:*:);< --./##'#;#;"<= c*! - r&_c ddlm}ddldtddffd }|j |j |j |j|j|j|j|j|j|j|jd|j|g|j||jfd S) Nr) core_schemavaluerr ct|tr|St|tr|d}t|tr*tj |d|d|d|dSt d)Nrr rrrr rrrzInvalid type for AudioFrame)rr tupledict b64decode TypeError)rYbase64s r$validate_audio_framezEAudioFrame.__get_pydantic_core_schema__..validate_audio_framesu%, %'a%&!))%-8 %m 4!&~!6(-.C(D 9: :r&r[cj|jjd|j|j|j dS)Nzutf-8r[) b64encoder decoderrr)instancer`s r$z9AudioFrame.__get_pydantic_core_schema__..sB",,X]];BB7K#+#7#7$,$9$9+3+G+G "r&) json_schema python_schema serialization) pydantic_corerXr`rjson_or_python_schema chain_schemamodel_fields_schema model_field str_schema int_schema no_info_plain_validator_function$plain_serializer_function_ser_schema)clsrVrXrar`s @r$__get_pydantic_core_schema__z'AudioFrame.__get_pydantic_core_schema__s- ; ;  ;"00#0033$/$;$;K3J3J + 6 6 84   @@AUV &FFG[\%JJ#1  r&) __name__ __module__ __qualname____doc__r bytesr(rintr]strrr% staticmethodr*r7OwnedAudioFrameBufferr5r8r:propertyr r rrrfloatrCrRrU classmethodrtr&r$r r s15,>E9j01,>,> ,> ! ,>S#X,-,> ,>\PCPsPPQ]PP"_[%F%F_<__[==$sCx. :j::!S!!"c"")S));%;;'e'& # . c. . r&r ) r _ffi_clientr_protorr7_utilsrrtypingrr r rr&r$rs""2:\ \ r&