qidZddlZddlmZmZmZddlZddlm Z ddl m Z ddl m Z mZmZ ddlZGd d e Zy#e$r7Ze j(dee j(ded edZ[wwxYw) zSoundfile-based audio mixer for file playback integration. Provides an audio mixer that combines incoming audio with audio loaded from files using the soundfile library. Supports multiple audio formats and runtime configuration changes. N)AnyDictMapping)logger)BaseAudioMixer)MixerControlFrameMixerEnableFrameMixerUpdateSettingsFramez Exception: zUIn order to use the soundfile mixer, you need to `pip install pipecat-ai[soundfile]`.zMissing module: c eZdZdZdddddeeefdededed ef fd Zd e fd Z d Z de fdZ dedefdZdefdZdefdZdefdZdefdZd efdZdedefdZdefdZxZS)SoundfileMixeraeAudio mixer that combines incoming audio with file-based audio. This is an audio mixer that mixes incoming audio with audio from a file. It uses the soundfile library to load files so it supports multiple formats. The audio files need to only have one channel (mono) and it needs to match the sample rate of the output transport. Multiple files can be loaded, each with a different name. The `MixerUpdateSettingsFrame` has the following settings available: `sound` (str) and `volume` (float) to be able to update to a different sound file or to change the volume at runtime. g?T)volumemixingloop sound_files default_soundr rrc t|di|||_||_d|_d|_i|_||_||_||_ y)aInitialize the soundfile mixer. Args: sound_files: Mapping of sound names to file paths for loading. default_sound: Name of the default sound to play initially. volume: Mixing volume level (0.0 to 1.0). Defaults to 0.4. mixing: Whether mixing is initially enabled. Defaults to True. loop: Whether to loop audio files when they end. Defaults to True. **kwargs: Additional arguments passed to parent class. rN) super__init__ _sound_files_volume _sample_rate _sound_pos_sounds_current_sound_mixing_loop)selfrrr rrkwargs __class__s V/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/audio/mixers/soundfile_mixer.pyrzSoundfileMixer.__init__/sP( "6"' ') +  sample_ratecK||_|jjD].\}}tj|j ||d{0y7w)zInitialize the mixer and load all sound files. Args: sample_rate: The sample rate of the output transport in Hz. N)rritemsasyncio to_thread_load_sound_file)rr# sound_name file_names r!startzSoundfileMixer.startNsV (%)%6%6%<%<%> R !J ##D$9$9:yQ Q Q R QsA AAAc Kyw)zyClean up mixer resources. Currently performs no cleanup as sound data is managed by garbage collection. Nr)rs r!stopzSoundfileMixer.stopXs sframecKt|tr|j|d{yt|tr#|j |j d{y797w)zProcess mixer control frames to update settings or enable/disable mixing. Args: frame: The mixer control frame to process. N) isinstancer _update_settingsr _enable_mixingenable)rr.s r! process_framezSoundfileMixer.process_frame_s] e5 6''. . . / 0%%ell3 3 3  / 3s!%A%A!3A%A#A%#A%audioreturnc,K|j|Sw)zMix transport audio with the current sound file. Args: audio: Raw audio bytes from the transport to mix. Returns: Mixed audio bytes combining transport and file audio. )_mix_with_sound)rr5s r!mixzSoundfileMixer.mixks##E**sr3cK||_yw)zEnable or disable audio mixing.N)r)rr3s r!r2zSoundfileMixer._enable_mixingv   cK|jjD]d\}}|xdk(r|j|d{'xdk(r|j|d{Gdk(sL|j |d{fy7F7(7 w)z+Update mixer settings from a control frame.soundNr r)settingsr% _change_sound_update_volume _update_loop)rr.settingvalues r!r1zSoundfileMixer._update_settingszs{#nn224 3NGU,,U333--e444++E222 3442s9B B  B r>cxK||jvr||_d|_ytjd|dyw)zxChange the currently playing sound file. Args: sound: Name of the sound file to switch to. rzSound z is not availableN)rrrrerror)rr>s r!r@zSoundfileMixer._change_sounds; D%% %"'D DO LL6%(9: ;s8:cK||_yw)zUpdate the mixing volume level.N)r)rr s r!rAzSoundfileMixer._update_volumer;r<cK||_yw)zUpdate the looping behavior.N)r)rrs r!rBzSoundfileMixer._update_loops  r<r)r*c  tjd|tj|d\}}||jk(rC|j }t j|t j|j|<y tjd|d|d|jdy #t$r%}tjd|d |Yd }~y d }~wwxYw) z*Load an audio file into memory for mixing.zLoading mixer sound from int16dtypez Sound file z has incorrect sample rate z (should be )zUnable to open file z: N) rdebugsfreadrtobytesnp frombufferrJrwarning ExceptionrF)rr)r*r>r#r5es r!r(zSoundfileMixer._load_sound_files B LL4YK@ A!#'!B E;d/// +-==bhh+O Z(!),G }T`aearar`sstu B LL/ {"QC@ A A BsBB0)B00 C9CCcp|jr|j|jvr|Stj|tj }t |}|j|j}|j|zt |kDr|js|Sd|_|j}|j|z}||_|||}tj|||jzzddjtj }|jtj jS)zHMix raw audio frames with chunks of the same length from the sound file.rKrii) rrrrRrSrJlenrrcliprastyperQ) rr5audio_np chunk_sizer> start_posend_possound_np mixed_audios r!r8zSoundfileMixer._mix_with_sounds||4#6#6$,,#FL==bhh7]  T001 ??Z '#e* 4:: DOOO //J.!7+gghDLL)@@&%PWWXZX`X`a !!"((+3355r")__name__ __module__ __qualname____doc__rstrfloatboolrintr+r-rr4bytesr9r2r r1r@rArBr(r8 __classcell__)r s@r!r r !s $S#X&     >RsR   ):   +u + +4 3,D 3 < <5tB3B3B"6U6r"r )rdr&typingrrrnumpyrRlogurur%pipecat.audio.mixers.base_audio_mixerrpipecat.frames.framesrr r soundfilerOModuleNotFoundErrorrVrFrUr rr"r!rrs%%@__,b6^b6,FLL;qc"#FLL_ &qc* ++ ,s<A82A33A8