qiK;dZddlZddlZddlmZddlmZmZm Z ddl m Z ddl m Z mZmZmZmZmZmZmZddlmZddlmZmZdd lmZdd lmZdd lmZdd l m!Z!dd l"m#Z# ddl$m%Z&ddl'm(Z(eGddeZ-GddZ.GddeZ/y#e)$r7Z*e jVde*e jVde,de*dZ*[*wwxYw)zCartesia Speech-to-Text service implementation. This module provides a WebSocket-based STT service that integrates with the Cartesia Live transcription API for real-time speech recognition. N) dataclass)AnyAsyncGeneratorOptional)logger) CancelFrameEndFrameFrameInterimTranscriptionFrame StartFrameTranscriptionFrameVADUserStartedSpeakingFrameVADUserStoppedSpeakingFrame)FrameDirection) STTSettings_warn_deprecated_param)CARTESIA_TTFS_P99)WebsocketSTTService)Language)time_now_iso8601) traced_stt)connect)Statez Exception: zIIn order to use Cartesia, you need to `pip install pipecat-ai[cartesia]`.zMissing module: ceZdZdZy)CartesiaSTTSettingsz Settings for CartesiaSTTService.N)__name__ __module__ __qualname____doc__O/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/cartesia/stt.pyrr/s*r!rc eZdZdZdej j ddddededed efd Z d Z d Z ddZ e deddfdZy )CartesiaLiveOptionszConfiguration options for Cartesia Live STT service. .. deprecated:: 0.0.105 Use ``settings=CartesiaSTTSettings(...)`` for model/language and direct ``__init__`` parameters for encoding/sample_rate instead. ink-whisper pcm_s16lei>modellanguageencoding sample_rater(r)r*r+c J||_||_||_||_||_y)aInitialize CartesiaLiveOptions with default or provided parameters. Args: model: The transcription model to use. Defaults to "ink-whisper". language: Target language for transcription. Defaults to English. encoding: Audio encoding format. Defaults to "pcm_s16le". sample_rate: Audio sample rate in Hz. Defaults to 16000. **kwargs: Additional parameters for the transcription service. N)r(r)r*r+additional_params)selfr(r)r*r+kwargss r"__init__zCartesiaLiveOptions.__init__>s)$     &!'r!c|jt|jtr |jn|jj|j t|j d}|S)zConvert options to dictionary format. Returns: Dictionary containing all configuration parameters. r')r( isinstancer)strvaluer*r+)r.paramss r"to_dictzCartesiaLiveOptions.to_dictVsNZZ)3DMM3)G T]]M`M` t//0   r!c>|jjS)zGet configuration items as key-value pairs. Returns: Iterator of (key, value) tuples for all configuration parameters. )r6itemsr.s r"r8zCartesiaLiveOptions.itemses ||~##%%r!Ncjt||r t||S|jj||S)zGet a configuration value by key. Args: key: The configuration parameter name to retrieve. default: Default value if key is not found. Returns: The configuration value or default if not found. )hasattrgetattrr-get)r.keydefaults r"r=zCartesiaLiveOptions.getms4 4 4% %%%))#w77r!json_strreturnc8|ditj|S)zCreate options from JSON string. Args: json_str: JSON string containing configuration parameters. Returns: New CartesiaLiveOptions instance with parsed parameters. r )jsonloads)clsr@s r" from_jsonzCartesiaLiveOptions.from_json{s*TZZ)**r!N)rrrrrENr4r3intr0r6r8r= classmethodrFr r!r"r$r$6s~# ))# (( (  (  (0 & 8 + +)> + +r!r$cfeZdZUdZeZeed<dddddeddeded ed e e d e e d e ed e e ffdZ defdZdeffd Zdeffd Zdeffd ZdZdedeffd ZdedeedffdZfdZfdZdede ee!fffd Z"dZ#dZ$d Z%d!Z&d"Z'e( d(d#ed$ed%e e)fd&Z*d'Z+xZ,S))CartesiaSTTServicea+Speech-to-text service using Cartesia Live API. Provides real-time speech transcription through WebSocket connection to Cartesia's Live transcription service. Supports both interim and final transcriptions with configurable models and languages. Cartesia disconnects WebSocket connections after 3 minutes of inactivity. The timeout resets with each message (audio data or text command) sent to the server. Silence-based keepalive is enabled by default to prevent this. See: https://docs.cartesia.ai/api-reference/stt/stt _settingsr&N)base_urlr*r+ live_optionssettingsttfs_p99_latencyapi_keyrOr*r+rPrQrRc tdtjj} |t dt|s|j r| |j }|j r |j }|jr|j| _|jr/|j} t| tr | jn| | _|| j|t |0d ||dd| d|||_ |xsd|_d|_||_y) a-Initialize CartesiaSTTService with API key and options. Args: api_key: Authentication key for Cartesia API. base_url: Custom API endpoint URL. If empty, uses default. encoding: Audio encoding format. Defaults to "pcm_s16le". sample_rate: Audio sample rate in Hz. If None, uses the pipeline sample rate. live_options: Configuration options for transcription service. .. deprecated:: 0.0.105 Use ``settings=CartesiaSTTSettings(...)`` for model/language and direct init parameters for encoding/sample_rate instead. settings: Runtime-updatable settings. When provided alongside deprecated parameters, ``settings`` values take precedence. ttfs_p99_latency: P99 latency from speech end to final transcript in seconds. Override for your deployment. See https://github.com/pipecat-ai/stt-benchmark **kwargs: Additional arguments passed to parent STTService. r%)r(r)NrPx)r+rRkeepalive_timeoutkeepalive_intervalrQzapi.cartesia.air )rrrHr4rr+r*r(r)r2 apply_updatesuperr0_api_key _base_url _receive_task _encoding) r.rSrOr*r+rPrQrRr/default_settingslang __class__s r"r0zCartesiaSTTService.__init__sB/[[&&   # ">3F G++ 0C".":":K((+44H%%-9-?-?$*(('00D>Hx>X ^b$-    ) )( 3  #-!!%      !6%6!"r!rAcy)zCheck if the service can generate processing metrics. Returns: True, indicating metrics are supported. Tr r9s r"can_generate_metricsz'CartesiaSTTService.can_generate_metricss r!framectKt||d{|jd{y77w)zStart the STT service and establish connection. Args: frame: Frame indicating service should start. N)rZstart_connectr.rdras r"rfzCartesiaSTTService.starts3 gmE"""mmo #848688ctKt||d{|jd{y77w)z{Stop the STT service and close connection. Args: frame: Frame indicating service should stop. N)rZstop _disconnectrhs r"rkzCartesiaSTTService.stops6 gl5!!!    " rictKt||d{|jd{y77w)zCancel the STT service and close connection. Args: frame: Frame indicating service should be cancelled. N)rZcancelrlrhs r"rnzCartesiaSTTService.cancels6 gnU###    $ ric@K|jd{y7w)zBStart performance metrics collection for transcription processing.N)start_processing_metricsr9s r"_start_metricsz!CartesiaSTTService._start_metricss++---s  directionclKt|||d{t|tr|j d{yt|t rX|j rK|j jtjur$|j jdd{yyyy77p7 w)zProcess incoming frames and handle speech events. Args: frame: The frame to process. direction: Direction of frame flow in the pipeline. Nfinalize) rZ process_framer2rrqr _websocketstaterOPENsend)r.rdrrras r"ruz CartesiaSTTService.process_framesg#E9555 e8 9%%' ' ' : ;4??#8#8EJJ#Foo**:666$G< 6 (7s3B4B.'B4B0A%B4%B2& B40B42B4audiocK|jr&|jjtjur|j d{|jj |d{dy7-7 w)zProcess audio data for speech-to-text transcription. Args: audio: Raw audio bytes to transcribe. Yields: None - transcription results are handled via WebSocket responses. N)rvrwrCLOSEDrgry)r.rzs r"run_sttzCartesiaSTTService.run_sttsY$//"7"75<<"G--/ ! !oo""5)))  ")s$AA:A6 "A:+A8, A:8A:cK|jd{t| d{|jr=|js0|j |j |j|_yyy7d7PwrG)_connect_websocketrZrgrvr] create_task_receive_task_handler _report_errorr.ras r"rgzCartesiaSTTService._connect'sm%%'''g   ??4#5#5!%!1!1$2L2LTM_M_2`!aD $6? ( s BA<BA>AB>BcKt|d{|jr*|j|jd{d|_|j d{y7S7&7 wrG)rZrlr] cancel_task_disconnect_websocketrs r"rlzCartesiaSTTService._disconnect/sfg!###   ""4#5#56 6 6!%D ((*** $ 7 +s3A/A).A/A+A/#A-$A/+A/-A/deltacdKt||d{}|j||S7w)zApply a settings delta. Args: delta: A :class:`STTSettings` (or ``CartesiaSTTSettings``) delta. Returns: Dict mapping changed field names to their previous values. N)rZ_update_settings _warn_unhandled_updated_settings)r.rchangedras r"rz#CartesiaSTTService._update_settings8s5077 --g68s 0.0cK |jr'|jjtjuryt j d|j j|j j|jt|jd}d|jdtjj|}d|j d}t#||d{|_|j%dd{y7#7#t&$r)}|j)d || d{7Yd}~yd}~wwxYww) NzConnecting to Cartesia STTr'zwss://z/stt/websocket?z 2025-04-16)zCartesia-Versionz X-API-Key)additional_headers on_connectedzUnknown error occurred:  error_msg exception)rvrwrrxrdebugrMr(r)r^r3r+r\urllibparse urlencoder[websocket_connect_call_event_handler Exception push_error)r.r5ws_urlheaderses r"rz%CartesiaSTTService._connect_websocketMs Y4??#8#8EJJ#F LL5 6-- NN33 NN"4#3#34 F dnn-_V\\=S=STZ=[<\]F+7dmmTG$5fQX$YYDO**>: : :Z : Y//.Fqc,JVW/X X X YsiE2DEB/D&D 'DD D E D D ED;0D31D;6E;EEcK |jr]|jjtjur7t j d|jj d{d|_|jdd{y7%#t$r)}|jd||d{7Yd}~Pd}~wwxYw7<#d|_|jdd{7wxYww)NzDisconnecting from Cartesia STTzError closing websocket: ron_disconnected) rvrwrrxrrcloserrr)r.rs r"rz(CartesiaSTTService._disconnect_websocketas >4??#8#8EJJ#F >?oo++---#DO**+<= = = . Z//.Gs,KWX/Y Y Y Z >#DO**+<= = =swC-A$B(B)B-C-C C-B CB=2B53B=8C=CCC-C*#C&$C**C-cH|jr |jStd)NzWebsocket not connected)rvrr9s r"_get_websocketz!CartesiaSTTService._get_websocketls ???? "122r!c\K|j23d{} tj|}|j|d{9747#tj$rt j d|Yjt$r"}t jd|Yd}~d}~wwxYw6yw)z$Process incoming WebSocket messages.NzReceived non-JSON message: zError processing message: ) rrCrD_process_responseJSONDecodeErrorrwarningrerror)r.messagedatars r"_receive_messagesz$CartesiaSTTService._receive_messagesqs!002 ? ?' ?zz'*,,T222 ?3'' H!> ? 3sfB,B*A B*B,)AAA B, B*A+B';B,=B'B"B,"B''B,cKd|vrX|ddk(r|j|d{y|ddk(r-|jdd}|j|d{yyy7<7 w)Ntype transcriptrrz Unknown error)r)_on_transcriptr=r)r.rrs r"rz$CartesiaSTTService._process_response|sp T>F||+))$///f( HHY@ oo o:::) /;s!!A$A 4A$A"A$"A$ris_finalr)c Kyw)z+Handle a transcription result with tracing.Nr )r.rrr)s r"_handle_transcriptionz(CartesiaSTTService._handle_transcriptions sc 0Kd|vry|jdd}|jdd}d}d|vr t|d}t |dkDr|rm|j t ||jt||d{|j|||d{|jd{y|j t||jt||d{yy#ttf$rYwxYw77o7Y7!w)NtextrNrFr)r)result) r=r ValueErrorKeyErrorlen push_framer _user_idrrstop_processing_metricsr )r.rrrr)s r"rz!CartesiaSTTService._on_transcripts-   XXfb) 88J.   #D$45 z?Q oo&" (* # 00XxPPP22444oo-" (* #  )   Q4sk0DC9ADDD D!D8D99D2D3D9D D D  DDDDrG)-rrrrrSettings__annotations__rr3rrIr$floatr0boolrcr rfr rkrrnrqr rrubytesrr}rgrlrdictrrrrrrrrrrr __classcell__)ras@r"rLrLsn #H"" #%)6:26,=F"F" F"  F" c] F"23F"./F"#5/F"Pd!!!+!.77>7 5^E4K-H b+KDcN*Y( >3 ?;NR  )- 9A(9K  %r!rL)0rrC urllib.parser dataclassesrtypingrrrlogururpipecat.frames.framesrr r r r r rr"pipecat.processors.frame_processorrpipecat.services.settingsrrpipecat.services.stt_latencyrpipecat.services.stt_servicerpipecat.transcriptions.languagerpipecat.utils.timer(pipecat.utils.tracing.service_decoratorsrwebsockets.asyncio.clientrrwebsockets.protocolrModuleNotFoundErrorrrrrr$rLr r!r"rs  !00   >I:<4/?,F)  +   O+O+di,i,FLL;qc"#FLL\] &qc* ++,s" BC2C  C