qi)8dZddlmZmZddlmZddlmZmZm Z m Z m Z m Z m Z mZmZmZmZmZmZddlmZmZddlmZmZddlmZGdd eZGd d eZGd d eZGddZy)zTranscript processing utilities for conversation recording and analysis. This module provides processors that convert speech and text frames into structured transcript messages with timestamps, enabling conversation history tracking and analysis. )ListOptional)logger) BotStoppedSpeakingFrame CancelFrameEndFrameFrameInterruptionFrameLLMThoughtEndFrameLLMThoughtStartFrameLLMThoughtTextFrameThoughtTranscriptionMessageTranscriptionFrameTranscriptionMessageTranscriptionUpdateFrame TTSTextFrame)FrameDirectionFrameProcessor)TextPartForConcatenationconcatenate_aggregated_text)time_now_iso8601c4eZdZdZfdZdeefdZxZS)BaseTranscriptProcessorzBase class for processing conversation transcripts. Provides common functionality for handling transcript messages and updates. c Tt|di|g|_|jdy)zInitialize processor with empty message store. Args: **kwargs: Additional arguments passed to parent class. on_transcript_updateN)super__init___processed_messages_register_event_handler)selfkwargs __class__s Y/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/processors/transcript_processor.pyrz BaseTranscriptProcessor.__init__+s, "6"?A  $$%;<messagescK|r[|jj|t|}|jd|d{|j |d{yy77w)zwEmit transcript updates for new messages. Args: messages: New messages to emit in update. )r&rN)rextendr_call_event_handler push_frame)r!r& update_frames r$ _emit_updatez$BaseTranscriptProcessor._emit_update5sa   $ $ + +H 53XFL**+A<P P P//,/ / /  Q /s#?A%A!A%A#A%#A%) __name__ __module__ __qualname____doc__rrrr, __classcell__r#s@r$rr%s = 040D+E 0r%rc,eZdZdZdedeffd ZxZS)UserTranscriptProcessorzKProcesses user transcription frames into timestamped conversation messages.frame directionc,Kt|||d{t|trGt d|j |j |j}|j|gd{|j||d{y7v7!7 w)zProcess TranscriptionFrames into user conversation messages. Args: frame: Input frame to process. direction: Frame processing direction. Nuser)roleuser_idcontent timestamp) r process_frame isinstancerrr:textr<r,r*)r!r5r6messager#s r$r=z%UserTranscriptProcessor.process_frameEsg#E9555 e/ 0*U]]EJJRWRaRaG##WI. . .ooeY/// 6 //s4BBAB.B/BB BBB)r-r.r/r0r rr=r1r2s@r$r4r4BsU00>00r%r4cNeZdZdZdddeffdZdZdZded e ffd Z xZ S) AssistantTranscriptProcessoralProcesses assistant TTS text frames and LLM thought frames into timestamped messages. This processor aggregates both TTS text frames and LLM thought frames into complete utterances and thoughts, emitting them as transcript messages. An assistant utterance is completed when: - The bot stops speaking (BotStoppedSpeakingFrame) - The bot is interrupted (InterruptionFrame) - The pipeline ends (EndFrame, CancelFrame) A thought is completed when: - The thought ends (LLMThoughtEndFrame) - The bot is interrupted (InterruptionFrame) - The pipeline ends (EndFrame, CancelFrame) Fprocess_thoughtsrDc xt|di|||_g|_d|_g|_d|_d|_y)zInitialize processor with aggregation state. Args: process_thoughts: Whether to process LLM thought frames. Defaults to False. **kwargs: Additional arguments passed to parent class. NFr)rr_process_thoughts_current_assistant_text_parts_assistant_text_start_time_current_thought_parts_thought_start_time_thought_active)r!rDr"r#s r$rz%AssistantTranscriptProcessor.__init__hsE "6"!1MO*9='FH#26 $r%cNK|jr|jrt|j}|rKtjd|t d||j}|j |gd{ntjdg|_d|_yyy7+w)zAggregates and emits text fragments as a transcript message. This method aggregates text fragments that may arrive in multiple TTSTextFrame instances and emits them as a single TranscriptionMessage. z'Emitting aggregated assistant message: assistant)r9r;r<Nz-No content to emit after stripping whitespace)rGrHrrtracerr,r!r;r@s r$_emit_aggregated_assistant_textz7%w)aProcess frames into assistant conversation messages and thought messages. Handles different frame types: - TTSTextFrame: Aggregates text for current utterance - LLMThoughtStartFrame: Begins aggregating a new thought - LLMThoughtTextFrame: Aggregates text for current thought - LLMThoughtEndFrame: Completes current thought - BotStoppedSpeakingFrame: Completes current utterance - InterruptionFrame: Completes current utterance and thought due to interruption - EndFrame: Completes current utterance and thought at pipeline end - CancelFrame: Completes current utterance and thought due to cancellation Args: frame: Input frame to process. direction: Frame processing direction. NT)includes_inter_part_spaces)rr=r>r rr*rPrFrKrRr rrJrIr appendrr?includes_inter_frame_spacesr rrHrGrr)r!r5r6r#s r$r=z*AssistantTranscriptProcessor.process_frames|$g#E9555 e/= >//%3 3 3668 8 8%%$*>*>33555+?% 3 4%%'+$+;+=(.0+//%3 3 3 2 3%%$*>*>++22, u?`?` //%3 3 3 1 2%%$*>*>33555//%3 3 3 | ,222B2D/  . . 5 5(JJ5;\;\ //%3 3 3  7B C668 8 8%*t/E/E$J^J^33555//%3 3 3//%3 3 3q 6 4 85 4 46 3 4 96 3 3sL K'/L K*L K- /L K0AL %K3&AA?L =K?>.L ,L-?L ,L-L LL !L"L *L -L 0L 3L 6L 9L <L ?L L L L L ) r-r.r/r0boolrrPrRr rr=r1r2s@r$rBrBWs? 49%D%"3.).J4J4>J4J4r%rBcFeZdZdZdddefdZdefdZdefdZ d e fd Z y ) TranscriptProcessoraYFactory for creating and managing transcript processors. Provides unified access to user and assistant transcript processors with shared event handling. The assistant processor handles both TTS text and LLM thought frames. Example:: transcript = TranscriptProcessor() pipeline = Pipeline( [ transport.input(), stt, transcript.user(), # User transcripts context_aggregator.user(), llm, tts, transport.output(), transcript.assistant(), # Assistant transcripts (including thoughts) context_aggregator.assistant(), ] ) @transcript.event_handler("on_transcript_update") async def handle_update(processor, frame): print(f"New messages: {frame.messages}") .. deprecated:: 0.0.99 `TranscriptProcessor` is deprecated and will be removed in a future version. Use `LLMUserAggregator`'s and `LLMAssistantAggregator`'s new events instead. FrCrDc||_d|_d|_i|_ddl}|j 5|j d|jdtdddy#1swYyxYw)zInitialize factory. Args: process_thoughts: Whether the assistant processor should handle LLM thought frames. Defaults to False. Nralwaysz`TranscriptProcessor` is deprecated and will be removed in a future version. Use `LLMUserAggregator`'s and `LLMAssistantAggregator`'s new events instead.) rF_user_processor_assistant_processor_event_handlerswarningscatch_warnings simplefilterwarnDeprecationWarning)r!rDr_s r$rzTranscriptProcessor.__init__sk"2#$(!!  $ $ &   ! !( + MM_"    s (A""A+returnc |jUtdi||_|jjD](\}|jj |fd}*|jS)zGet the user transcript processor. Args: **kwargs: Arguments specific to UserTranscriptProcessor. Returns: The user transcript processor instance. c2K||d{S7wNr processorr5handlers r$ user_handlerz.TranscriptProcessor.user..user_handler:!(E!:::: r)r\r4r^items event_handler)r!r" event_namerkrjs @r$r8zTranscriptProcessor.user,sv    '#:#DV#DD '+';';'A'A'C ;# G%%33J?;@; ; ###r%c |jatdd|ji||_|jj D](\}|jj |fd}*|jS)zGet the assistant transcript processor. Args: **kwargs: Arguments specific to AssistantTranscriptProcessor. Returns: The assistant transcript processor instance. rDc2K||d{S7wrgrrhs r$assistant_handlerz8TranscriptProcessor.assistant..assistant_handlerPrlrmr)r]rBrFr^rnro)r!r"rprsrjs @r$rMzTranscriptProcessor.assistant@s  $ $ ,(D)!%!7!7);A)D %(,';';'A'A'C ;# G**88D;E; ; (((r%rpcfd}|S)zRegister event handler for both processors. Args: event_name: Name of event to handle. Returns: Decorator function that registers handler with both processors. cj<jr#jjfd}jr#jjfd}S)Nc2K||d{S7wrgrrhs r$rkzJTranscriptProcessor.event_handler..decorator..user_handlerfrlrmc2K||d{S7wrgrrhs r$rszOTranscriptProcessor.event_handler..decorator..assistant_handlerlrlrm)r^r\ror])rjrkrsrpr!s` r$ decoratorz4TranscriptProcessor.event_handler..decorator`sx/6D  ,##%%33J?;@;((**88D;E;Nr%r)r!rprxs`` r$roz!TranscriptProcessor.event_handlerVs $r%N) r-r.r/r0rWrr4r8rBrMstrrorr%r$rYrYs?B49D,$ 7$()%A),r%rYN) r0typingrrlogururpipecat.frames.framesrrrr r r r r rrrrr"pipecat.processors.frame_processorrrpipecat.utils.stringrrpipecat.utils.timerrr4rBrYrr%r$rsg "NV/0n0:050*Z4#:Z4z~~r%