qidZddlZddlZddlZddlZddlZddlZddlmZm Z ddl m Z m Z m Z mZmZmZddlZddlmZddlmZddlmZmZddlmZmZdd lmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)dd l*m+Z+dd l,m-Z-dd l.m/Z/m0Z0m1Z1m2Z2dd l3m4Z4m5Z5ddl6m7Z7ddl8m9Z9m:Z:ddl;mZ>m?Z?m@Z@mAZAddlBmCZC ddlDmZMeGddZNGdde:ZOGdd e4ZPGd!d"e2ZQGd#d$e0ZRy#eH$r7ZIejdeIejdeKdeIdZI[IwwxYw)%zAnthropic AI service integration for Pipecat. This module provides LLM services and context management for Anthropic's Claude models, including support for function calling, vision, and prompt caching features. N) dataclassfield)AnyDictListLiteralOptionalUnion)logger)Image) BaseModelField)AnthropicLLMAdapterAnthropicLLMInvocationParams) FrameFunctionCallCancelFrameFunctionCallInProgressFrameFunctionCallResultFrameLLMContextFrameLLMEnablePromptCachingFrameLLMFullResponseEndFrameLLMFullResponseStartFrameLLMMessagesFrameLLMThoughtEndFrameLLMThoughtStartFrameLLMThoughtTextFrameUserImageRawFrame) LLMTokenUsage) LLMContext)LLMAssistantAggregatorParamsLLMAssistantContextAggregatorLLMUserAggregatorParamsLLMUserContextAggregator)OpenAILLMContextOpenAILLMContextFrame)FrameDirection)FunctionCallFromLLM LLMService NOT_GIVEN) LLMSettings _NotGiven_warn_deprecated_paramis_given) traced_llm)r*APITimeoutErrorAsyncAnthropicNotGivenz Exception: zKIn order to use Anthropic, you need to `pip install pipecat-ai[anthropic]`.zMissing module: c<eZdZUdZedezed<dZee ed<y)AnthropicThinkingConfigaPConfiguration for extended thinking. Parameters: type: Type of thinking mode (currently only "enabled" or "disabled"). budget_tokens: Maximum number of tokens for thinking. With today's models, the minimum is 1024. Currently required when type is "enabled", not allowed when "disabled". )enableddisabledtypeN budget_tokens) __name__ __module__ __qualname____doc__rstr__annotations__r8r intP/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/anthropic/llm.pyr4r4Hs* ' (3 ..$(M8C='rAr4cveZdZUdZedZeezed<edZ e ezed<e fdZ xZ S)AnthropicLLMSettingszSettings for AnthropicLLMService. Parameters: enable_prompt_caching: Whether to enable prompt caching. thinking: Extended thinking configuration. ctSN _NOT_GIVENr@rArBzAnthropicLLMSettings.dsJrAdefault_factoryenable_prompt_cachingctSrFrGr@rArBrIzAnthropicLLMSettings.esR\rAthinkingct||}t|jr4t |jt rt di|j|_|S)zConvert a plain dict to settings, coercing thinking dicts. For backward compatibility, a ``thinking`` value that is a plain dict is converted to a :class:`AnthropicThinkingConfig`. r@)super from_mappingr.rN isinstancedictr4)clssettingsinstance __class__s rBrQz!AnthropicLLMSettings.from_mappinggsL7'1 H%% &:h6G6G+N 7 L(:K:K LH rA)r9r:r;r<rrLboolr,r>rNr4 classmethodrQ __classcell__rWs@rBrDrD[sH/4DV.W4)+W49J\4]H% 1]  rArDc6eZdZUdZded<ded<d dZd dZy) AnthropicContextAggregatorPaira/Pair of context aggregators for Anthropic conversations. Encapsulates both user and assistant context aggregators to manage conversation flow and message formatting. .. deprecated:: 0.0.99 `AnthropicContextAggregatorPair` is deprecated and will be removed in a future version. Use the universal `LLMContext` and `LLMContextAggregatorPair` instead. See `OpenAILLMContext` docstring for migration guide. Parameters: _user: The user context aggregator. _assistant: The assistant context aggregator. AnthropicUserContextAggregator_user#AnthropicAssistantContextAggregator _assistantc|jS)zmGet the user context aggregator. Returns: The user context aggregator instance. )r_selfs rBuserz#AnthropicContextAggregatorPair.users zzrAc|jS)zwGet the assistant context aggregator. Returns: The assistant context aggregator instance. )rarcs rB assistantz(AnthropicContextAggregatorPair.assistants rAN)returnr^)rhr`)r9r:r;r<r>rergr@rArBr]r]ts  ,+55rAr]ceZdZUdZeZeed<eZe Z Gdde Z dddddddd e d ee d ee d eed eedeef fdZdefdZdZ d'deezdeedee dee fdZeeddedededefdZdeezdefdZedeezfdZde de!ffd Z"d e defd!Z#d"ed#ed$ed%efd&Z$xZ%S)(AnthropicLLMServiceaLLM service for Anthropic's Claude models. Provides inference capabilities with Claude models including support for function calling, vision processing, streaming responses, and prompt caching. Can use custom clients like AsyncAnthropicBedrock and AsyncAnthropicVertex. _settingsc,eZdZUdZdZeeed<dZeeed<e ddZ ee ed<e d d d Z ee ed <e ddZee ed<e dd d Zee ed<e dZeeed<e eZeeeefed<dZy)AnthropicLLMService.InputParamsaInput parameters for Anthropic model inference. .. deprecated:: 0.0.105 Use ``AnthropicLLMSettings`` instead. Pass settings directly via the ``settings`` parameter of :class:`AnthropicLLMService`. Parameters: enable_prompt_caching: Whether to enable the prompt caching feature. enable_prompt_caching_beta (deprecated): Whether to enable the beta prompt caching feature. .. deprecated:: 0.0.84 Use the `enable_prompt_caching` parameter instead. max_tokens: Maximum tokens to generate. Must be at least 1. temperature: Sampling temperature between 0.0 and 1.0. top_k: Top-k sampling parameter. top_p: Top-p sampling parameter between 0.0 and 1.0. thinking: Extended thinking configuration. Enabling extended thinking causes the model to spend more time "thinking" before responding. It also causes this service to emit LLMThinking*Frames during response generation. Extended thinking is disabled by default. extra: Additional parameters to pass to the API. NrLenable_prompt_caching_betacy)Nr@r@rArBrIz(AnthropicLLMService.InputParams.srA)rKge max_tokensctSrFr)r@rArBrIz(AnthropicLLMService.InputParams.sYrAgg?)rKrrle temperaturectSrFr)r@rArBrIz(AnthropicLLMService.InputParams.sYrArtop_kctSrFr)r@rArBrIz(AnthropicLLMService.InputParams.syrAtop_pctSrFr)r@rArBrIz(AnthropicLLMService.InputParams.sT]rArJrNextracx|j.ddl}|jd|jdtdyy)z4Post-initialization to handle deprecated parameters.NralwaysLenable_prompt_caching_beta is deprecated. Use enable_prompt_caching instead. stacklevel)rnwarnings simplefilterwarnDeprecationWarning)rd_InputParams__contextrs rBmodel_post_initz/AnthropicLLMService.InputParams.model_post_inits>..:%%h/ b&  ;rA)r9r:r;r<rLr rXr>rnrrsr?rvfloatrxrzrNr4rSr|rr=rrr@rArB InputParamsrms 015x~459"HTN9$),1$M HSMM',=NSV[^'_ Xe__$5F1Mx}M!&7HSUX!YxY6;L]6^(23^*/*ExS#X'E rArNg@F)modelparamsrUclientretry_timeout_secsretry_on_timeoutapi_keyrrrUrrc tddddtttdddddti} |tdtd|| _| tdt|s|j| _|j | _|j | _|j| _|j| _t|jtr|j| _ |j} |jTddl} | j5| j!d | j#d t$d ddd| |j} | xsd| _ || j'|t) |Tdd | i||xs t-||_||_||_|j4j6r/t9j:|d|j4j6yy#1swYxYw)aInitialize the Anthropic LLM service. Args: api_key: Anthropic API key for authentication. model: Model name to use. .. deprecated:: 0.0.105 Use ``settings=AnthropicLLMSettings(model=...)`` instead. params: Optional model parameters for inference. .. deprecated:: 0.0.105 Use ``settings=AnthropicLLMSettings(...)`` instead. settings: Runtime-updatable settings for this service. When both deprecated parameters and *settings* are provided, *settings* values take precedence. client: Optional custom Anthropic client instance. retry_timeout_secs: Request timeout in seconds for retry logic. retry_on_timeout: Whether to retry the request once if it times out. **kwargs: Additional arguments passed to parent LLMService. zclaude-sonnet-4-6NrpF)rsystem_instructionrsrLrvrxrzfrequency_penaltypresence_penaltyseedfilter_incomplete_user_turnsuser_turn_completion_configrNr|rrrr~rrrrU)rz: Using system instruction: r@)rDr*r-rrsrvrxrzrNrRr|rSrLrnrcatch_warningsrrr apply_updaterP__init__r1_client_retry_timeout_secs_retry_on_timeoutrkrr debug) rdrrrrUrrrkwargsdefault_settingsrLrrWs rBrzAnthropicLLMService.__init__sF0%#"'!"!).(, $   "7,@' J%*  "   "8-A B.4.?.? +/5/A/A ,)/ &)/ &,2OO )fllD1-3\\$*(.(D(D%44@#!002 --h7 A.'( &-4060Q0Q-9N9WRW 6    ) )( 3 ="2=f= "  $6 !1 >> , , LLD6!=dnn>_>_=`a b --s *GG'rhcy)zCheck if this service can generate usage metrics. Returns: True, as Anthropic provides detailed token usage metrics. Tr@rcs rBcan_generate_metricsz(AnthropicLLMService.can_generate_metrics;s rAcFK|jr2 tj|di||jd{}|S|di|d{}|S7#ttj f$r.t j|d|di|d{7}|cYSwxYw7Rw)zCreate message stream with optional timeout and retry. Args: api_call: The Anthropic API method to call. params: Parameters for the API call. Returns: Async stream of message events. )timeoutNz*: Retrying message creation due to timeoutr@)rasynciowait_forrr0 TimeoutErrorr r)rdapi_callrresponses rB_create_message_streamz*AnthropicLLMService._create_message_streamCs  ! ! !(!1!1&v&0H0H" &///HO$W%9%9:  v%OPQ!)!3F!333  0sP B!*AAA B! B B!Az4AnthropicLLMService.run_inference..sXEPVAWUZZXs%%r@)r*rRrget_llm_adapterget_llm_invocation_paramsrkrLAnthropicLLMContextupgrade_to_anthropicrgetattrrr warningrrsrvrxrzrN model_dumpupdater|rbetacreatenextcontent) rdrrsrrrradapterinvocation_paramsrrs rB run_inferencez!AnthropicLLMService.run_inference\s$ gz *+/+?+?+AG ' A At~~/S/S!B! )4H&x0F%g.E)>>wGG''HWh :FMM'RE  )& 1f11(F^^))(2(>*DNND]D]>>55^^))^^)) 78   >> " "!%!8!8!C!CRV!C!WF:  dnn**+;**33::DVDDXX-=-=XZ^__EsGG=G;"G=) user_paramsassistant_paramsrrc|j|jt|trtj |}t ||}t||}t||S)aECreate Anthropic-specific context aggregators. Creates a pair of context aggregators optimized for Anthropic's message format, including support for function calls, tool usage, and image handling. Args: context: The LLM context. user_params: User aggregator parameters. assistant_params: Assistant aggregator parameters. Returns: A pair of context aggregators, one for the user and one for the assistant, encapsulated in an AnthropicContextAggregatorPair. .. deprecated:: 0.0.99 `create_context_aggregator()` is deprecated and will be removed in a future version. Use the universal `LLMContext` and `LLMContextAggregatorPair` instead. See `OpenAILLMContext` docstring for migration guide. )r)r_ra) set_llm_adapterrrRr$rfrom_openai_contextr^r`r])rdrrrrergs rBcreate_context_aggregatorz-AnthropicLLMService.create_context_aggregators^4  4 4 67 g/ 0)==gFG.gkJ7HXY -DYOOrAct|tr|j}|j||jj }|jj r<|dturtj|d|jj |d<|S|jj r|jn |j}t|j||jxsgS)Nrrr)rrr)rRrrrrkrLrr*r r'get_messages_with_cache_control_markersrrrr)rdrrrrs rB_get_llm_invocation_paramsz.AnthropicLLMService._get_llm_invocation_paramss gz *+/+?+?+AG3:3T3Tt~~/S/S4U4F~~00(#94NN&!::$(>>#D#Dx M ~~33  ; ; =!!  ,>>--%2  rAc "Kd}d}d}d}d}d} |jtd{|jd{|j|}t |t r$|j } d} | j|} nd} |j} tj|d| d|dd| |jd{|jj|jjd |jj|jj|jj d } |jj"r)|jj"j%d | d <| j'|| j'|jj(| j'd dgi|j+|j,j.j0j2| d{} |j5d{d}d}g}| 23d{}|j6dk(rgt9|j:drW|j=|j:j>d{||jA|j:j>z }nt9|j:drE|rC||j:jBz }||jA|j:jBz }nt9|j:d r9|jtE|j:j"d{nht9|j:drQ|jtG|j:jHd{n|j6dk(r~|jJj6dk(r|jJ}d}n|jJj6d k(r|jtMd |j jNd{n|j6dk(r|t9|j:drf|j:jPdk(rM|rK|rtSjT|ni}|jWtY||jZ|j\|t9|drd|t9|j^dr|j^j`ndz }|t9|j^dr|j^jbndz }t9|dst9|jdds.|t9|jdj^dr |jdj^j`ndz }|t9|jdj^dr |jdj^jbndz }|t9|jdj^d r@|jdj^jf |jdj^jfndz }tjd!||t9|jdj^d"r@|jdj^jh |jdj^jhndz }tjd#|||z|z}|d$k\st9|d%s|xjjd&z c_5777I77777776|jm|d{7nx#tnjp$rd }trjt$r|jwd'd{7Yn4tx$r)}|j{d(||)d{7Yd}~nd}~wwxYw|j}d{7|jtd{7|s|n|}|j||||*d{7y#|j}d{7|jtd{7|s|n|}|j||||*d{7wxYww)+NrF universalz LLM-specificz: Generating chat from z context [rz] | T)rrsrrvrxrzrrNrrcontent_block_deltar partial_jsonr signature)rcontent_block_starttool_use)append_to_contextllm message_delta stop_reason)r tool_call_id function_name argumentsusage input_tokens output_tokensmessagecache_creation_input_tokenszCache creation input tokens: cache_read_input_tokenszCache read input tokens: iturns_above_cache_thresholdrqon_completion_timeoutzUnknown error occurred: ) error_msg exception) prompt_tokenscompletion_tokensrr)A push_framerstart_processing_metricsrrRrrget_messages_for_loggingr rstart_ttfb_metricsrkrrsrvrxrzrNrrr|rrrrrstop_ttfb_metricsr7rdelta_push_llm_textr_estimate_tokensrrrr content_blockrid_for_llm_specific_messagesrjsonloadsappendr'idnamerrrrrrrrun_function_callsrCancelledErrorhttpxTimeoutException_call_event_handler Exception push_errorstop_processing_metricsr_report_usage_metrics)rdrrrcompletion_tokens_estimateuse_completion_tokens_estimaterrparams_from_contextrcontext_type_for_loggingmessages_for_loggingrrtool_use_blockjson_accumulatorfunction_callseventargstotal_input_tokense comp_tokenss rB_process_contextz$AnthropicLLMService._process_contexts  %&").&&'#"#f //";"=> > >//1 1 1"&"A"A'"J ':...0+6('.'G'G'P$+9('.'G'G'I$ LL&/0H/ITghpTqSrrvxLwMN ))+ + +--"nn77#~~99---- F~~&&%)^^%<%<%G%GVZ%G%[z" MM- . MM$.... / MM7%F$GH I!889J9J9S9S9Z9Z\bccH((* * *"N! N'X EX Ee::!66u{{F3"11%++2B2BCCC2d6K6KEKKL\L\6]]2 n=.(EKK,D,DD(2d6K6K!KK4472!j9"oo.Au{{G[G[.\]]] k:"oo.@5;;K`K`.abbbZZ#88**//:=).)<)<+-(,,11Z?"oo026$($8$8$:$W$WJJ/1 ]; //:=%?Otzz*:;UW&--/(/-;->->.<.A.A*. 5'*!4;EKK4X 00^_M&5`+_`+ b_!!b`#b$`'%b+b ?a!b !a$"#b bb  bframe directioncTKt|||d{d}t|tr tj |j }nt|tr |j }nt|tr tj|j}nit|tr?tjd|jd|j|j_n|j#||d{|r|j%|d{yy7 7$7 w)a,Process incoming frames and route them appropriately. Handles various frame types including context frames, message frames, vision frames, and settings updates. Args: frame: The frame to process. direction: The direction of frame processing. Nz#Setting enable prompt caching to: [])rP process_framerRr%rrrrr from_messagesrrr renablerkrLrr)rdrrrrWs rBrz!AnthropicLLMService.process_framesg#E9555 e2 3-@-U-UV[VcVc-dG  /mmG / 0*77GG : ; LL>u||nAN O38<> F..v6 6 6' 7s 0;9;)NN)&r9r:r;r<rDSettingsr>r adapter_classr4ThinkingConfigr rr=r rrXrrrrr$r?rr"r r]rrrr/rrr&rrrrZr[s@rBrjrjs$H##(M-N,i,d $(,37.1+0`c`c} `c % `c /0 `c%UO`c#4.`cDd8%),0 A`..A`SMA`%SM A` # A`N0G/H9U9W #P!#P- #P 7 #P ( #PJ '*4 % <r.>.Krrh11>1<9S9S9777&) 7 "% 7rArjc DeZdZdZ deddeeedeeedeedee e fffdZ d Z e d ed dfd Zed efdZedeed dfdZdefdZdZdZddde deeefdede fdZdZd eefdZdZfdZd eee effdZ xZ!S)raLLM context specialized for Anthropic's message format and features. Extends OpenAILLMContext to handle Anthropic-specific features like system messages, prompt caching, and message format conversions. Manages conversation state and message history formatting. .. deprecated:: 0.0.99 `AnthropicLLMContext` is deprecated and will be removed in a future version. Use the universal `LLMContext` and `LLMContextAggregatorPair` instead. See `OpenAILLMContext` docstring for migration guide. N)rrr tool_choicercXt|||||j||_y)aInitialize the Anthropic LLM context. Args: messages: Initial list of conversation messages. tools: Available function calling tools. tool_choice: Tool selection preference. system: System message content. rrr*N)rPr!_AnthropicLLMContext__setup_localr)rdrrr*rrWs rBrzAnthropicLLMContext.__init__s," (%[Q  rAcd|_y)Nr)rrcs rB __setup_localz!AnthropicLLMContext.__setup_locals ,-(rAobjrhctjd|t|tr;t|ts+t|_|j |j|S)a Upgrade an OpenAI context to Anthropic format. Converts message format and restructures content for Anthropic compatibility. Args: obj: The OpenAI context to upgrade. Returns: The upgraded Anthropic context. zUpgrading to Anthropic: )r rrRr$rrWr-!_restructure_from_openai_messages)r0s rBrz(AnthropicLLMContext.upgrade_to_anthropicsQ  /u56 c+ ,ZEX5Y/CM      1 1 3 rAopenai_contextc||j|j|j}|j|j |j |S)zCreate Anthropic context from OpenAI context. Args: openai_context: The OpenAI context to convert. Returns: New Anthropic context with converted messages. r,)rrr*rrr2)rTr3rds rBrz'AnthropicLLMContext.from_openai_context sS#,, &&&22  ^;;=> ..0 rAc8||}|j|S)zCreate context from a list of messages. Args: messages: List of conversation messages. Returns: New Anthropic context with the provided messages. )r)r2)rTrrds rBrz!AnthropicLLMContext.from_messagessH% ..0 rAcPd|_||jdd|jy)zzSet the messages list and reset cache tracking. Args: messages: New list of messages to set. rN)r _messagesr2)rdrs rB set_messagesz AnthropicLLMContext.set_messages-s& ,-($q ..0rAc ,|jd}|jd}|dk(rt|tr |d|dgdgSt|trg}g}|D]_}|ddk(r|j d|dd#|ddk(s,|j d |d |d t j |d d dag}|r|j ||d|r|j ||d|Sy|dk(rt|tr |d|dgdgSt|trzg}g}|D]F}|ddk(r|j d|dd#|ddk(s,|j d|d|ddHg}|r|j ||d|j||Syy)aConvert Anthropic message format to standard structured format. Handles text content and function calls for both user and assistant messages. Args: obj: Message in Anthropic format. Returns: List of messages in standard format. Examples: Input Anthropic format:: { "role": "assistant", "content": [ {"type": "text", "text": "Hello"}, {"type": "tool_use", "id": "123", "name": "search", "input": {"q": "test"}} ] } Output standard format:: [ {"role": "assistant", "content": [{"type": "text", "text": "Hello"}]}, { "role": "assistant", "tool_calls": [ { "type": "function", "id": "123", "function": {"name": "search", "arguments": '{"q": "test"}'} } ] } ] rolerrgrr7rr:rr7rfunctionrrinput)rr)r7rr=)r: tool_callsre tool_resulttool tool_use_id)r:rrN)getrRr=listrrdumpsextend)rdr0r:r text_items tool_itemsitemrs rBto_standard_messagesz(AnthropicLLMContext.to_standard_messages7sPwwv'')$ ; '3'!%FG3T2UVWWGT*  # DF|v-"))64<*PQf3"))(2&*4j,0L15DM1J-"  OOTj$IJOOT$LM-+.V^'3'!%FG3T2UVWWGT*  # DF|v-"))64<*PQf6"))(.04]0C+/ ? OOTj$IJ +%+rAc|ddk(rdd|d|ddgdS|jd rQ|d }d gd}|D]@}|d }tj|d }d |d|d|d}|dj|B|S|jd}t |t r |dk(rd}|St |t r|D]} | ddk(s | ddk(sd| d<|S)aHConvert standard format message to Anthropic format. Handles conversion of text content, tool calls, and tool results. Empty text content is converted to "(empty)". Args: message: Message in standard format. Returns: Message in Anthropic format. Examples: Input standard format:: { "role": "assistant", "tool_calls": [ { "id": "123", "function": {"name": "search", "arguments": '{"q": "test"}'} } ] } Output Anthropic format:: { "role": "assistant", "content": [ { "type": "tool_use", "id": "123", "name": "search", "input": {"q": "test"} } ] } r:rArer@rrr7rBrr<r?rgr=rrrrr7rrr>r(empty)r7r)rCrrrrRr=rD) rdrtcret tool_callr=r new_tool_userrIs rBfrom_standard_messagez)AnthropicLLMContext.from_standard_messages/P 6?f $!.'.~'>#*9#5   ;;| $&B&26C 4 $Z0 JJx '<= &#D/$V,&   I%%l3 4J++i( gs #"}#   & -<6)d6lb.@#,DL -rArformatsizeimagercHtj}tj|||j |dt j |jjd}ddd|ddg}|r|jd |d |jd |d y )aAdd an image message to the context. Converts the image to base64 JPEG format and adds it as a user message with optional accompanying text. Args: format: The image format (e.g., 'RGB', 'RGBA'). size: Image dimensions as (width, height). image: Raw image bytes. text: Optional text to accompany the image. JPEG)rTzutf-8rVbase64z image/jpeg)r7 media_typedata)r7sourcerr;rer<N) ioBytesIOr frombytessaverY b64encodegetvaluedecoder add_message)rdrTrUrVrbuffer encoded_imagers rBadd_image_frame_messagez+AnthropicLLMContext.add_image_frame_messages e,11&1H(():;BB7K  $".)     NNFD9 : &W=>rAc, |jr|jdd|dk(rt|jddtr&d|jdddg|jdd<t|dtr d|ddg|d<|jddj|dy|jj |y|jj |y#t $r"}t jd|Yd}~yd}~wwxYw)aAdd a message to the context, merging with previous message if same role. Anthropic requires alternating roles, so consecutive messages from the same role are merged together. Args: message: The message to add to the context. r:rrr;zError adding message: N)rrRr=rFrrr error)rdrrs rBrdzAnthropicLLMContext.add_messages 7}}==$V,?"$--"3I">D%+T]]25Fy5QR8 b))4 "')"4c:7=wyGY.Z-[ *MM"%i077 8JKMM((1 $$W- 7 LL1!5 6 6 7s$B-C(0C( C(( D1DDc tj|j}|jdk\rC|dddk(r8t |ddt rd|dddg|dd<dd i|dddd <|jd k\rQt |d kDrC|d ddk(r8t |d dt rd|d ddg|d d<dd i|d ddd <|S#t$r.}tjd ||jcYd}~Sd}~wwxYw)aGet messages with prompt caching markers applied. Adds cache control markers to appropriate messages based on the number of turns above the cache threshold. Returns: List of messages with cache control markers added. rqrir:rerrr;r7 ephemeral cache_controlrz#Error adding cache control marker: N) copydeepcopyrrrRr=rrr rj)rdrrs rBrz;AnthropicLLMContext.get_messages_with_cache_control_markers!s8 !}}T]]3H//14"f9MQW9Whrl95s;8>QS U^H_/`.aHRL+@F ?T Y'+O<00A5MA%RL(F2hrl95s;8>QS U^H_/`.aHRL+@F ?T Y'+O<O ! LL>qcB C==  !sCC D #DD D cT |jDcgc]}|j|c}|jdd|j rr|j dddk(r]t |j dk(rd|j dd<n2|j dd|_|j jdd}|t |j dz kr|j |}|j |dz}|d|dk(rtt|dtr d|dd g|d<t|dtr d|dd g|d<|dj|d|j j|dzn|dz }|t |j dz kr|j D]R}t|dtr|dd k(rd |d<$t|dts8t |ddk(sJdd d g|d<Tycc}w#t$r#}tjd|Yd}~d}~wwxYw) NzError mapping messages: rr:rrqrerrr;rrN) r7rSrr rjrrrpoprRr=rFrD)rdmricurrent_message next_messagers rBr2z5AnthropicLLMContext._restructure_from_openai_messages=s( 9HL W1!;!;A!> WDNN1  ==T]]1-f5A4==!Q&,2 a (#mmA.y9  !!!$ #dmm$q(("mmA.O==Q/Lv&,v*>>oi8#>!'1KL2OI.l95s;8> U^H_/`.aL+ *11,y2IJ !!!a%(Q!#dmm$q((&}} KG'),c2wy7IR7O%. "GI.5#gi>P:QUV:V/5y&I%J "  KM!X 9 LL3A37 8 8 9s'G;G6G;6G;; H'H""H'czt|}|jr|jdd|jd|S)zGet messages formatted for persistent storage. Includes system message at the beginning if present. Returns: List of messages suitable for storage. rrr<)rP#get_messages_for_persistent_storagerinsert)rdrrWs rBrxz7AnthropicLLMContext.get_messages_for_persistent_storagels57>@ ;; OOAT[[I JrAcg}|jD]Z}tj|}d|vr.t|dtr|dD]}|ddk(s d|dd<|j |\|S)zGet messages formatted for logging with sensitive data redacted. Replaces image data with placeholder text for cleaner logs. Returns: List of messages in a format ready for logging. rr7rVz...r\r[)rrorprRrDr)rdmsgsrmsgrIs rBrz,AnthropicLLMContext.get_messages_for_loggingys}} G--(CCc)nd3 #I;<725:DN62; KK   rA)NNN)"r9r:r;r<r*r rrSr r=r2rr- staticmethodr$rrYrrr8rJrStupler?bytesrgrdrr2rxrrrrZr[s@rBrrs] *.&*&*  (1 4:&T #d^  c8m$ *"27L$1A$ T$Z 4I  1T1Y vK\PT??$)#s(O?rArceZdZdZy)r^aAnthropic-specific user context aggregator. Handles aggregation of user messages for Anthropic LLM services. Inherits all functionality from the base LLMUserContextAggregator. .. deprecated:: 0.0.99 `AnthropicUserContextAggregator` is deprecated and will be removed in a future version. Use the universal `LLMContext` and `LLMContextAggregatorPair` instead. See `OpenAILLMContext` docstring for migration guide. N)r9r:r;r<r@rArBr^r^s   rAr^cTeZdZdZdefdZdefdZdefdZ de de de fd Z de fd Zy ) r`aContext aggregator for assistant messages in Anthropic conversations. Handles function call lifecycle management including in-progress tracking, result handling, and cancellation for Anthropic's tool use format. .. deprecated:: 0.0.99 `AnthropicAssistantContextAggregator` is deprecated and will be removed in a future version. Use the universal `LLMContext` and `LLMContextAggregatorPair` instead. See `OpenAILLMContext` docstring for migration guide. rcKdgd}|djd|j|j|jd|jj ||jj dd|jdd gdy w) zHandle a function call that is starting. Creates tool use message and placeholder tool result for tracking. Args: frame: Frame containing function call details. rgr<rrrMrer@ IN_PROGRESSrLN)rrrr_contextrd)rdrassistant_messages rB handle_function_call_in_progresszDAnthropicAssistantContextAggregator.handle_function_call_in_progresss&1R@)$++"((++    !!"34 !!!.','9'9#0  sBBc(K|jrOtj|j}|j|j|j |d{y|j|j|j dd{y757w)zHandle the result of a completed function call. Updates the tool result with actual return value or completion status. Args: frame: Frame containing function call result. N COMPLETED)resultrrE_update_function_call_resultrr)rdrrs rBhandle_function_call_resultz?AnthropicAssistantContextAggregator.handle_function_call_results} <<ZZ -F33E4G4GI[I[]cd d d33##U%7%7   e s$ABB/BB BBcnK|j|j|jdd{y7w)zHandle cancellation of a function call. Updates the tool result to indicate cancellation. Args: frame: Frame containing function call cancellation details. CANCELLEDN)rrrrdrs rBhandle_function_call_cancelz?AnthropicAssistantContextAggregator.handle_function_call_cancels3//   !3!3[   s +535rrrcK|jjD]=}|ddk(s |dD]*}t|ts|ddk(s|d|k(s&||d<,?yw)Nr:rerr7r@rB)rrrRrS)rdrrrrrs rBrz@AnthropicAssistantContextAggregator._update_function_call_resultsn}}-- 4Gv&(&y14G"7D1#FO}<#M2lB-3 * 4 4s"AAAA Ac8K|j|jj|jjdd{|jj |j |j|j|jjy7Vw)zHandle a user image frame with function call context. Marks the associated function call as completed and adds the image to the conversation context. Args: frame: User image frame with request context. rN)rTrUrVr) rrequestrrrrgrTrUrVrrs rBhandle_user_image_framez;AnthropicAssistantContextAggregator.handle_user_image_frames{// MM ' ')C)C[    --<<++&& .  s?BBABN)r9r:r;r<rrrrrrr=rrrrr@rArBr`r`sX  7N  7N   4  403 4=@ 4 3D rAr`)Sr<rrYror]rr  dataclassesrrtypingrrrrr r rlogurur PILr pydanticr r+pipecat.adapters.services.anthropic_adapterrrpipecat.frames.framesrrrrrrrrrrrrrpipecat.metrics.metricsr*pipecat.processors.aggregators.llm_contextr+pipecat.processors.aggregators.llm_responser r!r"r#1pipecat.processors.aggregators.openai_llm_contextr$r%"pipecat.processors.frame_processorr&pipecat.services.llm_servicer'r(pipecat.services.settingsr*rHr+r,r-r.(pipecat.utils.tracing.service_decoratorsr/ anthropicr0r1r2ModuleNotFoundErrorrrjrr4rDr]rjrr^r`r@rArBrsH  (<< %2A >H=^^?,NN(i(& ; 0 "" "Jr7*r7j{*{|  %=  4g *Gg K#,FLL;qc"#FLL^_ &qc* ++,s8 DE 2EE