qifdZddlZddlZddlZddlZddlZddlZddlZddlm Z m Z ddl m Z m Z mZmZddlmZddlmZddlmZmZddlmZmZdd lmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$dd l%m&Z&dd l'm(Z(dd l)m*Z*m+Z+m,Z,m-Z-dd l.m/Z/m0Z0ddl1m2Z2ddl3m4Z4ddl5m6Z6m7Z7m8Z8m9Z9ddl:m;Z; ddlZ>ddl?m@Z@e Gdde7ZEe GddZFGdde/ZGGdde-ZHGdd e+ZIGd!d"e4ZJy#eA$r7ZBejdeBejdeDdeBdZB[BwwxYw)#zAWS Bedrock integration for Large Language Model services. This module provides AWS Bedrock LLM service implementation with support for Amazon Nova and Anthropic Claude models, including vision capabilities and function calling. N) dataclassfield)AnyDictListOptional)logger)Image) BaseModelField)AWSBedrockLLMAdapterAWSBedrockLLMInvocationParams) FrameFunctionCallCancelFrameFunctionCallFromLLMFunctionCallInProgressFrameFunctionCallResultFrameLLMContextFrameLLMFullResponseEndFrameLLMFullResponseStartFrameLLMMessagesFrameUserImageRawFrame) LLMTokenUsage) LLMContext)LLMAssistantAggregatorParamsLLMAssistantContextAggregatorLLMUserAggregatorParamsLLMUserContextAggregator)OpenAILLMContextOpenAILLMContextFrame)FrameDirection) LLMService) NOT_GIVEN LLMSettings _NotGiven_warn_deprecated_param) traced_llm)Config)ReadTimeoutErrorz Exception: zIn order to use AWS services, you need to `pip install pipecat-ai[aws]`. Also, remember to set `AWS_SECRET_ACCESS_KEY`, `AWS_ACCESS_KEY_ID`, and `AWS_REGION` environment variable.zMissing module: ceZdZUdZedZeedzeze d<edZ eeze d<edZ e ee feze d <y) AWSBedrockLLMSettingsaSettings for AWSBedrockLLMService. Parameters: stop_sequences: List of strings that stop generation. latency: Performance mode - "standard" or "optimized". additional_model_request_fields: Additional model-specific parameters. ctSNr#J/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/aws/llm.pyzAWSBedrockLLMSettings.SsQZr0default_factoryNstop_sequencesctSr-r.r/r0r1r2zAWSBedrockLLMSettings.TsYr0latencyctSr-r.r/r0r1r2zAWSBedrockLLMSettings.Vs r0additional_model_request_fields)__name__ __module__ __qualname____doc__rr5rstrr%__annotations__r7r9rrr/r0r1r+r+Is^49IZ3[NDI$y0[$5FGGS9_GBG)C#T#s(^i%?r0r+c6eZdZUdZded<ded<d dZd dZy) AWSBedrockContextAggregatorPaira5Container for AWS Bedrock context aggregators. Provides convenient access to both user and assistant context aggregators for AWS Bedrock LLM operations. .. deprecated:: 0.0.99 `AWSBedrockContextAggregatorPair` is deprecated and will be removed in a future version. Use the universal `LLMContext` and `LLMContextAggregatorPair` instead. See `OpenAILLMContext` docstring for migration guide. Parameters: _user: The user context aggregator instance. _assistant: The assistant context aggregator instance. AWSBedrockUserContextAggregator_user$AWSBedrockAssistantContextAggregator _assistantc|jS)zmGet the user context aggregator. Returns: The user context aggregator instance. )rCselfs r1userz$AWSBedrockContextAggregatorPair.useros zzr0c|jS)zwGet the assistant context aggregator. Returns: The assistant context aggregator instance. )rErGs r1 assistantz)AWSBedrockContextAggregatorPair.assistantws r0N)returnrB)rLrD)r:r;r<r=r?rIrKr/r0r1rArAZs  -,66r0rAc .eZdZdZ ddddeeedeeedeedeeffdZe d e d dfd Z e d e fd Z e deed dfdZdefdZdZdZdddedeeefdedefdZdZdZdZfdZd eeeeffdZxZS)AWSBedrockLLMContextaAWS Bedrock-specific LLM context implementation. Extends OpenAI LLM context to handle AWS Bedrock's specific message format and system message handling. Manages conversion between OpenAI and Bedrock message formats. .. deprecated:: 0.0.99 `AWSBedrockLLMContext` is deprecated and will be removed in a future version. Use the universal `LLMContext` and `LLMContextAggregatorPair` instead. See `OpenAILLMContext` docstring for migration guide. N)systemmessagestools tool_choicerOc8t||||||_y)aDInitialize AWS Bedrock LLM context. Args: messages: List of conversation messages in OpenAI format. tools: List of available function calling tools. tool_choice: Tool selection strategy or specific tool choice. system: System message content for AWS Bedrock. rPrQrRN)super__init__rO)rHrPrQrRrO __class__s r1rVzAWSBedrockLLMContext.__init__s " (%[Q r0objrLctjd|t|tr-t|tst|_|j |S|j|S)zUpgrade an OpenAI LLM context to AWS Bedrock format. Args: obj: The OpenAI LLM context to upgrade. Returns: The upgraded AWS Bedrock LLM context. zUpgrading to AWS Bedrock: )r debug isinstancerrNrW!_restructure_from_openai_messages"_restructure_from_bedrock_messages)rXs r1upgrade_to_bedrockz'AWSBedrockLLMContext.upgrade_to_bedrocksZ  1#78 c+ ,ZEY5Z0CM  1 1 3   2 2 4 r0openai_contextc||j|j|j}|j|j |j |S)zCreate AWS Bedrock context from OpenAI context. Args: openai_context: The OpenAI LLM context to convert. Returns: New AWS Bedrock LLM context instance. rT)rPrQrRset_llm_adapterget_llm_adapterr\)clsr_rHs r1from_openai_contextz(AWSBedrockLLMContext.from_openai_contextsS#,, &&&22  ^;;=> ..0 r0c8||}|j|S)zCreate AWS Bedrock context from message list. Args: messages: List of messages in OpenAI format. Returns: New AWS Bedrock LLM context instance. )rP)r\)rcrPrHs r1 from_messagesz"AWSBedrockLLMContext.from_messagessH% ..0 r0cB||jdd|jy)zSet the messages list and restructure for Bedrock format. Args: messages: List of messages to set. N) _messagesr\)rHrPs r1 set_messagesz!AWSBedrockLLMContext.set_messagess %q ..0r0c |jd}|jd}|dk(rt|tr |d|dgdgSt|trg}g}|D]\}d|vr|j d|ddd|vs$|d}|j d|d |d t j |d d d ^g}|r|j ||d|r|j ||d|Sy|dk(rt|tr |d|dgdgSt|trg}g}|D]}d|vr|j d|ddd|vs$|d} d} t| dtr2| dD])} d| vr| d} d| vst j | d} +n| d} |j d| d | dg}|r|j ||d|j||Syy)aConvert AWS Bedrock message format to standard structured format. Handles text content and function calls for both user and assistant messages. Args: obj: Message in AWS Bedrock format. Returns: List of messages in standard format. Examples: AWS Bedrock format input:: { "role": "assistant", "content": [ {"text": "Hello"}, {"toolUse": {"toolUseId": "123", "name": "search", "input": {"q": "test"}}} ] } Standard format output:: [ {"role": "assistant", "content": [{"type": "text", "text": "Hello"}]}, { "role": "assistant", "tool_calls": [ { "type": "function", "id": "123", "function": {"name": "search", "arguments": '{"q": "test"}'} } ] } ] rolecontentrKtexttypermrkrltoolUsefunction toolUseIdnameinput)rt arguments)roidrr)rk tool_callsrI toolResultjsontool)rk tool_call_idrlN)getr[r>listappendr{dumpsextend) rHrXrkrl text_items tool_itemsitemtool_userP tool_resultresult_content content_items r1to_standard_messagesz)AWSBedrockLLMContext.to_standard_messagessELwwv'')$ ; '3'!%FG3T2UVWWGT*  #D~"))64<*PQ"d*#' ?"))(2&.{&;,4V,<15HWrbase64 b64decodesplit enumeratelenpopinsert)rHmessage content_jsontool_result_contenttcret tool_callrrrv new_tool_userl new_contentr text_contentnew_itemi image_indices text_indicesimg_idx first_txt_idx image_items r1from_standard_messagez*AWSBedrockLLMContext.from_standard_messageDs*P 6?f $ E9%++-88='C%'((3-C($(::gi.@#AL,2L+A*B',2GI4F+G*H' %)0)@':'   ;;| $&B&26C 4 $Z0 JJx '<= %.t_ ( 0!*   I%%l3 4J++i( gs #"} 'fi=P<;.&, ')9)9${:KE:R:X:XY\:]^_:`)a'" H &&x0 1&/8 .DX71dSWQXMX-6{-CV'!TvQU~AVLV=!Q&<'* ,Q ]*!,!9J""=*=#FO D DM((*nE E(. 0B'C&D# EvYVs*A*I I=I=0 J=J&I:9I:)rmrsizerrmcDtj}tj|||j |dt j |jjd}ddd|idg}|r|jd|i|jd |d y ) aAdd an image message to the context. Args: format: The image format (e.g., 'RGB', 'RGBA'). size: The image dimensions as (width, height). image: The raw image data as bytes. text: Optional text to accompany the image. JPEG)rzutf-8rrr)rorrrmrIrpN) ioBytesIOr frombytessaver b64encodegetvaluedecoder add_message)rHrrrrmbuffer encoded_imagerls r1add_image_frame_messagez,AWSBedrockLLMContext.add_image_frame_messages e,11&1H(():;BB7K $v'=AYZ[  NNFD> * &W=>r0c( |jr|jdd|dk(rt|jddtr%d|jddig|jdd<t|dtr d|dig|d<|jddj|dy|jj |y|jj |y#t $r"}t jd|Yd}~yd}~wwxYw)aAdd a message to the context, merging with previous message if same role. AWS Bedrock requires alternating roles, so consecutive messages from the same role are merged together. Args: message: The message to add to the context. rkrlrmzError adding message: N)rPr[r>rr Exceptionr error)rHres r1rz AWSBedrockLLMContext.add_messages 7}}==$V,?"$--"3I">D9?rARS\A]8^7_ b))4"')"4c:/5wy7I.J-K *MM"%i077 8JKMM((1 $$W- 7 LL1!5 6 6 7s$B+C&.C& C&& D/D  Dc|jr|jdddk(rt|jdk(rd|jdd<n|jjdd}t|trd|ig}|j rJt|j trd|j ig|_|j j |n||_|jD]}t|dtr d|dig|d<"|ds ddig|d<0t|dtsDt|dD]H\}}t|trd|vr|dd k(rd|d<(t|ts9|d k(s?ddi|d|<Jg}|jD]>}|r)|d d|dk(r|d dj |d.|j|@|jj|jj |y ) zRestructure messages in AWS Bedrock format. Handles system messages, merging consecutive messages with the same role, and ensuring proper content formatting. rrkrOrrIrlrmrrzrN) rPrrr[r>rOrrrdictrclear)rHsystem_contentmsgidxrmerged_messagess r1r]z7AWSBedrockLLMContext._restructure_from_bedrock_messagess ==T]]1-f5A4==!Q&+1 a (!%!2!21!5i!@nc2'-~&>%?N;;!$++s3(. '<&= KK&&~6"0DK== BC#i.#.#)3y>":!;I^#)9"5!6IC ND1!*3y>!:BIC!$-&D.T&\UWEW'0V #D#.42:/5y.AIs+ B B== ,C?2#6v#>#f+#M#I.55c)nE&&s+  ,  _-r0c |jDcgc]}|j|c}|jdd|j rG|j dddk(r2|j dd|_|j jdd}|t|j dz kr|j |}|j |dz}|d|dk(rtt|dtr d|ddg|d<t|dtr d|ddg|d<|dj|d|j j|dzn|dz }|t|j dz kr|j D]R}t|dtr|dd k(rd |d<$t|dts8t|ddk(sJdd dg|d<Tycc}w#t$r#}tjd|Yd}~d}~wwxYw) NzError mapping messages: rrkrOrlrrmrnrzr) rhrrr rrPrOrrr[r>rr)rHmrrcurrent_message next_messagers r1r\z6AWSBedrockLLMContext._restructure_from_openai_messages!s 9HL W1!;!;A!> WDNN1  ==T]]1-f5A--*95DK MM  a  #dmm$q(("mmA.O==Q/Lv&,v*>>oi8#>!'1KL2OI.l95s;8> U^H_/`.aL+ *11,y2IJ !!!a%(Q!#dmm$q((&}} KG'),c2wy7IR7O%. "GI.5#gi>P:QUV:V/5y&I%J "  K?!X 9 LL3A37 8 8 9s'GG G G G<G77G<czt|}|jr|jdd|jd|S)zGet messages formatted for persistent storage. Returns: List of messages including system message if present. rrOrp)rU#get_messages_for_persistent_storagerOr)rHrPrWs r1rz8AWSBedrockLLMContext.get_messages_for_persistent_storageIs5 7>@ ;; OOAT[[I Jr0cg}|jD]f}tj|}d|vr:t|dtr'|dD]}|j dsd|ddd<!|j |h|S)zGet messages formatted for logging with sensitive data redacted. Returns: List of messages in a format ready for logging. rlrz...rr)rPcopydeepcopyr[rr~r)rHmsgsrrrs r1get_messages_for_loggingz-AWSBedrockLLMContext.get_messages_for_loggingTs }} G--(CCc)nd3 #IE88G,?DDM(3G<E KK   r0)NNN)r:r;r<r=rrrr>rV staticmethodrr^ classmethodrdrfrirrtupleintrrrr]r\rrrr __classcell__rWs@r1rNrNsH *.&*&*  !% 4:&T #d^   ( 05K"1A$ T$Z 4J  1T1e NxvPT??$)#s(O?r0rNceZdZdZy)rBa_User context aggregator for AWS Bedrock LLM service. Handles aggregation of user messages and frames for AWS Bedrock format. Inherits all functionality from the base LLM user context aggregator. .. deprecated:: 0.0.99 `AWSBedrockUserContextAggregator` is deprecated and will be removed in a future version. Use the universal `LLMContext` and `LLMContextAggregatorPair` instead. See `OpenAILLMContext` docstring for migration guide. Args: context: The LLM context to aggregate messages into. params: Configuration parameters for the aggregator. N)r:r;r<r=r/r0r1rBrBfs    r0rBcTeZdZdZdefdZdefdZdefdZ de de de fd Z de fd Zy ) rDa^Assistant context aggregator for AWS Bedrock LLM service. Handles aggregation of assistant responses and function calls for AWS Bedrock format, including tool use and tool result handling. .. deprecated:: 0.0.99 `AWSBedrockAssistantContextAggregator` is deprecated and will be removed in a future version. Use the universal `LLMContext` and `LLMContextAggregatorPair` instead. See `OpenAILLMContext` docstring for migration guide. Args: context: The LLM context to aggregate messages into. params: Configuration parameters for the aggregator. framecK|jjdd|j|j|jr |jnidigd|jjdd|jddigd igdy w) zHandle function call in progress frame. Args: frame: The function call in progress frame to handle. rKrqrrprIryrm IN_PROGRESSrN)_contextrr} function_namervrHrs r1 handle_function_call_in_progresszEAWSBedrockAssistantContextAggregator.handle_function_call_in_progresss !!#").););$)$7$78=U__R$   !!%).););)/(?'@'  sBBc(K|jrOtj|j}|j|j|j |d{y|j|j|j dd{y757w)zwHandle function call result frame. Args: frame: The function call result frame to handle. N COMPLETED)resultr{r_update_function_call_resultrr})rHrrs r1handle_function_call_resultz@AWSBedrockAssistantContextAggregator.handle_function_call_results} <<ZZ -F33E4G4GI[I[]cd d d33##U%7%7   e s$ABB/BB BBcnK|j|j|jdd{y7w)zwHandle function call cancel frame. Args: frame: The function call cancel frame to handle. CANCELLEDN)rrr}rs r1handle_function_call_cancelz@AWSBedrockAssistantContextAggregator.handle_function_call_cancels3 //   !3!3[   s +535rr}rcK|jjD]O}|ddk(s |dD]<}t|ts|j ds&|dd|k(s2d|ig|dd<>Qyw)NrkrIrlryrsrm)rrPr[rr~)rHrr}rrrls r1rzAAWSBedrockAssistantContextAggregator._update_function_call_results}}-- NGv&(&y1NG"7D1#KK 5#L1+>,N=CVrrrrr/r0r1rDrDzs] "! sBr0r3r5)rr7r9)r:r;r<r=r rrrr?rfloatrr5rr>r7rr9rrr/r0r1 InputParamsrs %*$1$= HSM=',Tcc'J Xe_J!&t!DxD.3J.Oc+O!&t!4#4DIZ^D_'$sCx.)A_r0rNg@F) modelaws_access_keyaws_secret_keyaws_session_token aws_regionparamssettingsr5 client_configretry_timeout_secsretry_on_timeoutrr r r r r rr5rrrc  Ptdddddddddddddi} |tdtd|| _|tdtd|| _|tdt|s|j| _|j | _|j | _|jr|j| _|j| _t|jtr|j| _ || j|t|4dd| i| | std d d d i } tj |_|xst%j&d |xst%j&d|xst%j&d|xst%j&dd| d|_| |_| |_t/j0d|j2j|j2j4r/t/j6|d|j2j4yy)azInitialize the AWS Bedrock LLM service. Args: model: The AWS Bedrock model identifier to use. .. deprecated:: 0.0.105 Use ``settings=AWSBedrockLLMSettings(model=...)`` instead. aws_access_key: AWS access key ID. If None, uses default credentials. aws_secret_key: AWS secret access key. If None, uses default credentials. aws_session_token: AWS session token for temporary credentials. aws_region: AWS region for the Bedrock service. params: Model parameters and configuration. .. deprecated:: 0.0.105 Use ``settings=AWSBedrockLLMSettings(...)`` instead. settings: Runtime-updatable settings for this service. When both deprecated parameters and *settings* are provided, *settings* values take precedence. stop_sequences: List of strings that stop generation. .. deprecated:: 0.0.105 Use ``settings=AWSBedrockLLMSettings(stop_sequences=...)`` instead. client_config: Custom boto3 client configuration. retry_timeout_secs: Request timeout in seconds for retry logic. retry_on_timeout: Whether to retry the request once if it times out. **kwargs: Additional arguments passed to parent LLMService. zus.amazon.nova-lite-v1:0NF)rsystem_instructionrrrtop_kfrequency_penaltypresence_penaltyseedfilter_incomplete_user_turnsuser_turn_completion_configr5r7r9rr5r ri, max_attempts)connect_timeout read_timeoutretriesAWS_ACCESS_KEY_IDAWS_SECRET_ACCESS_KEYAWS_SESSION_TOKEN AWS_REGIONz us-east-1)aws_access_key_idaws_secret_access_keyr  region_nameconfigzUsing AWS Bedrock model: z: Using system instruction: r/)r+r&rr5rrrr7r[r9r apply_updaterUrVr(aioboto3Session _aws_sessionosgetenv _aws_params_retry_timeout_secs_retry_on_timeoutr inforrrZ)rHrr r r r r rr5rrrkwargsdefault_settingsrWs r1rVzAWSBedrockLLMService.__init__ s^1,#"!).(,,. $   "7,A7 K%*  "  % "#35JL\ ].<  +   "8-B C.4.?.? +/5/A/A ,)/ &((6<6K6K$3+1>> (fDDdK>>%D    ) )( 3 ="2=f=" # '+M %,,."0!Q299=P3Q%3%YryyAX7Y!2!Tbii@S6T%M<)M#  $6 !1 /0D0D/EFG >> , , LLD6!=dnn>_>_=`a b -r0rLcy)zCheck if the service can generate usage metrics. Returns: True if metrics generation is supported. Tr/rGs r1can_generate_metricsz)AWSBedrockLLMService.can_generate_metricss r0ci}|jj|jj|d<|jj|jj|d<|jj|jj|d<|jjr|jj|d<|S)aOBuild inference config with only the parameters that are set. This prevents conflicts with models (e.g., Claude Sonnet 4.5) that don't allow certain parameter combinations like temperature and top_p together. Returns: Dictionary containing only the inference parameters that are not None. maxTokensrtopP stopSequences)rrrrr5)rHinference_configs r1_build_inference_configz,AWSBedrockLLMService._build_inference_configs >> $ $ 0,0NN,E,E [ ) >> % % 1.2nn.H.H ] + >>   +'+~~';'; V $ >> ( (040M0M _ -r0rrrcKg}g}t|tr,|j}|j|}|d}|d}n.tj |}|j }t|dd}||rtj|dd|ig}|j}|||d<|jj||jjd} |r|| d<|r|| d<|jjdd d i|j 4d{} | j"di| d{} d | vrd | d vryd | d d vro| d d d } t| t$r1| D]+} | j'ds| dccdddd{Sn#t| t(r| cdddd{S dddd{y777@77 #1d{7swYyxYww)aVRun a one-shot, out-of-band (i.e. out-of-pipeline) inference with the given LLM context. Args: context: The LLM context containing conversation history. max_tokens: Optional maximum number of tokens to generate. If provided, overrides the service's default max_tokens setting. system_instruction: Optional system instruction to use for this inference. If provided, overrides any system instruction in the context. Returns: The LLM's response as a string, or None if no response is generated. rPrON\: Both system_instruction and a system message in context are set. Using system_instruction.rmr6modelIdrPadditionalModelRequestFieldsinferenceConfig service_namebedrock-runtimeoutputrrlr/)r[rrbget_llm_invocation_paramsrNr^rPgetattrr warningr:rrr9r*clientr-converserr~r>)rHrrrrPrOadapterr r9request_paramsrGresponserlrs r1 run_inferencez"AWSBedrockLLMService.run_inferences9$ gz *,0,@,@,BG4;4U4UV]4^Fj)HH%F*==gFG''HWh5F  )f11123F 779  !,6 [ )~~++ ,0NN,Z,Z  0@N, - '-N8 $+4$$++ * .2.>.>    ,V__>~>>HH$(!33(!3I!>>"8,Y7 Bgt, '088F+#'</!   0 -"%   ()   ?       sDG%GG%G+G,A G7G= G% G  G%G" G%.G /G%4G5 G%GG%G G% G%G%G"G G"G%cK|jr< tj|jdi||jd{}|S|jdi|d{}|S7"#t tj f$r?}tj|d|jdi|d{7}|cYd}~Sd}~wwxYw7cw)aCreate converse stream with optional timeout and retry. Args: client: The AWS Bedrock client instance. request_params: Parameters for the converse_stream call. Returns: Async stream of response events. )timeoutNz): Retrying converse_stream due to timeoutr/) r/asynciowait_forconverse_streamr.r) TimeoutErrorr rZ)rHrGrJrKrs r1_create_converse_streamz,AWSBedrockLLMService._create_converse_streams  ! ! !(!1!1*F**<^>wGG/w{K8IYZ .TiPPr0cdddddigdidiS)agCreate a no-operation tool for AWS Bedrock when tool content exists but no tools are defined. This is required because AWS Bedrock doesn't allow empty tool configurations after tools were previously set. Other LLM vendors allow NOT_GIVEN or empty tool configurations, but AWS Bedrock requires at least one tool to be defined. toolSpec no_operationz9Internal placeholder function. Do not call this function.r{object)ro propertiesrequired)rt description inputSchemar/rGs r1_create_no_op_toolz'AWSBedrockLLMService._create_no_op_tool,s, &Z &Y[(\]  r0c~t|trr|j}|j|}|jj r9|drt j|dd|jj ig|d<|Stt|dd|j|jxsg|jS)NrOr<rm)rOrPrQrR) r[rrbrDrrr rFrrErPrQrR)rHrrIr s r1_get_llm_invocation_paramsz/AWSBedrockLLMService._get_llm_invocation_params;s gz *,0,@,@,BG4;4U4UV]4^F~~00(#NN&!::&,T^^-N-N$O#Px M-7Hd3%%--%2++   r0c Kd}d}d}d}d}d}d} |jtd{|jd{|jd{|j |} | d} | d} | d} | d} |j }|j j| |j jd}|r||d<| r| |d<d}| D];}t|jd tr|d D]}d |vsd |vs d }n|s;n|r| s|jg} d }| rCd| i}|s8| r6| d k(rd ii|d<n)| dk(rn#t| trd| vrdd| ddii|d<||d<|j jdvrd|j ji|d<t|tr$|j!}d}|j#|}nd}|j#}t%j&|d|d| d||j(j*d9ddi|j,4d{}|j/||d{}|j1d{d}d}g}|d23d{}d |vrq|d d!}d"|vr4|j3|d"d{||j5|d"z }nd |vrd#|d vr||d d#z }||j5|d d#z }nd$|vr:|d$d%}d |vr|d jd&d|d jddd'}d}nnd(|vrjd)|d(vrc|d(d)d*k(rX|rV |rt7j8|ni}|s%|j;t=||d+|d|,nt%j&d-d/|vs0d0|d/vs9|d/d0} || jd1dz }|| jd2dz }|| jd3dz }|| jd4dz }77777777|#t6j>$rt%j@d.|YwxYw6dddd{7n#1d{7swYnxYw|jCd{7n~#tDjF$rd }tHtDjJf$r|jMd5d{7Yn4tN$r)}!|jQd6|!|!7d{7Yd}!~!nd}!~!wwxYw|jSd{7|jtUd{7|s|n|}"|jW||"||8d{7y#|jSd{7|jtUd{7|s|n|}"|jW||"||8d{7wxYww):NrFrPrOrQrRr=r@rlrqryTauto toolChoicenonerrr|rt toolConfig)standard optimizedr7performanceConfig universalz LLM-specificz: Generating chat from z context [z] | rArBrzstreamcontentBlockDeltadeltarmrucontentBlockStartstartrs)rwrt messageStop stopReasonrrw)rr}rrvzIgnoring no_operation tool callz Failed to parse tool arguments: metadatausage inputTokens outputTokenscacheReadInputTokenscacheWriteInputTokenson_completion_timeoutzUnknown error occurred: ) error_msg exception) prompt_tokenscompletion_tokenscache_read_input_tokenscache_creation_input_tokensr/), push_framerstart_processing_metricsstart_ttfb_metricsrbr:rrr9r[r~rr`rr7rrbrr rZr*rGr-rSstop_ttfb_metrics_push_llm_text_estimate_tokensr{rrrrrrun_function_callsrOCancelledErrorr)rR_call_event_handlerr push_errorstop_processing_metricsr_report_usage_metrics)#rHrr|r}completion_tokens_estimater~ruse_completion_tokens_estimateusing_noop_toolparams_from_contextrPrOrQrRr9rJhas_tool_contentrr tool_configrIcontext_type_for_loggingmessages_for_loggingrGrKtool_use_blockjson_accumulatorfunction_callseventrncontent_block_startrvrtr comp_tokenss# r1_process_contextz%AWSBedrockLLMService._process_contextSs %&""#&'#).&j //";"=> > >//1 1 1))+ + +"&"A"A'"J *:6H(2F'0E-m>//$040^0^N 4D01+1x( % # gkk)4d;(/ (:" $ 4 8T/3,!"$  0023"&&. ';"f,5;RL L1$.#K6:;T"V[-DV-L$M5 L10;|,~~%%)BB7@$..BXBX6Y23':...0+6('.'G'G'P$+9('.'G'G'I$ LL&/0H/ITZS[[_`t_uv 0t((//.262B2BA ]A ]!%!=!=fn!UU,,..."&#% !##+H#53]3]%*e3 %&9 :7 C!U?"&"5"5eFm"DDD6$:O:OPUV\P]:^^6&%/GuY?O4O,i0@0II,6$:O:O %i 0 9;6 -5.34G.H.Q+$(;;&9)&D&H&HVX&Y(;I(F(J(J6SU(V.N02,'%/LE-DX4X / =KP^dL\DJJ7G,Hbd (7$2$9$9(;4;9G9M:H:P6? )*%&%+LL1R$S "U*w% :K/K %j 1' :%=!)DD )UYY~q-II)/599=SUV3WW/3uyyAXZ[7\\3_ ? 1 +VA ]V.3] EJ$(#7#7d & /OP`Oa-b cdU$6A ]A ]A ]A ]A ]F)).9 9 9%% .2 *  '"6"67 D**+BC C C Y//.Fqc,JVW/X X X Y..0 0 0//"9";< < <6"/  ,,+"-(?,G -  ..0 0 0//"9";< < <6"/  ,,+"-(?,G -  sWRPRPRPB+R RD$R7P8R;Q,PQ,)P*Q,9Q=P">Q(Q,)P%*B#Q,AP(#Q,)Q,2AQ,RRRRQ,Q,"Q%Q,(+QQ,QQ, R%Q(&R,Q>2Q5 3Q>:RRRU:ATS!T$U:&T.TT T U:TU:W-T0.!WU#W3U64W:WV!W0V31#WWWWr directioncKt|||d{d}t|trtj |j }t|tr |j }nJt|tr tj|j}n|j||d{|r|j|d{yy77#7 w)zProcess incoming frames and handle LLM-specific frame types. Args: frame: The frame to process. direction: The direction of frame processing. N) rU process_framer[r rNr^rrrrfrPrr)rHrrrrWs r1rz"AWSBedrockLLMService.process_frame sg#E9555 e2 3*==emmLG e_ -mmG / 0+88HG//%3 3 3 ''0 0 0  6 4 1s4CCBC/C0C C CCCrmcXtttjd|dzS)Nz[^\w]+g?)rrrer)rHrms r1rz%AWSBedrockLLMService._estimate_tokens#s"3rxx 401C788r0r|r}r~rcrK|s|r-t||||z||}|j|d{yy7w)N)r|r} total_tokensr~r)rstart_llm_usage_metrics)rHr|r}r~rtokenss r1rz*AWSBedrockLLMService._report_usage_metrics&sM -"+"3*->>(?,G F..v6 6 6. 7s ,757)NN)+r:r;r<r=r+Settingsr?r adapter_classr rrr>rr(rboolrVr4rrr:rrrrLrSrrrArWr`rrbr'rNrrr!rrrrrs@r1rrsS%H$$)M`i`4 $(,(,+/$((,48.2*..1+0uc}uc! uc ! uc $C= ucSMuc%uc01uc!c+uc 'uc%UOuc#4.ucnd c3h .%),0 N..NSMN%SM N # N`:0G/H9U9W $Q!$Q- $Q 7 $Q ) $QL   '*4 & 0u.BZ.Ouun11>109S9S9777"% 7 &) 7r0r)Kr=rOrrrr{r+r dataclassesrrtypingrrrrlogurur PILr pydanticr r )pipecat.adapters.services.bedrock_adapterr rpipecat.frames.framesrrrrrrrrrrpipecat.metrics.metricsr*pipecat.processors.aggregators.llm_contextr+pipecat.processors.aggregators.llm_responserrrr1pipecat.processors.aggregators.openai_llm_contextrr "pipecat.processors.frame_processorr!pipecat.services.llm_servicer"pipecat.services.settingsr#r$r%r&(pipecat.utils.tracing.service_decoratorsr'r(botocore.configr(botocore.exceptionsr)ModuleNotFoundErrorrrrr+rArNrBrDrr/r0r1rs> (,,%   2A >3__? ,&4  K     "" "Jc+cL &> (h +Hh VP 7:P 7I,FLL;qc"#FLL ~ &qc* ++ ,s&DD>2D99D>