qitdZddlmZmZmZmZddlmZddlm Z m Z m Z ddl m Z ddlmZGdde e Zy ) zbLLM switcher for switching between different LLMs at runtime, with different switching strategies.)AnyListOptionalType)DirectFunction)ServiceSwitcherServiceSwitcherStrategyManual StrategyType) LLMContext) LLMServiceceZdZdZefdeedeeffd Z e deefdZ e defdZ de deefd Z dd d d eed edefdZd d d edefdZxZS) LLMSwitcherzA pipeline that switches between different LLMs at runtime. Example:: llm_switcher = LLMSwitcher(llms=[openai_llm, anthropic_llm]) llms strategy_typec&t|||y)a/Initialize the service switcher with a list of LLMs and a switching strategy. Args: llms: List of LLM services to switch between. strategy_type: The strategy class to use for switching between LLMs. Defaults to ``ServiceSwitcherStrategyManual``. N)super__init__)selfrr __class__s O/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/pipeline/llm_switcher.pyrzLLMSwitcher.__init__s }-returnc|jS)zGet the list of LLMs managed by this switcher. Returns: List of LLM services managed by this switcher. )servicesrs rrzLLMSwitcher.llms+s}}rc.|jjS)zGet the currently active LLM. Returns: The currently active LLM service, or None if no LLM is active. )strategyactive_servicers r active_llmzLLMSwitcher.active_llm4s}}+++rcontextctK|jr&|jjdd|i|d{Sy7w)aRun a one-shot, out-of-band (i.e. out-of-pipeline) inference with the given LLM context, using the currently active LLM. Args: context: The LLM context containing conversation history. **kwargs: Additional arguments forwarded to the active LLM's run_inference (e.g. max_tokens, system_instruction). Returns: The LLM's response as a string, or None if no response is generated. r N)r run_inference)rr kwargss rr#zLLMSwitcher.run_inference=s: ??666QwQ&QQ QRs .868T)cancel_on_interruption function_namehandlerr%cP|jD]}|j||||y)aRegister a function handler for LLM function calls, on all LLMs, active or not. Args: function_name: The name of the function to handle. Use None to handle all function calls with a catch-all handler. handler: The function handler. Should accept a single FunctionCallParams parameter. start_callback: Legacy callback function (deprecated). Put initialization code at the top of your handler instead. .. deprecated:: 0.0.59 The `start_callback` parameter is deprecated and will be removed in a future version. cancel_on_interruption: Whether to cancel this function call when an interruption occurs. Defaults to True. )r&r'start_callbackr%N)rregister_function)rr&r'r)r%llms rr*zLLMSwitcher.register_functionLs6099 C  ! !+-'= "  rcL|jD]}|j||y)aQRegister a direct function handler for LLM function calls, on all LLMs, active or not. Args: handler: The direct function to register. Must follow DirectFunction protocol. cancel_on_interruption: Whether to cancel this function call when an interruption occurs. Defaults to True. )r'r%N)rregister_direct_function)rr'r%r+s rr-z$LLMSwitcher.register_direct_functionls099 C  ( ('= )  r)N)__name__ __module__ __qualname____doc__r rr rr rpropertyrrr rstrr#rboolr*rr- __classcell__)rs@rrrs-J .: .L) .d:&,J,, : HSM &  (, } !% H(, !% rrN)r1typingrrrr(pipecat.adapters.schemas.direct_functionr!pipecat.pipeline.service_switcherrr r *pipecat.processors.aggregators.llm_contextr pipecat.services.llm_servicer rr"rrr;s:i,,C B3h/,/hr