qi;dZddlmZddlmZddlmZddlmZddl m Z ddl m Z ddl mZdd lmZdd lmZeGd d eZGd deZy)a Perplexity LLM service implementation. This module provides a service for interacting with Perplexity's API using an OpenAI-compatible interface. It handles Perplexity's unique token usage reporting patterns while maintaining compatibility with the Pipecat framework. ) dataclass)Optional)OpenAILLMInvocationParams) LLMTokenUsage) LLMContext)OpenAILLMContext)OpenAILLMSettings)OpenAILLMService)_warn_deprecated_paramceZdZdZy)PerplexityLLMSettingsz"Settings for PerplexityLLMService.N)__name__ __module__ __qualname____doc__Q/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/perplexity/llm.pyr r s,rr c eZdZUdZeZeed<dddddededeed eeffd Z d e d e fd Z de ezffd ZdefdZxZS)PerplexityLLMServiceaDA service for interacting with Perplexity's API. This service extends OpenAILLMService to work with Perplexity's API while maintaining compatibility with the OpenAI-style interface. It specifically handles the difference in token usage reporting between Perplexity (incremental) and OpenAI (final summary). _settingszhttps://api.perplexity.aiN)base_urlmodelsettingsapi_keyrrrc td}|tdtd||_||j|t |d|||d|d|_d|_d|_d|_ d|_ y) aInitialize the Perplexity LLM service. Args: api_key: The API key for accessing Perplexity's API. base_url: The base URL for Perplexity's API. Defaults to "https://api.perplexity.ai". model: The model identifier to use. Defaults to "sonar". .. deprecated:: 0.0.105 Use ``settings=OpenAILLMSettings(model=...)`` instead. settings: Runtime-updatable settings. When provided alongside deprecated parameters, ``settings`` values take precedence. **kwargs: Additional keyword arguments passed to OpenAILLMService. sonar)rNr)rrrrFr) r r r apply_updatesuper__init___prompt_tokens_completion_tokens _total_tokens_has_reported_prompt_tokens_is_processing)selfrrrrkwargsdefault_settings __class__s rr zPerplexityLLMService.__init__,s01w?   "7,A7 K%*  "    ) )( 3 a8FVaZ`a"#+0(#rparams_from_contextreturnc|jjd|dd}|jj|jj|d<|jj|jj|d<|jj|jj|d<|jj |jj |d<|jj |jj |d<|jjr2|jdg}d |jjd g|z|d<|S) aBuild parameters for Perplexity chat completion request. Perplexity uses a subset of OpenAI parameters and doesn't support tools. Args: params_from_context: Parameters, derived from the LLM context, to use for the chat completion. Contains messages, tools, and tool choice. Returns: Dictionary of parameters for the chat completion request. Tmessages)rstreamr-frequency_penaltypresence_penalty temperaturetop_p max_tokenssystem)rolecontent) rrr/r0r1r2r3system_instructionget)r&r*paramsr-s rbuild_chat_completion_paramsz1PerplexityLLMService.build_chat_completion_paramsYs&^^))+J7  >> + + 7*...*J*JF& ' >> * * 6)-)H)HF% & >> % % 1$(NN$>$>F= ! >>   +"nn22F7O >> $ $ 0#'>>#<#> , ,zz*b1H!dnn.O.OP""F:  rcontextcKd|_d|_d|_d|_d|_ t ||d{d|_|jdkDs|jdkDrb|j|jz|_t|j|j|j}t |!|d{yy77#d|_|jdkDs|jdkDrc|j|jz|_t|j|j|j}t |!|d{7wwxYww)aProcess a context through the LLM and accumulate token usage metrics. This method overrides the parent class implementation to handle Perplexity's incremental token reporting style, accumulating the counts and reporting them once at the end of processing. Args: context: The context to process, containing messages and other information needed for the LLM interaction. rFTN) prompt_tokenscompletion_tokens total_tokens) r!r"r#r$r%r_process_contextrstart_llm_usage_metrics)r&r;tokensr)s rr@z%PerplexityLLMService._process_contextsO "#+0(" >'*73 3 3"'D ""Q&$*A*AA*E%)%8%84;R;R%R"&"&"5"5&*&=&=!%!3!3 g5f===+F 4>#(D ""Q&$*A*AA*E%)%8%84;R;R%R"&"&"5"5&*&=&=!%!3!3 g5f===+FsK$EC CC BEC EC E BE EEErBcK|jsy|js'|jdkDr|j|_d|_|j|j kDr|j|_yyw)aRAccumulate token usage metrics during processing. Perplexity reports token usage incrementally during streaming, unlike OpenAI which provides a final summary. We accumulate the counts and report the total at the end of processing. Args: tokens: Token usage information to accumulate. NrT)r%r$r=r!r>r")r&rBs rrAz,PerplexityLLMService.start_llm_usage_metricssk"" //F4H4H14L"("6"6D /3D ,  # #d&=&= =&,&>&>D # >sA-A/)rrrrr Settings__annotations__strrr rdictr:rrr@rrA __classcell__)r)s@rrr!s%H$$ 4#48 +$+$ +$ } +$ 01 +$Z&@Y&^b&P>.>.K>@?M?rrN)r dataclassesrtypingr)pipecat.adapters.services.open_ai_adapterrpipecat.metrics.metricsr*pipecat.processors.aggregators.llm_contextr1pipecat.processors.aggregators.openai_llm_contextr pipecat.services.openai.base_llmr pipecat.services.openai.llmr pipecat.services.settingsr r rrrrrRsR"O1AN>8<  -   T?+T?r