o Zh;@s<ddlmZddlZddlZddlZddlmZmZmZm Z m Z m Z m Z m Z mZmZmZmZddlmZmZddlmZddlmZmZmZddlmZmZddlmZdd l m!Z!dd l"m#Z#m$Z$m%Z%m&Z&m'Z'e(e)Z*ed Z+d'ddZ,d(ddZ-d)ddZ.d)ddZ/d)ddZ0d*d d!Z1d+d$d%Z2Gd&d d eZ3dS),) annotationsN) Any AsyncIterable AsyncIteratorCallableDictIterableIteratorListMappingOptionalTupleTypeVar)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)BaseLLM) GenerationGenerationChunk LLMResult)get_from_dict_or_envpre_init)Field) HTTPError)before_sleep_logretryretry_if_exception_typestop_after_attemptwait_exponentialTllmTongyireturnCallable[[Any], Any]cCs6d}d}tdt|jtd||dtttttj dS)NT) multiplierminmax)reraisestopwaitr before_sleep) rr max_retriesrrrrloggerloggingWARNING)rZ min_secondsZ max_secondsr0V/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/llms/tongyi.py_create_retry_decorator*s  r2resprc Csv|ddkr|S|ddvr&td|dd|dd|dd |d td |dd|dd |d |d ) z,Check the response from the completion call. status_code)iiz request_id: request_idz status_code: z code: codez message: messagez"HTTP error occurred: status_code: )response) ValueErrorr)r3r0r0r1check_response8s(    r;kwargsc (t}|dfdd }|di|S) *Use tenacity to retry the completion call._kwargsrr!csjjdi|}t|SNr0clientcallr;)r?r3rr0r1_generate_with_retryNsz1generate_with_retry.._generate_with_retryNr?rr!rr0r2)rr<retry_decoratorrEr0rDr1generate_with_retryJsrIc r=) r>r?rr!c;s,jjdi|}|D]}t|Vq dSr@rA)r? responsesr3rDr0r1_stream_generate_with_retryZs  z?stream_generate_with_retry.._stream_generate_with_retryNrFr0rG)rr<rHrKr0rDr1stream_generate_with_retryVsrLcKs:Gddd}||fi|2z 3dHW}|Vq6dS)zAsync version of `stream_generate_with_retry`. Because the dashscope SDK doesn't provide an async API, we wrap `stream_generate_with_retry` with an async generator.c@s4eZdZdddZdd d Zdd d Zdd dZdS)z8astream_generate_with_retry.._AioTongyiGenerator_llmr r?rc[st|fi||_dSN)rL generator)selfrMr?r0r0r1__init__jszAastream_generate_with_retry.._AioTongyiGenerator.__init__r!AsyncIterator[Any]cSs|SrNr0rPr0r0r1 __aiter__mszBastream_generate_with_retry.._AioTongyiGenerator.__aiter__cs*td|jIdH}|dur|StrN)asyncioget_running_looprun_in_executor _safe_nextStopAsyncIteration)rPvaluer0r0r1 __anext__ps zBastream_generate_with_retry.._AioTongyiGenerator.__anext__cSs"zt|jWStyYdSwrN)nextrO StopIterationrSr0r0r1rXys   zCastream_generate_with_retry.._AioTongyiGenerator._safe_nextN)rMr r?r)r!rR)r!r)__name__ __module__ __qualname__rQrTr[rXr0r0r0r1_AioTongyiGeneratoris     raNr0)rr<rachunkr0r0r1astream_generate_with_retrycs rciterable Iterable[T]Iterator[Tuple[T, bool]]ccsRt|}zt|}Wn tyYdSw|D] }|dfV|}q|dfVdS)z[Generate elements from an iterable, and a boolean indicating if it is the last element.NFT)iterr\r]rditeratoritemZ next_itemr0r0r1generate_with_last_element_marks   rkAsyncIterable[T]AsyncIterator[Tuple[T, bool]]cCsb|}z |IdH}Wn tyYdSw|2z 3dHW}|dfV|}q6|dfVdS)zaGenerate elements from an async iterable, and a boolean indicating if it is the last element.NFT)rTr[rYrhr0r0r1 agenerate_with_last_element_marks  rncs>eZdZUdZedHddZdZded<ed d d Z d ed < ee dZ ded<dZ ded< eddd Z ded< dZded< dZded< edIddZedJd!d"ZedKd#d$ZedLfd&d' Z  dMdNd0d1Z  dMdOd3d4Z  dMdPd7d8Z  dMdQd:d;ZdRddSdTdAdBZedUdFdGZZS)Vr uP Tongyi completion model integration. Setup: Install ``dashscope`` and set environment variables ``DASHSCOPE_API_KEY``. .. code-block:: bash pip install dashscope export DASHSCOPE_API_KEY="your-api-key" Key init args — completion params: model: str Name of Tongyi model to use. top_p: float Total probability mass of tokens to consider at each step. streaming: bool Whether to stream the results or not. Key init args — client params: api_key: Optional[str] Dashscope API KEY. If not passed in will be read from env var DASHSCOPE_API_KEY. max_retries: int Maximum number of retries to make when generating. See full list of supported init args and their descriptions in the params section. Instantiate: .. code-block:: python from langchain_community.llms import Tongyi llm = Tongyi( model="qwen-max", # top_p="...", # api_key="...", # other params... ) Invoke: .. code-block:: python input_text = "用50个字左右阐述，生命的意义在于" llm.invoke(input_text) .. code-block:: python '探索、成长、连接与爱——在有限的时间里，不断学习、体验、贡献并寻找与世界和谐共存之道，让每一刻充满价值与意义。' Stream: .. code-block:: python for chunk in llm.stream(input_text): print(chunk) .. code-block:: python 探索 | 、 | 成长 | 、连接与爱。 | 在有限的时间里，寻找个人价值， | 贡献于他人，共同体验世界的美好 | ，让世界因自己的存在而更 | 温暖。 Async: .. code-block:: python await llm.ainvoke(input_text) # stream: # async for chunk in llm.astream(input_text): # print(chunk) # batch: # await llm.abatch([input_text]) .. code-block:: python '探索、成长、连接与爱。在有限的时间里，寻找个人价值，贡献于他人和社会，体验丰富多彩的情感与经历，不断学习进步，让世界因自己的存在而更美好。' r!Dict[str, str]cCsddiS)Ndashscope_api_keyDASHSCOPE_API_KEYr0rSr0r0r1 lc_secretsszTongyi.lc_secretsNrrBz qwen-plusmodel)defaultaliasstr model_name)default_factoryDict[str, Any] model_kwargsg?floattop_papi_keyz Optional[str]rpFbool streaming intr,cCsdS)zReturn type of llm.Ztongyir0rSr0r0r1 _llm_typeszTongyi._llm_typevaluesrcCs`t|ddgd|d<zddl}Wn tytdwz|j|d<W|Sty/tdw) z?Validate that api key and python package exists in environment.rpr}rqrNzZCould not import dashscope python package. Please install it with `pip install dashscope`.rBz`dashscope` has no `Generation` attribute, this is likely due to an old version of the dashscope package. Try upgrading it with `pip install --upgrade dashscope`.)r dashscope ImportErrorrAttributeErrorr:)clsrrr0r0r1validate_environment s$     zTongyi.validate_environmentcCs |j|j|jd}i||jS)z7Get the default parameters for calling Tongyi Qwen API.)rsr|r})rwr|rprz)rPZ normal_paramsr0r0r1_default_params!s zTongyi._default_paramsMapping[str, Any]csd|jitjS)Nrw)rwsuper_identifying_paramsrS __class__r0r1r,szTongyi._identifying_paramsprompts List[str]r)Optional[List[str]] run_manager"Optional[CallbackManagerForLLMRun]r<rc Ksg}|jr &    zTongyi._ageneraterIterator[GenerationChunk]c ksr|jd|dd|}tt|fd|i|D]\}}tdi|||}|r3|j|j||jd|VqdSNT)r)streamr)rbverboser0)rrkrLrron_llm_new_tokentextr rPrr)rr<rZ stream_resp is_last_chunkrbr0r0r1rws(  zTongyi._streamAsyncIterator[GenerationChunk]c Ks|jd|dd|}tt|fd|i|2z%3dHW\}}tdi|||}|r:|j|j||jdIdH|Vq6dSr)rrnrcrrrrrrr0r0r1rs(  zTongyi._astreamcKs4i|j|}|dur||d<|drd|d<|S)Nr)rTZincremental_output)rget)rPr)r<rr0r0r1rs zTongyi._invocation_paramsTr3rcCsH|rt|ddt|dd|dt|dddSt|dddS) Noutputr finish_reasonr6usage)rr6Z token_usagergeneration_info)r)dict)r3rr0r0r1rs     z!Tongyi._generation_from_qwen_resprbrrcCst|j|jdS)Nr)rrr)rbr0r0r1rszTongyi._chunk_to_generation)r!ro)r!rv)rrr!r)r!ry)r!r)NN) rrr)rrrr<rr!r) rrr)rrrr<rr!r) rrvr)rrrr<rr!r) rrvr)rrrr<rr!r)r)rr<rr!ry)T)r3rrr~r!ry)rbrr!r)r^r_r`__doc__propertyrrrB__annotations__rrwrrzr|rprr,rrrrrrrrrr staticmethodrr __classcell__r0r0rr1r sT L          $ )   )rr r!r")r3rr!r)rr r<rr!r)rdrer!rf)rdrlr!rm)4 __future__rrUrr.typingrrrrrrr r r r r rZlangchain_core.callbacksrrZ#langchain_core.language_models.llmsrZlangchain_core.outputsrrrZlangchain_core.utilsrrZpydanticrZrequests.exceptionsrtenacityrrrrr getLoggerr^r-rr2r;rIrLrcrkrnr r0r0r0r1s, 8