o Zh>@sddlZddlZddlmZmZmZmZmZmZddl Z ddl m Z ddl m Z ddlmZddlmZeeZGddde ZdS) N)AnyDictListMappingOptionalSet)CallbackManagerForLLMRun)LLM)Field)enforce_stop_tokensc seZdZUdZdZeed< edddZe ed< dZ e e ed < d Z e e ed < d Ze e ed < dZeed< dZe eed< gZe eeed< dZe e ed< dZe e ed< dZeed< gZeeed< dZeed< deddffdd ZedefddZedeefd d!Zde eeffd"d#Z!ede"eeffd$d%Z#  d*d&ede eed'e e$dedef d(d)Z%Z&S)+Yuan2unYuan2.0 language models. Example: .. code-block:: python yuan_llm = Yuan2( infer_api="http://127.0.0.1:8000/yuan", max_tokens=1024, temp=1.0, top_p=0.9, top_k=40, ) print(yuan_llm) print(yuan_llm.invoke("你是谁？")) zhttp://127.0.0.1:8000/yuan infer_apiiZ max_token)alias max_tokensgffffff?tempg?top_prtop_kF do_sampleechostop@ repeat_last_ngzG?repeat_penalty streaminghistory use_historykwargsreturnNc sJtjdi||jp ddkr!|jpddkr#tdd|_dSdSdS)zInitialize the Yuan2 class.rzGtop_p and top_k cannot be set simultaneously. set top_k to 0 instead...N)super__init__rrloggerwarning)selfr __class__rU/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/llms/yuan2.pyr Is zYuan2.__init__cCsdS)NzYuan2.0rr#rrr& _llm_typeTszYuan2._llm_typecCshdS)N>rrrrrrrrrr&_model_param_namesXszYuan2._model_param_namesc Cs&|j|j|j|j|j|j|j|jdS)Nrr rrrrrrr*r'rrr&_default_paramsbszYuan2._default_paramscs*djifddjDS)zGet the identifying parameters.modelcs"i|] \}}|vr||qSr)r)).0kvr'rr& tsz-Yuan2._identifying_params..)r(r+__dict__itemsr'rr'r&_identifying_paramsns zYuan2._identifying_paramsprompt run_managerc Ks|jr|j|d|j}n|}ddi}td|dg|j|j|j|j |j d}t d|z t j|j||d}Wnt jjyQ} ztd | d } ~ wwt d ||jd krftd |z<|} | ddkrtd| dd| ddd| vrt| dddkr| dddd} ntdtdWnt jjy} z td| d|jd } ~ ww|d urt| |} |jr|j| t d|j| S)uxCall out to a Yuan2.0 LLM inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = yuan_llm.invoke("你能做什么?") zz Content-Typezapplication/jsonZ000)idZques)Z ques_listZtokens_to_generateZ temperaturerrrzYuan2.0 prompt:)headersdatazError raised by inference api: NzYuan2.0 response: zFailed with response: ZerrCode0zFailed with error code [z], error message: [Z exceptionMsg]ZresDataoutputrZanszNo output found in response.zNo resData found in response.z:Error raised during decoding response from inference api: z . Response: z history: )rrappendjoinjsondumpsrrrrrr!debugrequestsputr exceptionsRequestException ValueError status_codelenJSONDecodeErrortextr ) r#r4rr5rinputr7r8responseerespZ generate_textrrr&_callysh        z Yuan2._call)NN)'__name__ __module__ __qualname____doc__r str__annotations__r rintrrfloatrrrboolrrrrrrrrrr propertyr( staticmethodrr)rr+rr3rrO __classcell__rrr$r&r sb          r )r?loggingtypingrrrrrrrBZlangchain_core.callbacksrZ#langchain_core.language_models.llmsr Zpydanticr Zlangchain_community.llms.utilsr getLoggerrPr!r rrrr&s