o Zh@sddlZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z mZmZmZddlmZddlmZeeZdd iZd Zd e d efd dZGddde ZdS)N)AnyListOptionalUnion)CallbackManagerForLLMRun)LLM) AIMessage BaseMessageFunctionMessage HumanMessage SystemMessage)Field)enforce_stop_tokensz Content-Typezapplication/jsonmessagereturncCsvt|tr d|jd}|St|trd|jd}|St|tr'd|jd}|St|tr4d|jd}|Std|)Nuser)ZrolecontentZ assistantsystemfunctionzGot unknown type ) isinstancer rrr r ValueError)rZ message_dictrX/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/llms/chatglm3.py_convert_message_to_dicts     rc @s.eZdZUdZedddZeed<dZeed< dZ e e ed < d Z e ed < d Zeed < dZeed< eedZeeed< dZeed< dZeedfed<eZe ed<edefddZede fddZedefddZdede fddZ  d%ded e eed!e e!d"edef d#d$Z"dS)&ChatGLM3zChatGLM3 LLM service.z chatglm3-6bmodel)defaultalias model_namez)http://127.0.0.1:8000/v1/chat/completions endpoint_urlN model_kwargsi N max_tokensg? temperaturegffffff?top_p)default_factoryprefix_messagesF streaming http_clienttimeoutrcCsdS)NZ chat_glm_3r)selfrrr _llm_type:szChatGLM3._llm_typecCs,|j|j|j|j|jd}i||jpiS)z,Get the parameters used to invoke the model.)rr#r"r$stream)rr#r"r$r'r!)r*paramsrrr_invocation_params>szChatGLM3._invocation_paramscCsddl}|jp |j|jdS)Nr)r))httpxr(ZClientr))r*r/rrrclientJszChatGLM3.clientpromptcCs4|j}|jt|dg}|ddd|Di|S)N)rmessagescSsg|]}t|qSr)r).0mrrr Usz)ChatGLM3._get_payload..)r.r&r update)r*r1r-r2rrr _get_payloadPszChatGLM3._get_payloadstop run_managerkwargsc Ks4ddl}||}td|z |jj|jt|d}Wn|jy1}zt d|d}~wwtd||j dkrFt d|z0| } t | t rnd } | | vrg| | } t| rf| dd d } nt d | t d | Wnt jy}z t d|d|jd}~ww|durt| |} | S)axCall out to a ChatGLM3 LLM inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = chatglm_llm.invoke("Who are you?") rNzChatGLM3 payload: )headersjsonz$Error raised by inference endpoint: zChatGLM3 response: zFailed with response: choicesrrzNo content in response : zUnexpected response type: z?Error raised during decoding response from inference endpoint: z . Response: )r/r7loggerdebugr0postr HEADERSZ NetworkErrorr status_coder<rdictlenJSONDecodeErrortextr) r*r1r8r9r:r/payloadresponseeZparsed_responseZ content_keysr>rGrrr_callZsJ     zChatGLM3._call)NN)#__name__ __module__ __qualname____doc__r rstr__annotations__r r!rrDr"intr#floatr$listr&rr r'boolr(rrDEFAULT_TIMEOUTr)propertyr+r.r0r7rrKrrrrr%sN          r)r<loggingtypingrrrrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsrZlangchain_core.messagesrr r r r Zpydanticr Zlangchain_community.llms.utilsr getLoggerrLr?rBrVrDrrrrrrs