o Zh8@sdZddlmZddlZddlZddlZddlmZmZddl m Z m Z m Z m Z mZmZmZmZddlmZddlZddlmZddlmZmZdd lmZmZdd lmZmZm Z m!Z!m"Z"dd l#m$Z$m%Z%m&Z&dd l'm(Z(dd l)m*Z*m+Z+m,Z,ddl-m.Z.m/Z/e rddl0m1Z1m2Z2m3Z3m4Z4ddl5m6Z6e7e8Z9eGdddZ:d0ddZ;d1ddZd4d(d)Z?ed*d+d,d-Gd.d/d/e*eZ@dS)5z1Wrapper around Google VertexAI chat-based models.) annotationsN) dataclassfield) TYPE_CHECKINGAnyDictIteratorListOptionalUnioncast)urlparse) deprecated)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun) BaseChatModelgenerate_from_stream) AIMessageAIMessageChunk BaseMessage HumanMessage SystemMessage)ChatGenerationChatGenerationChunk ChatResult)pre_init)_VertexAICommonis_codey_modelis_gemini_model)load_image_from_gcsraise_vertex_import_error) ChatMessage ChatSessionCodeChatSessionInputOutputTextPair)Contentc@s0eZdZUdZeedZded<dZded<dS) _ChatHistoryz/Represents a context and a history of messages.)default_factoryzList['ChatMessage']historyN Optional[str]context) __name__ __module__ __qualname____doc__rlistr(__annotations__r*r1r1_/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/chat_models/vertexai.pyr&6s r&r(List[BaseMessage]returnc Csddlm}gd}}t|D]F\}}tt|j}|dkr%t|tr%|}qt|tr7||jdd}| |qt|t rI||jdd}| |qt dt |d|d t ||d }|S) aParse a sequence of messages into history. Args: history: The list of messages to re-create the history of the chat. Returns: A parsed chat history. Raises: ValueError: If a sequence of message has a SystemMessage not at the first place. r)r!NZbot)contentZauthoruserUnexpected message with type  at the position .)r*r()vertexai.language_modelsr! enumerater strr5 isinstancerrappendr ValueErrortyper&) r(r!vertex_messagesr*imessager5vertex_messageZ chat_historyr1r1r2_parse_chat_history>s"       rEsr<boolc CsRz t|}t|j|jgWSty(}ztd|WYd}~dSd}~ww)NzUnable to parse URL: F)r allschemenetloc Exceptionloggerdebug)rFresulter1r1r2_is_url^srPprojectr)List['Content']c sddlm}mmdfdd g}t|D]M\}}|dkr*t|tr*td t|tr2d }nt|t r:d }n td t |d |d|j }t|t rR|g}fdd|D}|||d} | | q|S)Nr)r%ImagePartpartUnion[str, Dict]r4rTcst|tr |St|tstdt|d|ddkr&|dS|ddkrx|dd}|dr>t|d}n>|d r^t d |}|rQ| d }ntd  t |}nt|rrt|}| |j}n |}ntd |S)Nz0Message's content is expected to be a dict, got !r@textZ image_urlurlzgs://)pathrQz data:image/zdata:image/\w{2,4};base64,(.*)zdInvalid image uri. It should be in the format data:image/;base64,.z,Only text and image_url types are supported!)r=r<Z from_textrr?r@ startswithrresearchgroup from_bytesbase64 b64decoderPrequestsgetraise_for_statusr5Zload_from_fileZ from_image)rUrZimageencodedresponse)rSrTrQr1r2_convert_to_promptls6             z6_parse_chat_history_gemini.._convert_to_promptz%SystemMessages are not yet supported!modelr6r7r8r9csg|]}|qSr1r1).0rU)rir1r2 sz._parse_chat_history_gemini..)roleparts)rUrVr4rT)"vertexai.preview.generative_modelsr%rSrTr;r=rr?rrr@r5r<r>) r(rQr%rArBrCrmZ raw_contentrnrDr1)rSrTrirQr2_parse_chat_history_geminigs(#     rpexamplesList['InputOutputTextPair']cCsddlm}t|ddkrtdt|dg}d}t|D]C\}}|ddkr?t|ts)rqr$Z example_pairsrtrBZexamplepairr1r1r2_parse_examplessB      rwmessagesrcCs4|std|d}t|tstd|jd|S)zMGet the human message at the end of a list of input messages to a chat model.z:You should provide at least one message to start the chat!z3Last message in the list should be from human, got r9)r?r=rr@)rxquestionr1r1r2 _get_questions  r{z0.0.12z1.0z&langchain_google_vertexai.ChatVertexAI)ZsinceZremovalZalternative_importc@seZdZUdZdZded< dZded<ed+d d Zed,d dZ e d-ddZ   d.d/ddZ  d0d1d!d"Z  d0d2d$d%Zd3d)d*ZdS)4 ChatVertexAIz+`Vertex AI` Chat large language models API.z chat-bisonr< model_nameNzOptional[List[BaseMessage]]rqr4rGcCsdS)NTr1)selfr1r1r2is_lc_serializableszChatVertexAI.is_lc_serializable List[str]cCsgdS)z*Get the namespace of the langchain object.)Z langchainZ chat_modelsZvertexair1)clsr1r1r2get_lc_namespaceszChatVertexAI.get_lc_namespacevaluesrcCst|d}||zddlm}m}|rddlm}Wn ty)tYnw|r7||dd|d<|St |dr@|}n|}| |d|d<|S)z7Validate that the python package exists in environment.r}r) ChatModel CodeChatModel)GenerativeModel)r}client) rZ_try_init_vertexair:rrror ImportErrorr rZfrom_pretrained)rrZ is_geminirrrZ model_clsr1r1r2validate_environments$      z!ChatVertexAI.validate_environmentrxr3stopOptional[List[str]] run_manager"Optional[CallbackManagerForLLMRun]streamOptional[bool]kwargsrrcKs|dur|n|j}|r|j|f||d|}t|St|}|jd|dd|} i} d| vr7| d| d<|jrTt||jd} | } |j j | d} | j | | d}n+t |dd }| d pc|j}|rlt|| d <|j|fi| } | j |jfi| }d d |jD}t|d S)a>Generate next turn in the conversation. Args: messages: The history of the conversation as a list of messages. Code chat does not support context. stop: The list of stop words (optional). run_manager: The CallbackManager for LLM run, it's not used at the moment. stream: Whether to use the streaming endpoint. Returns: The ChatResult that contains outputs generated by the model. Raises: ValueError: if the last message in the list is not from human. N)rrFrrcandidate_countrQr(generation_configryrqcSg|] }tt|jddqSr5rCrrrXrkrr1r1r2rl,z*ChatVertexAI._generate.. generationsr1)Z streaming_streamrr{_prepare_paramspop_is_gemini_modelrprQr start_chat send_messagerErdrqrw _start_chatr5 candidatesr)r~rxrrrrZ should_streamZ stream_iterrzparams msg_paramshistory_geminirCchatrhr(rqrr1r1r2 _generates<  zChatVertexAI._generate'Optional[AsyncCallbackManagerForLLMRun]csd|vr|dtd|jdd|i|}i}d|vr&|d|d<|jrFt||jd}|}|jj|d} | j ||dIdH} n0t |} t |dd } | d d} | r`t | |d <|j| fi|} | j | jfi|IdH} d d | jD}t|d S)aAsynchronously generate next turn in the conversation. Args: messages: The history of the conversation as a list of messages. Code chat does not support context. stop: The list of stop words (optional). run_manager: The CallbackManager for LLM run, it's not used at the moment. Returns: The ChatResult that contains outputs generated by the model. Raises: ValueError: if the last message in the list is not from human. rz8ChatVertexAI does not currently support async streaming.rrrrrNryrqcSrrrrr1r1r2rl^rz+ChatVertexAI._agenerate..rr1)rrLwarningrrrprQrrZsend_message_asyncr{rErdrwrr5rr)r~rxrrrrrrrCrrhrzr(rqrr1r1r2 _agenerate2s0     zChatVertexAI._agenerateIterator[ChatGenerationChunk]cks|jd |dd|}|jr*t||jd}|}|jj|d}|j|d|d} n-t|} t |dd} | dd} | rDt | |d<|j | fi|}|j | jfi|} | D]} tt| jdd }|rn|j| j|d |VqYdS) NTrrr)rrryrqrr)chunkr1)rrrprQrrrrr{rErdrwrZsend_message_streamingr5rrrXZon_llm_new_token)r~rxrrrrrrCr responsesrzr(rqrhrr1r1r2rds,  zChatVertexAI._streamr(r&#Union[ChatSession, CodeChatSession]cKs:|js|jjd|j|jd|S|jjdd|ji|S)N)r*message_historyrr1)rrrr*r()r~r(rr1r1r2rszChatVertexAI._start_chat)r4rG)r4r)rrr4r)NNN) rxr3rrrrrrrrr4r)NN) rxr3rrrrrrr4r) rxr3rrrrrrr4r)r(r&rrr4r)r+r,r-r.r}r0rq classmethodrrrrrrrrr1r1r1r2r|s,       9 5 r|)r(r3r4r&)rFr<r4rG)r(r3rQr)r4rR)rqr3r4rr)rxr3r4r)Ar. __future__rraloggingr] dataclassesrrtypingrrrrr r r r urllib.parser rcZlangchain_core._api.deprecationrZlangchain_core.callbacksrrZ*langchain_core.language_models.chat_modelsrrZlangchain_core.messagesrrrrrZlangchain_core.outputsrrrZlangchain_core.utilsrZ!langchain_community.llms.vertexairrrZ&langchain_community.utilities.vertexairr r:r!r"r#r$ror% getLoggerr+rLr&rErPrprwr{r|r1r1r1r2sD (       >