o
Zh* @ sr d dl Z d dlmZ d dlmZmZmZmZmZm Z m
Z
d dl m Z d dl
mZ d dlmZ d dlmZmZmZmZmZmZ d dlmZmZmZ d d l m Z d d
l m Z d d l m!Z! d d l"m#Z# d d
l$m%Z%m&Z& dede'fddZ(dee de'fddZ)de'defddZ*dee de ee' ee f fddZ+G dd dZ,d d d d d d Z-e d d d!d"G d#d$ d$ee#Z.dS )% N) defaultdict)AnyDictIteratorListOptionalTupleUnion)
deprecated)CallbackManagerForLLMRun)
BaseChatModel) AIMessageAIMessageChunk BaseMessage ChatMessage HumanMessage
SystemMessage)ChatGenerationChatGenerationChunk
ChatResult)
ConfigDict)$convert_messages_to_prompt_anthropic) convert_messages_to_prompt_llama) BedrockBase)get_num_tokens_anthropicget_token_ids_anthropicmessagereturnc C s t | trd| j d| j }|S t | tr!d| j d}|S t | tr,| j }|S t | tr:d| j d}|S td| )Nz
z: z[INST] z [/INST]z<> z <>zGot unknown type )
isinstancer role
capitalizecontentr r
r
ValueError)r message_text r$ ^/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/chat_models/bedrock.py$_convert_one_message_to_text_mistral s
r& messagesc C s d dd | D S )z3Convert a list of messages to a prompt for mistral.
c S s g | ]}t |qS r$ )r& ).0r r$ r$ r%
1 s z6convert_messages_to_prompt_mistral..)joinr' r$ r$ r% "convert_messages_to_prompt_mistral. s r- image_urlc C s8 d}t || }|du rtdd|d|ddS )a
Formats an image of format data:image/jpeg;base64,{b64_string}
to a dict for anthropic api
{
"type": "base64",
"media_type": "image/jpeg",
"data": "/9j/4AAQSkZJRg...",
}
And throws an error if it's not a b64 image
z3^data:(?Pimage/.+);base64,(?P.+)$NzgAnthropic only supports base64-encoded images currently. Example: data:image/png;base64,'/9j/4AAQSk'...base64
media_typedata)typer0 r1 )rematchr" group)r. regexr4 r$ r$ r%
_format_image5 s
r7 c C s8 d}g }t | D ]\}}|jdkr.|dkrtdt|jts*tdt|j |j}q t|j }t|jtst|jtsCJ dg }|jD ]B}t|trX|d|d qHt|t rd |vretd
|d d kr|t
|d d }|d
|d qH|| qHtdt| n|j}|||d q ||fS )z Format messages for anthropic.Nsystemr z4System message must be at beginning of message list.z.System message must be a string, instead was: z6Anthropic message content must be str or list of dictstext)r2 r9 r2 z&Dict content item must have a type keyr. urlimage)r2 sourcez0Content items must be str or dict, instead was: )r r! ) enumerater2 r" r r! str_message_type_lookupslistappenddictr7 ) r' r8 formatted_messagesir r r! itemr< r$ r$ r% _format_anthropic_messagesP sd
rF c
@ s\ e Zd ZdZededee defddZededee de e
e ee f fddZ d S )
ChatPromptAdapterzeAdapter class to prepare the inputs from Langchain to prompt format
that Chat model expects.
providerr' r c C sl |dkr t |d}|S |dkrt|d}|S |dkr!t|d}|S |dkr.t |ddd}|S td | d
) N anthropicr, metaZmistralZamazonz
User:z
Bot:)r' Z human_promptZ ai_prompt Provider z model does not support chat.)r r r- NotImplementedError)clsrH r' promptr$ r$ r% convert_messages_to_prompt s&
z,ChatPromptAdapter.convert_messages_to_promptc C s |dkrt |S td| d)NrI rK z" not supported for format_messages)rF rL )rM rH r' r$ r$ r% format_messages s
z!ChatPromptAdapter.format_messagesN)
__name__
__module__ __qualname____doc__ classmethodr> r r rO r r r rP r$ r$ r$ r% rG s$ rG userZ assistant)ZhumanZair ZHumanMessageChunkfunctionz0.0.34z1.0zlangchain_aws.ChatBedrock)ZsinceZremovalZalternative_importc s( e Zd ZdZedefddZedefddZ ede
e fddZ ede ee
f fd d
Zed d Z
d de
e dee
e dee de
dee f
ddZ
d de
e dee
e dee de
def
ddZde
ee defddZdedef fdd Z dede
e f fd d Z Z S ) BedrockChatz%Chat model that uses the Bedrock API.r c C dS )zReturn type of chat model.Zamazon_bedrock_chatr$ )selfr$ r$ r% _llm_type zBedrockChat._llm_typec C rY )z9Return whether this model can be serialized by Langchain.Tr$ rM r$ r$ r% is_lc_serializable r\ z BedrockChat.is_lc_serializablec C s g dS )z*Get the namespace of the langchain object.)Z langchainZ chat_modelsZbedrockr$ r] r$ r$ r% get_lc_namespace s z BedrockChat.get_lc_namespacec C s i }| j r
| j |d< |S )N region_name)r` )rZ
attributesr$ r$ r%
lc_attributes s
zBedrockChat.lc_attributesZforbid)extraNr' stop run_managerkwargsc k sz | }d\}}}|dkrt||\}}ntj||d}| jd|||||d|D ]} | j}
tt|
ddV q,d S )NNNNrI rH r' )rN r8 r' rd re r! r r$ )
_get_providerrG rP rO Z _prepare_input_and_invoke_streamr9 r r ) rZ r' rd re rf rH rN r8 rC chunkdeltar$ r$ r% _stream s,
zBedrockChat._streamc K s d}d| j i}| jr | j|||fi |D ]}||j7 }qn;| }d\} }
} i |} |dkr8t||\}
} ntj||d} |rE|| d< | jd | |||
| d| \}}
|
|d< t t
t |d d
g|d S )
N model_idrg rI rh Zstop_sequences)rN rd re r8 r' usageri rj )Z generations
llm_outputr$ ) rp Z streamingrn r9 rk rG rP rO Z_prepare_input_and_invoker r r
)rZ r' rd re rf
completionrr rl rH rN r8 rC paramsZ
usage_infor$ r$ r% _generate
s@
zBedrockChat._generate llm_outputsc C sb t t}i }|D ]"}|p
i }|di }| D ] \}}|| |7 < q|| q||d< |S )Nrq )r intgetitemsupdate)rZ rv Z final_usageZ final_outputoutputrq
token_typeZ token_countr$ r$ r% _combine_llm_outputs; s z BedrockChat._combine_llm_outputsr9 c | j rt|S t |S N)_model_is_anthropicr superget_num_tokensrZ r9 __class__r$ r% r G zBedrockChat.get_num_tokensc r~ r )r r r
get_token_idsr r r$ r% r M r zBedrockChat.get_token_ids)NN) rQ rR rS rT propertyr> r[ rU boolr^ r r_ r r rb r Z model_configr r r r r rn r ru rB r} rw r r
__classcell__r$ r$ r r% rX sT
!
. "rX )/r3 collectionsr typingr r r r r r r Z langchain_core._api.deprecationr
Zlangchain_core.callbacksr Z*langchain_core.language_models.chat_modelsr Zlangchain_core.messagesr
r r r r r Zlangchain_core.outputsr r r Zpydanticr Z)langchain_community.chat_models.anthropicr Z$langchain_community.chat_models.metar Z langchain_community.llms.bedrockr Z'langchain_community.utilities.anthropicr r r> r& r- r7 rF rG r? rX r$ r$ r$ r% s@ $
M(