o
ZhY9 @ s d dl Z d dlmZmZmZmZmZmZmZm Z d dl
m Z d dl m
Z
mZ d dlmZmZ d dlmZmZmZmZmZmZ d dlmZmZm Z d dl m Z m Z e d d
d d e d
efddZ!d e d
efdd
Z"e ddddG dd dee Z#dS ) N)Any
AsyncIteratorDictIteratorListOptionalUnioncast)
deprecated) AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)
BaseChatModelLangSmithParams) AIMessageAIMessageChunk BaseMessage ChatMessage HumanMessage
SystemMessage)ChatGenerationChatGenerationChunk
ChatResult)OllamaEndpointNotFoundError
_OllamaCommon0.0.3._chat_stream_response_to_chat_generation_chunk alternativestream_responsereturnc C s: t | }|ddu r|nd}tt|ddd|dS )0Convert a stream response to a generation chunk.doneTNresponse contentmessagegeneration_infojsonloadsgetr r r Zparsed_responser( r. ]/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/chat_models/ollama.py)_stream_response_to_chat_generation_chunk s
r0 c C sB t | }|ddu r|nd}tt|di ddd|dS ) r r! TNr' r% r# r$ r& r) r- r. r. r/ r $ s
z0.3.1z1.0.0zlangchain_ollama.ChatOllama)ZsinceZremovalZalternative_importc
@ s e Zd ZdZedefddZedefddZ d-de
e e d e de
fd
d Zed d
ddedefddZde e defddZde e de eeeee e f f fddZ d-de e de
e e d e dee fddZ d-de e de
e e d e dee fddZ d.de e de
e e d e
e d ed e def d d Z d.de e de
e e d e
e d ed e def d d!Z d/de e de
e e d e
e d e de f
d"d#Z d/de e de
e e d e
e d e de f
d$d%Z! d/de e de
e e d e
e d e dee f
d&d'Z" d/de e de
e e d e
e d e dee f
d(d)Z#ed d*d d/de e de
e e d e
e d e dee f
d+d,Z$dS )0
ChatOllamaa Ollama locally runs large language models.
To use, follow the instructions at https://ollama.ai/.
Example:
.. code-block:: python
from langchain_community.chat_models import ChatOllama
ollama = ChatOllama(model="llama2")
r c C dS )zReturn type of chat model.z ollama-chatr. selfr. r. r/ _llm_typeC zChatOllama._llm_typec C r2 )z9Return whether this model can be serialized by Langchain.Fr. )clsr. r. r/ is_lc_serializableH r6 z ChatOllama.is_lc_serializableNstopkwargsc K sp | j d
d|i|}td| jd|d| jd}|d| j }r%||d< |p/|ddp/| j }r6||d < |S ) z Get standard params for tracing.r9 ZollamaZchat temperature)Z ls_providerZ
ls_model_nameZ
ls_model_typeZls_temperature num_predict
ls_max_tokensNls_stopr. )Z_get_invocation_paramsr modelr, r; r< r9 )r4 r9 r: paramsZ ls_paramsr= r> r. r. r/ _get_ls_paramsM s zChatOllama._get_ls_paramsr $_convert_messages_to_ollama_messagesr r' c C s t |trd|j d|j }|S t |trPt |jtrGttt |jd }| d}|dkr;d|d d}|S |dkrE|d d }|S d|j d}|S t |t
r[|j }|S t |t rid
|j d }|S t d | )
Nz
z: r typetextz[INST] z [/INST] image_urlurlz<> z <>zGot unknown type )
isinstancer role
capitalizer% r r r r r, r r
ValueError)r4 r' message_textZ
first_content content_typer. r. r/ _format_message_as_text^ s,
z"ChatOllama._format_message_as_textmessagesc s d fdd|D S )N
c s g | ]} |qS r. )rM ).0r' r3 r. r/
v s z7ChatOllama._format_messages_as_text..)join)r4 rN r. r3 r/ _format_messages_as_textt s z#ChatOllama._format_messages_as_textc C sD g }|D ]}d}t |trd}nt |trd}n t |tr d}ntdd}g }t |jtr2|j}ndttt |jD ][}|
ddkrM|d|d 7 }q:|
dd krd }|
d } t | tre|d }nt | t rsd
| v rs| d
}ntd | d }
t
|
d
kr||
d
q:||
d q:td||||d q|S )Nr# userZ assistantsystemz-Received unsupported message type for Ollama.rC rD rO rE rF zSOnly string image_url or dict with string 'url' inside content parts are supported., r zsUnsupported message content type. Must either have type 'text' or type 'image_url' with a string 'image_url' field.)rH r% images)rG r r r rJ r% strr r r r, dictsplitlenappend) r4 rN Zollama_messagesr' rH r% rX Z content_partrE Ztemp_image_urlZimage_url_componentsr. r. r/ rB y sV
z/ChatOllama._convert_messages_to_ollama_messagesc k s> | j | |d}| jd||| j dd|E d H d S N)r? rN z /api/chat)payloadr9 Zapi_urlr. )r? rB Z_create_streambase_url)r4 rN r9 r: r_ r. r. r/ _create_chat_stream s z ChatOllama._create_chat_streamc K sN | j | |d}| jd||| j dd|2 z 3 d H W }|V q6 d S r^ )r? rB Z_acreate_streamr` )r4 rN r9 r: r_ stream_respr. r. r/ _acreate_chat_stream s z ChatOllama._acreate_chat_streamF run_managerverbosec K sj d }| j ||fi |D ] }|r*t|}|d u r|}n||7 }|r*|j|j||d q |d u r3td|S Nchunkre z$No data received from Ollama stream.)ra r on_llm_new_tokenrD rJ r4 rN r9 rd re r: final_chunkrb rh r. r. r/ _chat_stream_with_aggregation s" z(ChatOllama._chat_stream_with_aggregationc s| d }| j ||fi |2 z%3 d H W }|r2t|}|d u r |}n||7 }|r2|j|j||dI d H q
6 |d u r | j |f||| jd|}tt|jd|jd}t|gdS ) Call out to Ollama's generate endpoint.
Args:
messages: The list of base messages to pass into the model.
stop: Optional list of stop words to use when generating.
Returns:
Chat generations from the model
Example:
.. code-block:: python
response = ollama([
HumanMessage(content="Tell me about the history of AI")
])
r9 rd re r$ r& Z generations)rl re r r rD r( r r4 rN r9 rd r: rk Zchat_generationr. r. r/ _generate s
zChatOllama._generatec sF | j |f||| jd|I dH }tt|jd|jd}t|gdS )rn ro Nr$ r& rp )rm re r r rD r( r rq r. r. r/
_agenerate0 s
zChatOllama._ageneratec k s| z%| j ||fi |D ]}|r#t|}|r |j|j|| jd |V q W d S ty= | j||fi |E d H Y d S w Nrg )ra r ri rD re r _legacy_streamr4 rN r9 rd r: rb rh r. r. r/ _streamU s"
zChatOllama._streamc K sZ | j ||fi |2 z 3 d H W }|r)t|}|r&|j|j|| jdI d H |V q 6 d S rt )rc r ri rD re rv r. r. r/ _astreamj s zChatOllama._astreamrw c k sT | |}| j||fi |D ]}|r't|}|r$|j|j|| jd |V qd S rt )rS Z_create_generate_streamr0 ri rD re )r4 rN r9 rd r: promptrb rh r. r. r/ ru | s
zChatOllama._legacy_stream)N)NNF)NN)%__name__
__module__ __qualname____doc__propertyrY r5 classmethodboolr8 r r r r rA r
r rM rS r r rB r ra r rc r r rl r rm r rr rs rw rx ru r. r. r. r/ r1 2 s
B
(
(
r1 )$r* typingr r r r r r r r Zlangchain_core._apir
Zlangchain_core.callbacksr r Z*langchain_core.language_models.chat_modelsr
r Zlangchain_core.messagesr r r r r r Zlangchain_core.outputsr r r Z langchain_community.llms.ollamar r rY r0 r r1 r. r. r. r/ s2 (