o Zh<"@sddlZddlmZmZmZmZmZddlmZm Z ddl m Z ddl m Z ddlmZmZddlmZdefd d Zdefd d Zd ededefddZGddde ZdS)N)AnyDictListOptionalcast) AgentAction AgentFinish)BaseCallbackHandler) BaseMessage)ChatGeneration LLMResult guard_importreturncCs tdS)zImport the infino client.Zinfinopy)rZ InfinoClientrrd/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/callbacks/infino_callback.py import_infino s rcCstdS)z6Import tiktoken for counting tokens for OpenAI models.tiktokenr rrrrimport_tiktokensrstringopenai_model_namecCs"t}||}t||}|S)zCalculate num tokens for OpenAI with tiktoken package. Official documentation: https://github.com/openai/openai-cookbook/blob/main /examples/How_to_count_tokens_with_tiktoken.ipynb )rZencoding_for_modellenencode)rrrencoding num_tokensrrrget_num_tokenss rc @seZdZdZ   dd,ed-eed.eededdf d/d0Zdededdfd1d2Zd3ededdfd4d5Zd6ededdfd7d8Zde eefd9e e ededdfd:d;ZdS)?InfinoCallbackHandlerz%Callback Handler that logs to Infino.NFmodel_id model_versionverbosercCs*t|_||_||_||_d|_d|_dS)NFz gpt-3.5-turbo)rclientrrris_chat_openai_modelchat_openai_model_name)selfrrrrrr__init__%s  zInfinoCallbackHandler.__init__Tkeyvalueis_tscCs`dtt||d|j|jdi}|jrtd|d||r(|j|dS|j|dS)aSend the key-value to Infino. Parameters: key (str): the key to send to Infino. value (Any): the value to send to Infino. is_ts (bool): if True, the value is part of a time series, else it is sent as a log message. datelabels)rrz Tracking z with Infino: N) inttimerrrprintr Z append_tsZ append_log)r#r%r&r'payloadrrr_send_to_infino3s z%InfinoCallbackHandler._send_to_infino serializedpromptskwargscKs.|D] }|jd|ddqd|_t|_dS)z=Log the prompts to Infino, and set start time and error flag.promptFr'rN)r.errorr+ start_time)r#r/r0r1r2rrr on_llm_startSsz"InfinoCallbackHandler.on_llm_starttokencKdS)z)Do nothing when a new token is generated.Nr)r#r7r1rrron_llm_new_tokenez&InfinoCallbackHandler.on_llm_new_tokenresponsec Kst|_|j|j}|d||d|j|jD]}|D] }|jd|jddqq|jdur^t|jt r^|jd}|dur^|d}|d }|d } |d||d ||d | |j rzd d d |D} t | |j d} |d | dSdS)zs  z3InfinoCallbackHandler.on_llm_end..r)r+end_timer5r.r4 generationstextZ llm_output isinstancerr!joinrr") r#r;r1durationrJrFr<r=r>r?messagesrrr on_llm_endis4         z InfinoCallbackHandler.on_llm_endr4cKs d|_dS)zSet the error flag.N)r4r#r4r1rrr on_llm_errors z"InfinoCallbackHandler.on_llm_errorinputscKr8)z!Do nothing when LLM chain starts.Nr)r#r/rTr1rrron_chain_startsz$InfinoCallbackHandler.on_chain_startoutputscKr8)zDo nothing when LLM chain ends.Nr)r#rVr1rrr on_chain_endr:z"InfinoCallbackHandler.on_chain_endcKr8)zNeed to log the error.NrrRrrron_chain_errorr:z$InfinoCallbackHandler.on_chain_error input_strcKr8)zDo nothing when tool starts.Nr)r#r/rYr1rrr on_tool_startsz#InfinoCallbackHandler.on_tool_startactioncKr8)z.Do nothing when agent takes a specific action.Nr)r#r[r1rrron_agent_actionr:z%InfinoCallbackHandler.on_agent_actionoutputobservation_prefix llm_prefixcKr8)zDo nothing when tool ends.Nr)r#r]r^r_r1rrr on_tool_endsz!InfinoCallbackHandler.on_tool_endcKr8)z&Do nothing when tool outputs an error.NrrRrrr on_tool_errorr:z#InfinoCallbackHandler.on_tool_errorrKcKr8z Do nothing.Nr)r#rKr1rrron_textr:zInfinoCallbackHandler.on_textfinishcKr8rbr)r#rdr1rrron_agent_finishr:z%InfinoCallbackHandler.on_agent_finishrOc Ks|d}|r|D] }|dkrd|_nq |jrK|d}|rK|d}|rK||_d}|D]} ddd | D} t| |jd } || 7}q-|d ||jrZtd |jd |jddd |D} |jd| ddd|_t |_ dS)zRun when LLM starts running.idZ ChatOpenAITinvocation_params model_namerr@css|] }tt|jVqdSrArrBrD)rEmsgrrrrGs  z.rHr=z=on_chat_model_start: is_chat_openai_model= z+, chat_openai_model_name=css&|]}|D] }tt|jVqqdSrAri)rEZsublistrjrrrrGs   r2Fr3N) getr!r"rMrr.rr,r4r+r5) r#r/rOr1valuesr&rgrhr=Z message_listZmessage_stringrr2rrron_chat_model_startsL       z)InfinoCallbackHandler.on_chat_model_start)NNF)T)NN)__name__ __module__ __qualname____doc__rrBboolr$rr.rrr6r9r rP BaseExceptionrSrUrWrXrZrr\r`rarcrrer rmrrrrr"s    %          r)r+typingrrrrrZlangchain_core.agentsrrZlangchain_core.callbacksr Zlangchain_core.messagesr Zlangchain_core.outputsr r Zlangchain_core.utilsrrrrBr*rrrrrrs