o Zh @sddlZddlmZddlmZmZmZmZmZddl m Z defddZ defdd Z defd d Z ddeeefdededeeeeffddZ ddeeefdededeeeffddZdedefddZdeeefdefddZGdddZdS)N)Path)AnyDictIterableTupleUnion guard_importreturncCtdS)zJImport the spacy python package and raise an error if it is not installed.Zspacyrr r Z/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/callbacks/utils.py import_spacyrcCr )zKImport the pandas python package and raise an error if it is not installed.Zpandasrr r r r import_pandas rrcCr )zMImport the textstat python package and raise an error if it is not installed.Ztextstatrr r r r import_textstatrr_ nested_dict parent_keysepccsT|D]"\}}|r|||n|}t|tr"t|||EdHq||fVqdS)a Generator that yields flattened items from a nested dictionary for a flat dict. Parameters: nested_dict (dict): The nested dictionary to flatten. parent_key (str): The prefix to prepend to the keys of the flattened dict. sep (str): The separator to use between the parent key and the key of the flattened dictionary. Yields: (str, any): A key-value pair from the flattened dictionary. N)items isinstancedict _flatten_dict)rrrkeyvalueZnew_keyr r r rs  rcCsddt|||D}|S)aFlatten a nested dictionary into a flat dictionary. Parameters: nested_dict (dict): The nested dictionary to flatten. parent_key (str): The prefix to prepend to the keys of the flattened dict. sep (str): The separator to use between the parent key and the key of the flattened dictionary. Returns: (dict): A flat dictionary. cSsi|]\}}||qSr r ).0kvr r r =sz flatten_dict..)r)rrrZ flat_dictr r r flatten_dict.sr!scCst|dS)zHash a string using sha1. Parameters: s (str): The string to hash. Returns: (str): The hashed string. zutf-8)hashlibsha1encode hexdigest)r"r r r hash_stringAs r' json_pathcCs8t|d }|}Wd|S1swY|S)zLoad json file to a string. Parameters: json_path (str): The path to the json file. Returns: (str): The string representation of the json file. rN)openread)r(fdatar r r load_jsonMs  r.c@seZdZdZdddZedefddZedefdd Zedefd d Z edefd d Z de e e ffddZdddZdS)BaseMetadataCallbackHandlera'Handle the metadata and associated function states for callbacks. Attributes: step (int): The current step. starts (int): The number of times the start method has been called. ends (int): The number of times the end method has been called. errors (int): The number of times the error method has been called. text_ctr (int): The number of times the text method has been called. ignore_llm_ (bool): Whether to ignore llm callbacks. ignore_chain_ (bool): Whether to ignore chain callbacks. ignore_agent_ (bool): Whether to ignore agent callbacks. ignore_retriever_ (bool): Whether to ignore retriever callbacks. always_verbose_ (bool): Whether to always be verbose. chain_starts (int): The number of times the chain start method has been called. chain_ends (int): The number of times the chain end method has been called. llm_starts (int): The number of times the llm start method has been called. llm_ends (int): The number of times the llm end method has been called. llm_streams (int): The number of times the text method has been called. tool_starts (int): The number of times the tool start method has been called. tool_ends (int): The number of times the tool end method has been called. agent_ends (int): The number of times the agent end method has been called. on_llm_start_records (list): A list of records of the on_llm_start method. on_llm_token_records (list): A list of records of the on_llm_token method. on_llm_end_records (list): A list of records of the on_llm_end method. on_chain_start_records (list): A list of records of the on_chain_start method. on_chain_end_records (list): A list of records of the on_chain_end method. on_tool_start_records (list): A list of records of the on_tool_start method. on_tool_end_records (list): A list of records of the on_tool_end method. on_agent_finish_records (list): A list of records of the on_agent_end method. r NcCsd|_d|_d|_d|_d|_d|_d|_d|_d|_d|_ d|_ d|_ d|_ d|_ d|_d|_d|_d|_g|_g|_g|_g|_g|_g|_g|_g|_g|_g|_dS)NrF)stepstartsendserrorstext_ctr ignore_llm_ ignore_chain_ ignore_agent_Zignore_retriever_always_verbose_ chain_starts chain_ends llm_startsllm_ends llm_streams tool_starts tool_ends agent_endson_llm_start_recordson_llm_token_recordson_llm_end_recordson_chain_start_recordson_chain_end_recordson_tool_start_recordson_tool_end_recordson_text_recordson_agent_finish_recordson_agent_action_recordsselfr r r __init__{s8 z$BaseMetadataCallbackHandler.__init__cC|jS)z;Whether to call verbose callbacks even if verbose is False.)r8rKr r r always_verbosez*BaseMetadataCallbackHandler.always_verbosecCrN)z Whether to ignore LLM callbacks.)r5rKr r r ignore_llmrPz&BaseMetadataCallbackHandler.ignore_llmcCrN)z"Whether to ignore chain callbacks.)r6rKr r r ignore_chainrPz(BaseMetadataCallbackHandler.ignore_chaincCrN)z"Whether to ignore agent callbacks.)r7rKr r r ignore_agentrPz(BaseMetadataCallbackHandler.ignore_agentcCs:|j|j|j|j|j|j|j|j|j|j |j |j |j d S)N r0r1r2r3r4r9r:r;r<r=r>r?r@rTrKr r r get_custom_callback_metasz4BaseMetadataCallbackHandler.get_custom_callback_metacCsd|_d|_d|_d|_d|_d|_d|_d|_d|_d|_ d|_ d|_ d|_ d|_ d|_d|_d|_g|_g|_g|_g|_g|_g|_g|_g|_g|_g|_dS)zReset the callback metadata.rFN)r0r1r2r3r4r5r6r7r8r9r:r;r<r=r>r?r@rArBrCrDrErFrGrHrIrJrKr r r reset_callback_metas8z/BaseMetadataCallbackHandler.reset_callback_meta)r N)__name__ __module__ __qualname____doc__rMpropertyboolrOrQrRrSrstrrrUrVr r r r r/[s (r/)rr)r#pathlibrtypingrrrrrZlangchain_core.utilsr rrrr]rr!r'r.r/r r r r s<