o Zh @sdZddlZddlmZddlmZmZmZddlm Z ddl m Z de de d ed e d ef d d Zded efddZGddde ZdS)zLoads .ipynb notebook files.N)Path)AnyListUnion)Document) BaseLoadercellinclude_outputsmax_output_length tracebackreturnc Cs|d}|d}|rz|d}Wn tyYnw|r|dkr|rd|dvr_|dd}|dd}|rP|dd}d |d |d |d |d |d Sd |d |d |d|d S|dddkr|dd}t|t|} d |d |d|d| dSdSd |d |dS)asCombine cells information in a readable format ready to be used. Args: cell: A dictionary include_outputs: Whether to include the outputs of the cell. max_output_length: Maximum length of the output to be displayed. traceback: Whether to return a traceback of the error. Returns: A string with the cell information. cell_typesourceoutputscodeZenamerZevaluer 'z ' cell: 'z' , gives error 'z', with description 'z' and traceback 'z' z',with description ' output_typestreamtextz' with output: 'N)KeyErrorkeysminlen) rr r r r routputZ error_nameZ error_valueZ min_outputrd/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/document_loaders/notebook.pyconcatenate_cells sB       rxcCsNt|tr |ddSt|trdd|DSt|tr%dd|DS|S)zMRecursively remove newlines, no matter the data structure they are stored in. rcSsg|]}t|qSrremove_newlines).0elemrrr Fsz#remove_newlines..cSsi|] \}}|t|qSrr r"kvrrr Hsz#remove_newlines..) isinstancestrreplacelistdictitemsrrrrr!@s    r!c @sReZdZdZ    ddeeefdedededef d d Z d e e fd d Z dS)NotebookLoaderz'Load `Jupyter notebook` (.ipynb) files.F pathr r remove_newliner cCs"||_||_||_||_||_dS)aInitialize with a path. Args: path: The path to load the notebook from. include_outputs: Whether to include the outputs of the cell. Defaults to False. max_output_length: Maximum length of the output to be displayed. Defaults to 10. remove_newline: Whether to remove newlines from the notebook. Defaults to False. traceback: Whether to return a traceback of the error. Defaults to False. N) file_pathr r r3r )selfr2r r r3r rrr__init__Ps  zNotebookLoader.__init__r cstj}t|dd }t|}Wdn1swYdd|dD}jr3ttt|}d ttfdd |}d t |i}t ||d gS) zLoad documents.utf8)encodingNcSsg|] }dd|DqS)cSsi|] \}}|dvr||qS))r rrrr%rrrr(usz2NotebookLoader.load...)r.)r"rrrrr$tsz'NotebookLoader.load..cellsrcst|jjjS)N)rr r r r/r5rrsz%NotebookLoader.load..r)Z page_contentmetadata) rr4openjsonloadr3r,mapr!joinr*r)r5pfdZ filtered_datarr<rr:rr?ks&    zNotebookLoader.loadN)Fr1FF) __name__ __module__ __qualname____doc__rr*rboolintr6rrr?rrrrr0Ms(  r0)rHr>pathlibrtypingrrrZlangchain_core.documentsrZ)langchain_community.document_loaders.baserr-rIrJr*rr!r0rrrrs&    4