o Zh@sdZddlmZddlmZddlmZddlZddlmZddl m Z m Z edgd Z d d Z dd e e efd dZdddZddedefddZdS)zToken-related utilities) namedtuple)StringIO) iskeywordN) TokenInfo)ListOptionalToken)tokentextstartendlineccs6zt|D]}|VqWdStjyYdSw)z'wrap generate_tkens to catch EOF errorsN)tokenizegenerate_tokens TokenError)readliner rN/var/www/html/lang_env/lib/python3.10/site-packages/IPython/utils/tokenutil.pyrsrextra_errors_to_catchc #sgd}|dust|tsJ||pg}g}zt|D] }|||VqWdStjyuz=tfdd|Dri|rW|djd|djdf}|}|dj }nd}}d}t tj d|||VnWYddSdww)N)zunterminated string literalzinvalid non-printable characterz!after line continuation characterc3s|] }|jdvVqdS)rN)args).0errorexcrr ,sz/generate_tokens_catch_errors..r)r) isinstancelistrrappendranyr r r r ERRORTOKEN) rrZdefault_errors_to_catchZerrors_to_catchtokensr r r r rrrgenerate_tokens_catch_errorss.   r$cCsXd}|d}|D]}|t|}|ds|d7}||kr#||fS|}q d}||fS)aReturn the line in a cell at a given cursor position Used for calling line-based APIs that don't support multi-line input, yet. Parameters ---------- cell : str multiline block of text cursor_pos : integer the cursor position Returns ------- (line, offset): (string, integer) The line with the current cursor, and the character offset of the start of the line. rT rr) splitlineslenendswith)cell cursor_posoffsetlinesr next_offsetrrrline_at_cursor:s   r.r)r*cCsg}g}g}ddi}tt|jD]}t|}|j\}} |j\} } | d|vrI|jd} t| |dD]\} }| |vrH|| dt ||| <q4||}| dkrU|dn|}|| |kr_nn|j t j krt |js|r|r|dj t jkr|djdkrd|d|jf|d<n4||jn-|j t jkr|jdkr|r|d|jdkr|r||dn |jd kr|r|d|||| | |krnq|r|dS|r|dSd S) avGet the token at a given cursor Used for introspection. Function calls are prioritized, so the token for the callable will be returned if the cursor is anywhere inside the call. Parameters ---------- cell : str A block of Python code cursor_pos : int The location of the cursor in the block where the token should be found rrTr.z%s.%s=()r)rrrrr r r r& enumerater'r rNAMErr OPr pop)r)r*namesr#Z call_namesoffsetstuptok start_lineZ start_colend_lineZend_colr,linenor r+boundaryrrrtoken_at_cursor\sL     &    r?)N)r)__doc__ collectionsriorkeywordrrrtypingrrrrstrr$r.intr?rrrrs       "