o <©Zh`Eã@sddlZddlZddlZddlZddlZddlmZddlmZmZm Z m Z mZmZm Z mZddlmZddlmZmZmZmZmZmZmZmZmZerTddlmZmZGdd „d ejd ZGdd„deƒZGd d„deƒZ dZ!ej"dd…dkre!d7Z!e!d7Z!ddd„Z#dS)éN)ÚModule)ÚIterableÚIteratorÚListÚOptionalÚTupleÚAnyÚcastÚ TYPE_CHECKINGé)ÚLineNumbers) ÚTokenÚmatch_tokenÚis_non_coding_tokenÚpatched_generate_tokensÚ last_stmtÚannotate_fstring_nodesÚgenerate_tokensÚ is_moduleÚis_stmt)ÚAstNodeÚ TokenInfoc@sDeZdZdededdfdd„Zejdd„ƒZdd d„Zddd „Z dS)ÚASTTextBaseÚsource_textÚfilenameÚreturnNcCs"||_t|ƒ}||_t|ƒ|_dS©N)Ú _filenameÚstrÚ_textrÚ _line_numbers)Úselfrr©r"úJ/var/www/html/lang_env/lib/python3.10/site-packages/asttokens/asttokens.pyÚ__init__"szASTTextBase.__init__cCst‚)áÎ Returns two ``(lineno, col_offset)`` tuples for the start and end of the given node. If the positions can't be determined, or the nodes don't correspond to any particular text, returns ``(1, 0)`` for both. ``padded`` corresponds to the ``padded`` argument to ``ast.get_source_segment()``. This means that if ``padded`` is True, the start position will be adjusted to include leading whitespace if ``node`` is a multiline statement. )ÚNotImplementedError©r!ÚnodeÚpaddedr"r"r#Úget_text_positions-szASTTextBase.get_text_positionsTcCs(| ||¡\}}|jj|Ž|jj|ŽfS)a Returns the (startpos, endpos) positions in source text corresponding to the given node. Returns (0, 0) for nodes (like `Load`) that don't correspond to any particular text. See ``get_text_positions()`` for details on the ``padded`` argument. )r*r Úline_to_offset©r!r(r)ÚstartÚendr"r"r#Úget_text_range;s þzASTTextBase.get_text_rangecCs| ||¡\}}|j||…S)zÚ Returns the text corresponding to the given node. Returns '' for nodes (like `Load`) that don't correspond to any particular text. See ``get_text_positions()`` for details on the ``padded`` argument. )r/rr,r"r"r#Úget_textIszASTTextBase.get_text)T) Ú__name__Ú __module__Ú__qualname__rr$ÚabcÚabstractmethodr*r/r0r"r"r"r#r!s r)Ú metaclasscs¶eZdZdZd%‡fdd„ Zdd„Zd d „Zedd„ƒZed d„ƒZ edd„ƒZ edd„ƒZdd„Zdd„Z dd„Zd&dd„Zd&dd„Zd'dd„Z d&dd „Zd&d!d"„Zd#d$„Z‡ZS)(Ú ASTTokensaš ASTTokens maintains the text of Python code in several forms: as a string, as line numbers, and as tokens, and is used to mark and access token and position information. ``source_text`` must be a unicode or UTF8-encoded string. If you pass in UTF8 bytes, remember that all offsets you'll get are to the unicode text, which is available as the ``.text`` property. If ``parse`` is set, the ``source_text`` will be parsed with ``ast.parse()``, and the resulting tree marked with token info and made available as the ``.tree`` property. If ``tree`` is given, it will be marked and made available as the ``.tree`` property. In addition to the trees produced by the ``ast`` module, ASTTokens will also mark trees produced using ``astroid`` library . If only ``source_text`` is given, you may use ``.mark_tokens(tree)`` to mark the nodes of an AST tree created separately. FNú csvtt|ƒ ||¡|rt ||¡n||_|durt|jƒ}t| |¡ƒ|_ dd„|j Dƒ|_|jr9| |j¡dSdS)NcSsg|]}|j‘qSr")Ústartpos)Ú.0Útokr"r"r#Ú usz&ASTTokens.__init__..) Úsuperr7r$ÚastÚparseÚ_treerrÚlistÚ_translate_tokensÚ_tokensÚ_token_offsetsÚmark_tokens)r!rr?ÚtreerÚtokens©Ú __class__r"r#r$is ÿzASTTokens.__init__cCsddlm}||ƒ |¡dS)aq Given the root of the AST or Astroid tree produced from source_text, visits all nodes marking them with token and position information by adding ``.first_token`` and ``.last_token`` attributes. This is done automatically in the constructor when ``parse`` or ``tree`` arguments are set, but may be used manually with a separate AST or Astroid tree. r)Ú MarkTokensN)rErJZ visit_tree)r!Z root_noderJr"r"r#rEzs zASTTokens.mark_tokensc csftt|ƒƒD])\}}|\}}}}}t|||||||j |d|d¡|j |d|d¡ƒVqdS)zS Translates the given standard library tokens into our own representation. rrN)Ú enumeraterr r r+) r!Zoriginal_tokensÚindexr;Útok_typeÚtok_strr-r.Úliner"r"r#rB†s€þþzASTTokens._translate_tokenscCó|jS)z,The source code passed into the constructor.)r©r!r"r"r#Útext‘ózASTTokens.textcCrP)zIThe list of tokens corresponding to the source code from the constructor.)rCrQr"r"r#rG—rSzASTTokens.tokenscCrP)zTThe root of the AST tree passed into the constructor or parsed from the source code.)r@rQr"r"r#rFrSzASTTokens.treecCrP)zThe filename that was parsed)rrQr"r"r#r£rSzASTTokens.filenamecCs|jt |j|¡dS)z£ Returns the token containing the given character offset (0-based position in source text), or the preceeding token if the position is between tokens. r)rCÚbisectrD)r!Úoffsetr"r"r#Úget_token_from_offset©szASTTokens.get_token_from_offsetcCs| |j ||¡¡S)zŽ Returns the token containing the given (lineno, col_offset) position, or the preceeding token if the position is between tokens. )rVr r+©r!ÚlinenoÚ col_offsetr"r"r#Ú get_token±s zASTTokens.get_tokencCs| ||j ||¡¡S)zd Same as get_token(), but interprets col_offset as a UTF8 offset, which is what `ast` uses. )rZr Ú from_utf8_colrWr"r"r#Úget_token_from_utf8¼szASTTokens.get_token_from_utf8cCs@|jd}|st|j|jƒr|d7}t|j|jƒs|j|S)z Returns the next token after the given one. If include_extra is True, includes non-coding tokens from the tokenize module, such as NL and COMMENT. r©rLrrCÚtype©r!r;Ú include_extraÚir"r"r#Ú next_tokenÃó ÿ zASTTokens.next_tokencCs@|jd}|st|j|jƒr|d8}t|j|jƒs|j|S)z¥ Returns the previous token before the given one. If include_extra is True, includes non-coding tokens from the tokenize module, such as NL and COMMENT. rr]r_r"r"r#Ú prev_tokenÏrczASTTokens.prev_tokencCsT|}|r|jn|j}t|||ƒs(t |j¡s(||dd}t|||ƒs(t |j¡r|S)z÷ Looks for the first token, starting at start_token, that matches tok_type and, if given, the token string. Searches backwards if reverse is True. Returns ENDMARKER token if not found (you can check it with `token.ISEOF(t.type)`). T©r`)rdrbrÚtokenÚISEOFr^)r!Zstart_tokenrMrNÚreverseÚtÚadvancer"r"r#Ú find_tokenÛsÿzASTTokens.find_tokenccs>t|j|jdƒD]}|st|j|jƒs|j|Vq dS)z² Yields all tokens in order from first_token through and including last_token. If include_extra is True, includes non-coding tokens such as tokenize.NL and .COMMENT. rN)ÚrangerLrrCr^)r!Úfirst_tokenÚ last_tokenr`rar"r"r#Útoken_rangeès€ €þzASTTokens.token_rangecCs|j|j|j|dS)z Yields all tokens making up the given node. If include_extra is True, includes non-coding tokens such as tokenize.NL and .COMMENT. re)rormrn)r!r(r`r"r"r#Ú get_tokensöszASTTokens.get_tokenscCsNt|dƒsdS|jj}|jj}|r#tdd„| |¡Dƒƒr#|ddf}||fS)r%rm©©rrrrcss|] }t|tjƒVqdSr)rrfÚNEWLINE)r:rir"r"r#Ú s€z/ASTTokens.get_text_positions..r)Úhasattrrmr-rnr.Úanyrpr,r"r"r#r*þs zASTTokens.get_text_positions)FNr8N)F)NF)r1r2r3Ú__doc__r$rErBÚpropertyrRrGrFrrVrZr\rbrdrkrorpr*Ú __classcell__r"r"rHr#r7Us. ý r7csJeZdZdZd‡fdd„ Zedd„ƒZedd „ƒZd d„Zdd „Z ‡Z S)ÚASTTextaF Supports the same ``get_text*`` methods as ``ASTTokens``, but uses the AST to determine the text positions instead of tokens. This is faster than ``ASTTokens`` as it requires less setup work. It also (sometimes) supports nodes inside f-strings, which ``ASTTokens`` doesn't. Some node types and/or Python versions are not supported. In these cases the ``get_text*`` methods will fall back to using ``ASTTokens`` which incurs the usual setup cost the first time. If you want to avoid this, check ``supports_tokenless(node)`` before calling ``get_text*`` methods. Nr8cs6tt|ƒ ||¡||_|jdurt|jƒd|_dSr)r=rzr$r@rÚ _asttokens)r!rrFrrHr"r#r$"s zASTText.__init__cCs,|jdurt |j|j¡|_t|jƒ|jSr)r@r>r?rrrrQr"r"r#rF,s zASTText.treecCs&|jdurt|j|j|jd|_|jS)N)rFr)r{r7rrFrrQr"r"r#Ú asttokens4s ýzASTText.asttokensc Cst|ƒrd|j t|jƒ¡fSt|ddƒdurdS|sJ‚t|dgƒ}|s1t|ddƒ}t|dgƒ}|r8|d}n|}|j}t|ƒ}|rZ||jksW||jkrZt|d dƒrZt |ƒrZd}n|j ||j¡}||f} tt |jƒ} tt |jƒ}|j | |¡}| |f}| |fS) zF Version of ``get_text_positions()`` that doesn't use tokens. rrrXNrqÚdecorator_listÚ decoratorsÚnodesrZdoc_node)rr Zoffset_to_lineÚlenrÚgetattrrXrÚ end_linenorr[rYr ÚintÚend_col_offset) r!r(r)r~Zdecorators_nodeZ start_nodeZstart_linenoZend_nodeZstart_col_offsetr-r‚r„r.r"r"r#Ú_get_text_positions_tokenless?s: ÿþz%ASTText._get_text_positions_tokenlesscCs2t|ddƒrdSt|ƒr| ||¡S|j ||¡S)r%Z_broken_positionsNrq)rÚsupports_tokenlessr…r|r*r'r"r"r#r*s zASTText.get_text_positions)Nr8)r1r2r3rwr$rxrFr|r…r*ryr"r"rHr#rzs Brz)Ú argumentsÚ ArgumentsÚwithitemé)éé)ÚargÚStarred)ÚSliceÚExtSliceÚIndexÚkeywordcCsRt|ƒjtvo(t|tjƒo |duo t|ƒjdko t|jƒjdvo(dtj ¡vS)av Returns True if the Python version and the node (if given) are supported by the ``get_text*`` methods of ``ASTText`` without falling back to ``ASTTokens``. See ``ASTText`` for why this matters. The following cases are not supported: - PyPy - ``ast.arguments`` / ``astroid.Arguments`` - ``ast.withitem`` - ``astroid.Comprehension`` - ``astroid.AssignName`` inside ``astroid.Arguments`` or ``astroid.ExceptHandler`` - The following nodes in Python 3.8 only: - ``ast.arg`` - ``ast.Starred`` - ``ast.Slice`` - ``ast.ExtSlice`` - ``ast.Index`` - ``ast.keyword`` NZ AssignName)rˆÚ ExceptHandlerÚpypy) r^r1Ú_unsupported_tokenless_typesÚ isinstancer>ÚASTÚparentÚsysÚversionÚlower)r(r"r"r#r† sûÿ õr†r)$r4r>rTr™rfrÚtypingrrrrrrr r Úline_numbersrÚutilr rrrrrrrrrrÚABCMetarr7rzr•Úversion_infor†r"r"r"r#Ús*(,4A