summaryrefslogtreecommitdiff
path: root/devdocs/python~3.12/library%2Ftoken.html
diff options
context:
space:
mode:
authorCraig Jennings <c@cjennings.net>2025-08-14 22:58:58 -0500
committerCraig Jennings <c@cjennings.net>2025-08-14 22:58:58 -0500
commit82ba818ff456bcd6d56a06226e3f27e98fbb55c3 (patch)
tree158cfc17b2f644a10f063cb546752cfaae12c97f /devdocs/python~3.12/library%2Ftoken.html
parent9278ddd4ea1a8b1a4c1edaa8894516e3f48d245b (diff)
downloaddotemacs-82ba818ff456bcd6d56a06226e3f27e98fbb55c3.tar.gz
dotemacs-82ba818ff456bcd6d56a06226e3f27e98fbb55c3.zip
removing all downloaded devdocs files
Diffstat (limited to 'devdocs/python~3.12/library%2Ftoken.html')
-rw-r--r--devdocs/python~3.12/library%2Ftoken.html216
1 files changed, 0 insertions, 216 deletions
diff --git a/devdocs/python~3.12/library%2Ftoken.html b/devdocs/python~3.12/library%2Ftoken.html
deleted file mode 100644
index 798b567b..00000000
--- a/devdocs/python~3.12/library%2Ftoken.html
+++ /dev/null
@@ -1,216 +0,0 @@
- <span id="token-constants-used-with-python-parse-trees"></span><h1>token — Constants used with Python parse trees</h1> <p><strong>Source code:</strong> <a class="reference external" href="https://github.com/python/cpython/tree/3.12/Lib/token.py">Lib/token.py</a></p> <p>This module provides constants which represent the numeric values of leaf nodes of the parse tree (terminal tokens). Refer to the file <code>Grammar/Tokens</code> in the Python distribution for the definitions of the names in the context of the language grammar. The specific numeric values which the names map to may change between Python versions.</p> <p>The module also provides a mapping from numeric codes to names and some functions. The functions mirror definitions in the Python C header files.</p> <dl class="py data"> <dt class="sig sig-object py" id="token.tok_name">
-<code>token.tok_name</code> </dt> <dd>
-<p>Dictionary mapping the numeric values of the constants defined in this module back to name strings, allowing more human-readable representation of parse trees to be generated.</p> </dd>
-</dl> <dl class="py function"> <dt class="sig sig-object py" id="token.ISTERMINAL">
-<code>token.ISTERMINAL(x)</code> </dt> <dd>
-<p>Return <code>True</code> for terminal token values.</p> </dd>
-</dl> <dl class="py function"> <dt class="sig sig-object py" id="token.ISNONTERMINAL">
-<code>token.ISNONTERMINAL(x)</code> </dt> <dd>
-<p>Return <code>True</code> for non-terminal token values.</p> </dd>
-</dl> <dl class="py function"> <dt class="sig sig-object py" id="token.ISEOF">
-<code>token.ISEOF(x)</code> </dt> <dd>
-<p>Return <code>True</code> if <em>x</em> is the marker indicating the end of input.</p> </dd>
-</dl> <p>The token constants are:</p> <dl class="py data"> <dt class="sig sig-object py" id="token.ENDMARKER">
-<code>token.ENDMARKER</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.NAME">
-<code>token.NAME</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.NUMBER">
-<code>token.NUMBER</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.STRING">
-<code>token.STRING</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.NEWLINE">
-<code>token.NEWLINE</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.INDENT">
-<code>token.INDENT</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.DEDENT">
-<code>token.DEDENT</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.LPAR">
-<code>token.LPAR</code> </dt> <dd>
-<p>Token value for <code>"("</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.RPAR">
-<code>token.RPAR</code> </dt> <dd>
-<p>Token value for <code>")"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.LSQB">
-<code>token.LSQB</code> </dt> <dd>
-<p>Token value for <code>"["</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.RSQB">
-<code>token.RSQB</code> </dt> <dd>
-<p>Token value for <code>"]"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.COLON">
-<code>token.COLON</code> </dt> <dd>
-<p>Token value for <code>":"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.COMMA">
-<code>token.COMMA</code> </dt> <dd>
-<p>Token value for <code>","</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.SEMI">
-<code>token.SEMI</code> </dt> <dd>
-<p>Token value for <code>";"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.PLUS">
-<code>token.PLUS</code> </dt> <dd>
-<p>Token value for <code>"+"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.MINUS">
-<code>token.MINUS</code> </dt> <dd>
-<p>Token value for <code>"-"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.STAR">
-<code>token.STAR</code> </dt> <dd>
-<p>Token value for <code>"*"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.SLASH">
-<code>token.SLASH</code> </dt> <dd>
-<p>Token value for <code>"/"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.VBAR">
-<code>token.VBAR</code> </dt> <dd>
-<p>Token value for <code>"|"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.AMPER">
-<code>token.AMPER</code> </dt> <dd>
-<p>Token value for <code>"&amp;"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.LESS">
-<code>token.LESS</code> </dt> <dd>
-<p>Token value for <code>"&lt;"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.GREATER">
-<code>token.GREATER</code> </dt> <dd>
-<p>Token value for <code>"&gt;"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.EQUAL">
-<code>token.EQUAL</code> </dt> <dd>
-<p>Token value for <code>"="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.DOT">
-<code>token.DOT</code> </dt> <dd>
-<p>Token value for <code>"."</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.PERCENT">
-<code>token.PERCENT</code> </dt> <dd>
-<p>Token value for <code>"%"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.LBRACE">
-<code>token.LBRACE</code> </dt> <dd>
-<p>Token value for <code>"{"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.RBRACE">
-<code>token.RBRACE</code> </dt> <dd>
-<p>Token value for <code>"}"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.EQEQUAL">
-<code>token.EQEQUAL</code> </dt> <dd>
-<p>Token value for <code>"=="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.NOTEQUAL">
-<code>token.NOTEQUAL</code> </dt> <dd>
-<p>Token value for <code>"!="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.LESSEQUAL">
-<code>token.LESSEQUAL</code> </dt> <dd>
-<p>Token value for <code>"&lt;="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.GREATEREQUAL">
-<code>token.GREATEREQUAL</code> </dt> <dd>
-<p>Token value for <code>"&gt;="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.TILDE">
-<code>token.TILDE</code> </dt> <dd>
-<p>Token value for <code>"~"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.CIRCUMFLEX">
-<code>token.CIRCUMFLEX</code> </dt> <dd>
-<p>Token value for <code>"^"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.LEFTSHIFT">
-<code>token.LEFTSHIFT</code> </dt> <dd>
-<p>Token value for <code>"&lt;&lt;"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.RIGHTSHIFT">
-<code>token.RIGHTSHIFT</code> </dt> <dd>
-<p>Token value for <code>"&gt;&gt;"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.DOUBLESTAR">
-<code>token.DOUBLESTAR</code> </dt> <dd>
-<p>Token value for <code>"**"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.PLUSEQUAL">
-<code>token.PLUSEQUAL</code> </dt> <dd>
-<p>Token value for <code>"+="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.MINEQUAL">
-<code>token.MINEQUAL</code> </dt> <dd>
-<p>Token value for <code>"-="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.STAREQUAL">
-<code>token.STAREQUAL</code> </dt> <dd>
-<p>Token value for <code>"*="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.SLASHEQUAL">
-<code>token.SLASHEQUAL</code> </dt> <dd>
-<p>Token value for <code>"/="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.PERCENTEQUAL">
-<code>token.PERCENTEQUAL</code> </dt> <dd>
-<p>Token value for <code>"%="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.AMPEREQUAL">
-<code>token.AMPEREQUAL</code> </dt> <dd>
-<p>Token value for <code>"&amp;="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.VBAREQUAL">
-<code>token.VBAREQUAL</code> </dt> <dd>
-<p>Token value for <code>"|="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.CIRCUMFLEXEQUAL">
-<code>token.CIRCUMFLEXEQUAL</code> </dt> <dd>
-<p>Token value for <code>"^="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.LEFTSHIFTEQUAL">
-<code>token.LEFTSHIFTEQUAL</code> </dt> <dd>
-<p>Token value for <code>"&lt;&lt;="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.RIGHTSHIFTEQUAL">
-<code>token.RIGHTSHIFTEQUAL</code> </dt> <dd>
-<p>Token value for <code>"&gt;&gt;="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.DOUBLESTAREQUAL">
-<code>token.DOUBLESTAREQUAL</code> </dt> <dd>
-<p>Token value for <code>"**="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.DOUBLESLASH">
-<code>token.DOUBLESLASH</code> </dt> <dd>
-<p>Token value for <code>"//"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.DOUBLESLASHEQUAL">
-<code>token.DOUBLESLASHEQUAL</code> </dt> <dd>
-<p>Token value for <code>"//="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.AT">
-<code>token.AT</code> </dt> <dd>
-<p>Token value for <code>"@"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.ATEQUAL">
-<code>token.ATEQUAL</code> </dt> <dd>
-<p>Token value for <code>"@="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.RARROW">
-<code>token.RARROW</code> </dt> <dd>
-<p>Token value for <code>"-&gt;"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.ELLIPSIS">
-<code>token.ELLIPSIS</code> </dt> <dd>
-<p>Token value for <code>"..."</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.COLONEQUAL">
-<code>token.COLONEQUAL</code> </dt> <dd>
-<p>Token value for <code>":="</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.EXCLAMATION">
-<code>token.EXCLAMATION</code> </dt> <dd>
-<p>Token value for <code>"!"</code>.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.OP">
-<code>token.OP</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.AWAIT">
-<code>token.AWAIT</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.ASYNC">
-<code>token.ASYNC</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.TYPE_IGNORE">
-<code>token.TYPE_IGNORE</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.TYPE_COMMENT">
-<code>token.TYPE_COMMENT</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.SOFT_KEYWORD">
-<code>token.SOFT_KEYWORD</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.FSTRING_START">
-<code>token.FSTRING_START</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.FSTRING_MIDDLE">
-<code>token.FSTRING_MIDDLE</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.FSTRING_END">
-<code>token.FSTRING_END</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.COMMENT">
-<code>token.COMMENT</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.NL">
-<code>token.NL</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.ERRORTOKEN">
-<code>token.ERRORTOKEN</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.N_TOKENS">
-<code>token.N_TOKENS</code> </dt> <dd></dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.NT_OFFSET">
-<code>token.NT_OFFSET</code> </dt> <dd></dd>
-</dl> <p>The following token type values aren’t used by the C tokenizer but are needed for the <a class="reference internal" href="tokenize#module-tokenize" title="tokenize: Lexical scanner for Python source code."><code>tokenize</code></a> module.</p> <dl class="py data"> <dt class="sig sig-object py"> <span class="sig-prename descclassname">token.</span><span class="sig-name descname">COMMENT</span>
-</dt> <dd>
-<p>Token value used to indicate a comment.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py"> <span class="sig-prename descclassname">token.</span><span class="sig-name descname">NL</span>
-</dt> <dd>
-<p>Token value used to indicate a non-terminating newline. The <a class="reference internal" href="#token.NEWLINE" title="token.NEWLINE"><code>NEWLINE</code></a> token indicates the end of a logical line of Python code; <code>NL</code> tokens are generated when a logical line of code is continued over multiple physical lines.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py" id="token.ENCODING">
-<code>token.ENCODING</code> </dt> <dd>
-<p>Token value that indicates the encoding used to decode the source bytes into text. The first token returned by <a class="reference internal" href="tokenize#tokenize.tokenize" title="tokenize.tokenize"><code>tokenize.tokenize()</code></a> will always be an <code>ENCODING</code> token.</p> </dd>
-</dl> <dl class="py data"> <dt class="sig sig-object py"> <span class="sig-prename descclassname">token.</span><span class="sig-name descname">TYPE_COMMENT</span>
-</dt> <dd>
-<p>Token value indicating that a type comment was recognized. Such tokens are only produced when <a class="reference internal" href="ast#ast.parse" title="ast.parse"><code>ast.parse()</code></a> is invoked with <code>type_comments=True</code>.</p> </dd>
-</dl> <div class="versionchanged"> <p><span class="versionmodified changed">Changed in version 3.5: </span>Added <a class="reference internal" href="#token.AWAIT" title="token.AWAIT"><code>AWAIT</code></a> and <a class="reference internal" href="#token.ASYNC" title="token.ASYNC"><code>ASYNC</code></a> tokens.</p> </div> <div class="versionchanged"> <p><span class="versionmodified changed">Changed in version 3.7: </span>Added <a class="reference internal" href="#token.COMMENT" title="token.COMMENT"><code>COMMENT</code></a>, <a class="reference internal" href="#token.NL" title="token.NL"><code>NL</code></a> and <a class="reference internal" href="#token.ENCODING" title="token.ENCODING"><code>ENCODING</code></a> tokens.</p> </div> <div class="versionchanged"> <p><span class="versionmodified changed">Changed in version 3.7: </span>Removed <a class="reference internal" href="#token.AWAIT" title="token.AWAIT"><code>AWAIT</code></a> and <a class="reference internal" href="#token.ASYNC" title="token.ASYNC"><code>ASYNC</code></a> tokens. “async” and “await” are now tokenized as <a class="reference internal" href="#token.NAME" title="token.NAME"><code>NAME</code></a> tokens.</p> </div> <div class="versionchanged"> <p><span class="versionmodified changed">Changed in version 3.8: </span>Added <a class="reference internal" href="#token.TYPE_COMMENT" title="token.TYPE_COMMENT"><code>TYPE_COMMENT</code></a>, <a class="reference internal" href="#token.TYPE_IGNORE" title="token.TYPE_IGNORE"><code>TYPE_IGNORE</code></a>, <a class="reference internal" href="#token.COLONEQUAL" title="token.COLONEQUAL"><code>COLONEQUAL</code></a>. Added <a class="reference internal" href="#token.AWAIT" title="token.AWAIT"><code>AWAIT</code></a> and <a class="reference internal" href="#token.ASYNC" title="token.ASYNC"><code>ASYNC</code></a> tokens back (they’re needed to support parsing older Python versions for <a class="reference internal" href="ast#ast.parse" title="ast.parse"><code>ast.parse()</code></a> with <code>feature_version</code> set to 6 or lower).</p> </div> <div class="_attribution">
- <p class="_attribution-p">
- &copy; 2001&ndash;2023 Python Software Foundation<br>Licensed under the PSF License.<br>
- <a href="https://docs.python.org/3.12/library/token.html" class="_attribution-link">https://docs.python.org/3.12/library/token.html</a>
- </p>
-</div>