Thanks to visit codestin.com Credit goes to github.com
We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 5f8fbf9 commit ea0f7c2Copy full SHA for ea0f7c2
1 file changed
Doc/library/tokenize.rst
@@ -16,8 +16,9 @@ implemented in Python. The scanner in this module returns comments as tokens
16
as well, making it useful for implementing "pretty-printers," including
17
colorizers for on-screen displays.
18
19
-To simplify token stream handling, all :ref:`operator <operators>` and :ref:`delimiter <delimiters>`
20
-tokens and :data:`Ellipsis` are returned using the generic :data:`~token.OP` token type. The exact
+To simplify token stream handling, all :ref:`operator <operators>` and
+:ref:`delimiter <delimiters>` tokens and :data:`Ellipsis` are returned using
21
+the generic :data:`~token.OP` token type. The exact
22
type can be determined by checking the ``exact_type`` property on the
23
:term:`named tuple` returned from :func:`tokenize.tokenize`.
24
0 commit comments