diff options
| author | Anthony Sottile <asottile@umich.edu> | 2019-05-30 15:06:32 -0700 |
|---|---|---|
| committer | Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com> | 2019-05-30 15:06:32 -0700 |
| commit | 2a58b0636d1f620f8a85a2e4c030cc10551936a5 (patch) | |
| tree | 816d10b4fd68438716a0e8fbadebf2b43369bc92 /Lib/tokenize.py | |
| parent | eea47e09394dfb64d3a59a601d947d25bb1bdc96 (diff) | |
| download | cpython-git-2a58b0636d1f620f8a85a2e4c030cc10551936a5.tar.gz | |
bpo-5028: Fix up rest of documentation for tokenize documenting line (GH-13686)
https://bugs.python.org/issue5028
Diffstat (limited to 'Lib/tokenize.py')
| -rw-r--r-- | Lib/tokenize.py | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/Lib/tokenize.py b/Lib/tokenize.py index 738fb71d18..1aee21b5e1 100644 --- a/Lib/tokenize.py +++ b/Lib/tokenize.py @@ -415,7 +415,7 @@ def tokenize(readline): column where the token begins in the source; a 2-tuple (erow, ecol) of ints specifying the row and column where the token ends in the source; and the line on which the token was found. The line passed is the - physical line; continuation lines are included. + physical line. The first token sequence will always be an ENCODING token which tells you which encoding was used to decode the bytes stream. |