| Commit message (Expand) | Author | Age | Files | Lines |
* | [3.6] bpo-33899: Make tokenize module mirror end-of-file is end-of-line behav... | Ammar Askar | 2018-07-06 | 1 | -1/+11 |
* | Issue #26331: Implement the parsing part of PEP 515. | Brett Cannon | 2016-09-09 | 1 | -8/+9 |
* | Issue #26581: Use the first coding cookie on a line, not the last one. | Serhiy Storchaka | 2016-03-20 | 1 | -1/+1 |
|\ |
|
| * | Issue #26581: Use the first coding cookie on a line, not the last one. | Serhiy Storchaka | 2016-03-20 | 1 | -1/+1 |
* | | Issue #25977: Fix typos in Lib/tokenize.py | Berker Peksag | 2015-12-30 | 1 | -5/+5 |
|\ \
| |/ |
|
| * | Issue #25977: Fix typos in Lib/tokenize.py | Berker Peksag | 2015-12-30 | 1 | -4/+4 |
* | | Issue 25311: Add support for f-strings to tokenize.py. Also added some commen... | Eric V. Smith | 2015-10-26 | 1 | -51/+67 |
|/ |
|
* | Issue #24619: Simplify async/await tokenization. | Yury Selivanov | 2015-07-23 | 1 | -16/+23 |
* | Issue #24619: New approach for tokenizing async/await. | Yury Selivanov | 2015-07-22 | 1 | -1/+6 |
* | Issue #20387: Merge test and patch from 3.4.4 | Jason R. Coombs | 2015-06-28 | 1 | -0/+17 |
|\ |
|
| * | Issue #20387: Restore retention of indentation during untokenize. | Dingyuan Wang | 2015-06-22 | 1 | -0/+17 |
* | | (Merge 3.5) Issue #23840: tokenize.open() now closes the temporary binary file | Victor Stinner | 2015-05-26 | 1 | -5/+9 |
|\ \
| |/ |
|
| * | Issue #23840: tokenize.open() now closes the temporary binary file on error to | Victor Stinner | 2015-05-26 | 1 | -5/+9 |
* | | PEP 0492 -- Coroutines with async and await syntax. Issue #24017. | Yury Selivanov | 2015-05-11 | 1 | -2/+54 |
* | | Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded with | Serhiy Storchaka | 2015-03-11 | 1 | -2/+1 |
|\ \
| |/ |
|
| * | Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded with | Serhiy Storchaka | 2015-03-11 | 1 | -2/+1 |
* | | Removed duplicated dict entries. | Serhiy Storchaka | 2015-01-11 | 1 | -1/+0 |
* | | (Merge 3.4) Issue #22599: Enhance tokenize.open() to be able to call it during | Victor Stinner | 2014-12-05 | 1 | -3/+4 |
|\ \
| |/ |
|
| * | Issue #22599: Enhance tokenize.open() to be able to call it during Python | Victor Stinner | 2014-12-05 | 1 | -3/+4 |
* | | PEP 465: a dedicated infix operator for matrix multiplication (closes #21176) | Benjamin Peterson | 2014-04-09 | 1 | -2/+3 |
|/ |
|
* | Merge with 3.3 | Terry Jan Reedy | 2014-02-23 | 1 | -1/+1 |
|\ |
|
| * | whitespace | Terry Jan Reedy | 2014-02-23 | 1 | -1/+1 |
* | | Merge with 3.3 | Terry Jan Reedy | 2014-02-23 | 1 | -0/+6 |
|\ \
| |/ |
|
| * | Issue #9974: When untokenizing, use row info to insert backslash+newline. | Terry Jan Reedy | 2014-02-23 | 1 | -0/+6 |
* | | Merge with 3.3 | Terry Jan Reedy | 2014-02-17 | 1 | -13/+11 |
|\ \
| |/ |
|
| * | Issue #8478: Untokenizer.compat now processes first token from iterator input. | Terry Jan Reedy | 2014-02-17 | 1 | -13/+11 |
* | | Untokenize, bad assert: Merge with 3.3 | Terry Jan Reedy | 2014-02-17 | 1 | -1/+3 |
|\ \
| |/ |
|
| * | Untokenize: An logically incorrect assert tested user input validity. | Terry Jan Reedy | 2014-02-17 | 1 | -1/+3 |
* | | Issue #18960: Fix bugs with Python source code encoding in the second line. | Serhiy Storchaka | 2014-01-09 | 1 | -0/+3 |
|\ \
| |/ |
|
| * | Issue #18960: Fix bugs with Python source code encoding in the second line. | Serhiy Storchaka | 2014-01-09 | 1 | -0/+3 |
* | | #19620: merge with 3.3. | Ezio Melotti | 2013-11-25 | 1 | -1/+1 |
|\ \
| |/ |
|
| * | #19620: Fix typo in docstring (noticed by Christopher Welborn). | Ezio Melotti | 2013-11-25 | 1 | -1/+1 |
* | | Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py script | Serhiy Storchaka | 2013-09-16 | 1 | -4/+4 |
|\ \
| |/ |
|
| * | Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py script | Serhiy Storchaka | 2013-09-16 | 1 | -4/+4 |
* | | Replace IOError with OSError (#16715) | Andrew Svetlov | 2012-12-25 | 1 | -1/+1 |
|/ |
|
* | #16152: merge with 3.2. | Ezio Melotti | 2012-11-03 | 1 | -1/+3 |
|\ |
|
| * | #16152: fix tokenize to ignore whitespace at the end of the code when no newl... | Ezio Melotti | 2012-11-03 | 1 | -1/+3 |
* | | Merge branch | Florent Xicluna | 2012-07-07 | 1 | -1/+1 |
|\ \
| |/ |
|
| * | Issue #14990: tokenize: correctly fail with SyntaxError on invalid encoding d... | Florent Xicluna | 2012-07-07 | 1 | -1/+1 |
* | | Issue #15096: Drop support for the ur string prefix | Christian Heimes | 2012-06-20 | 1 | -9/+3 |
* | | Issue #15054: Fix incorrect tokenization of 'b' string literals. | Meador Inge | 2012-06-16 | 1 | -1/+1 |
* | | Issue #14629: Mention the filename in SyntaxError exceptions from | Brett Cannon | 2012-04-20 | 1 | -3/+19 |
* | | merge 3.2: issue 14629 | Martin v. Löwis | 2012-04-20 | 1 | -2/+5 |
|\ \
| |/ |
|
| * | Issue #14629: Raise SyntaxError in tokenizer.detect_encoding | Martin v. Löwis | 2012-04-20 | 1 | -2/+5 |
| * | Merged revisions 88498 via svnmerge from | Brett Cannon | 2011-02-22 | 1 | -3/+2 |
* | | Updated tokenize to support the inverse byte literals new in 3.3 | Armin Ronacher | 2012-03-04 | 1 | -6/+16 |
* | | Basic support for PEP 414 without docs or tests. | Armin Ronacher | 2012-03-04 | 1 | -8/+22 |
* | | Issue #2134: Add support for tokenize.TokenInfo.exact_type. | Meador Inge | 2012-01-19 | 1 | -1/+58 |
* | | Issue #13150: The tokenize module doesn't compile large regular expressions a... | Antoine Pitrou | 2011-10-11 | 1 | -19/+16 |
* | | Issue #12943: python -m tokenize support has been added to tokenize. | Meador Inge | 2011-10-07 | 1 | -23/+56 |