summaryrefslogtreecommitdiff
path: root/Parser/tokenizer.h
Commit message (Expand)AuthorAgeFilesLines
* gh-92651: Remove the Include/token.h header file (#92652)Victor Stinner2022-05-111-1/+1
* Ensure the str member of the tokenizer is always initialised (GH-29681)Pablo Galindo Salgado2021-11-211-1/+1
* bpo-45434: Mark the PyTokenizer C API as private (GH-28924)Victor Stinner2021-10-131-5/+5
* Fix typos in the Objects directory (GH-28766)Christian Clauss2021-10-061-1/+1
* bpo-44854: Remove trailing whitespaces (GH-27689)Serhiy Storchaka2021-08-091-1/+1
* bpo-44201: Avoid side effects of "invalid_*" rules in the REPL (GH-26298)Pablo Galindo2021-05-221-0/+10
* bpo-25643: Refactor the C tokenizer into smaller, logical units (GH-25050)Pablo Galindo2021-03-281-3/+2
* bpo-43410: Fix crash in the parser when producing syntax errors when reading ...Pablo Galindo2021-03-141-1/+3
* bpo-42864: Improve error messages regarding unclosed parentheses (GH-24161)Pablo Galindo2021-01-191-0/+1
* bpo-42827: Fix crash on SyntaxError in multiline expressions (GH-24140)Lysandros Nikolaou2021-01-141-0/+1
* closes bpo-39721: Fix constness of members of tok_state struct. (GH-18600)Andy Lester2020-02-271-5/+5
* bpo-36623: Clean parser headers and include files (GH-12253)Pablo Galindo2019-04-131-0/+2
* bpo-35975: Support parsing earlier minor versions of Python 3 (GH-12086)Guido van Rossum2019-03-071-0/+7
* bpo-35808: Retire pgen and use pgen2 to generate the parser (GH-11814)Pablo Galindo2019-03-011-8/+0
* bpo-35766: Merge typed_ast back into CPython (GH-11645)Guido van Rossum2019-01-311-0/+2
* bpo-16806: Fix `lineno` and `col_offset` for multi-line string tokens (GH-10021)Anthony Sottile2019-01-131-0/+5
* bpo-33306: Improve SyntaxError messages for unbalanced parentheses. (GH-6516)Serhiy Storchaka2018-12-171-1/+4
* tokenizer: Remove unused tabs options (#4422)Victor Stinner2017-11-171-3/+0
* bpo-30406: Make async and await proper keywords (#1669)Jelle Zijlstra2017-10-051-7/+0
* Remove obsolete declaration in tokenizer.h (#962)Jim Fasarakis-Hilliard2017-04-031-2/+0
* Issue #24619: Simplify async/await tokenization.Yury Selivanov2015-07-231-15/+6
* Issue #24619: New approach for tokenizing async/await.Yury Selivanov2015-07-221-6/+15
* PEP 0492 -- Coroutines with async and await syntax. Issue #24017.Yury Selivanov2015-05-111-0/+7
* Issue #1772673: The type of `char*` arguments now changed to `const char*`.Serhiy Storchaka2013-10-191-3/+3
* Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.Victor Stinner2011-04-051-1/+0
* Issue #10785: Store the filename as Unicode in the Python parser.Victor Stinner2011-04-051-1/+7
* #10222: fix for overzealous AIX compiler.Georg Brandl2010-10-291-1/+1
* Issue #9713, #10114: Parser functions (eg. PyParser_ASTFromFile) expectsVictor Stinner2010-10-161-1/+1
* Issue #10095: fp_setreadl() doesn't reopen the file, reuse instead the fileVictor Stinner2010-10-141-1/+1
* Recorded merge of revisions 81029 via svnmerge fromAntoine Pitrou2010-05-091-45/+45
* Merged revisions 76230 via svnmerge fromBenjamin Peterson2009-11-131-2/+3
* ignore the coding cookie in compile(), exec(), and eval() if the source is a ...Benjamin Peterson2009-03-021-0/+1
* Latin-1 source code was not being properly decoded when passed throughBrett Cannon2008-10-171-2/+2
* Issue 1267, continued.Guido van Rossum2007-10-221-1/+1
* Patch 1267 by Christian Heimes.Guido van Rossum2007-10-191-0/+1
* Use an enum for decoding_state. It makes the code a little moreNeil Schemenauer2007-09-211-1/+7
* Merged revisions 57778-58052 via svnmerge fromThomas Wouters2007-09-081-0/+2
* Convert code from sys.stdin.encoding to UTF-8 inMartin v. Löwis2007-09-041-1/+2
* Patch #1440601: Add col_offset attribute to AST nodes.Martin v. Löwis2006-03-011-0/+1
* Remove unused field.Martin v. Löwis2006-03-011-1/+0
* Constify filenames and scripts. Fixes #651362.Martin v. Löwis2002-12-111-2/+2
* Ignore encoding declarations inside strings. Fixes #603509.Martin v. Löwis2002-09-031-0/+1
* Make pgen compile with pydebug. Duplicate normalized names, as it mayMartin v. Löwis2002-08-041-0/+2
* Patch #534304: Implement phase 1 of PEP 263.Martin v. Löwis2002-08-041-0/+11
* REMOVED all CWI, CNRI and BeOpen copyright markings.Guido van Rossum2000-09-011-9/+0
* Nuke all remaining occurrences of Py_PROTO and Py_FPROTO.Tim Peters2000-07-091-5/+4
* Change copyright notice - 2nd try.Guido van Rossum2000-06-301-6/+0
* Change copyright notice.Guido van Rossum2000-06-301-21/+6
* Add checking for inconsistent tab usageGuido van Rossum1998-04-091-0/+6
* Another directory quickly renamed.Guido van Rossum1997-04-291-4/+5