delta/cpython-git.git/Parser, branch datetime_backport_test

bpo-41746: Cast to typed seqs in CHECK macros to avoid type erasure (GH-22864)

2020-10-21T19:53:14+00:00

bpo-42000: Cleanup the AST related C-code (GH-22641)

2020-10-10T17:14:59+00:00

- Use the proper asdl sequence when creating empty arguments
- Remove reduntant casts (thanks to new typed asdl_sequences)
- Remove MarshalPrototypeVisitor and some utilities from asdl generator
- Fix the header of `Python/ast.c` (kept from pgen times)

Automerge-Triggered-By: @pablogsal

bpo-41979: Accept star-unpacking on with-item targets (GH-22611)

2020-10-09T09:56:48+00:00

Co-authored-by: Pablo Galindo

bpo-41746: Add type information to asdl_seq objects (GH-22223)

2020-09-16T18:42:00+00:00

* Add new capability to the PEG parser to type variable assignments. For instance:
```
       | a[asdl_stmt_seq*]=';'.small_stmt+ [';'] NEWLINE { a }
```

* Add new sequence types from the asdl definition (automatically generated)
* Make `asdl_seq` type a generic aliasing pointer type.
* Create a new `asdl_generic_seq` for the generic case using `void*`.
* The old `asdl_seq_GET`/`ast_seq_SET` macros now are typed.
* New `asdl_seq_GET_UNTYPED`/`ast_seq_SET_UNTYPED` macros for dealing with generic sequences.
* Changes all possible `asdl_seq` types to use specific versions everywhere.

bpo-41631: _ast module uses again a global state (#21961)

2020-09-15T16:03:34+00:00

Partially revert commit ac46eb4ad6662cf6d771b20d8963658b2186c48c:
"bpo-38113: Update the Python-ast.c generator to PEP384 (gh-15957)".

Using a module state per module instance is causing subtle practical
problems.

For example, the Mercurial project replaces the __import__() function
to implement lazy import, whereas Python expected that "import _ast"
always return a fully initialized _ast module.

Add _PyAST_Fini() to clear the state at exit.

The _ast module has no state (set _astmodule.m_size to 0). Remove
astmodule_traverse(), astmodule_clear() and astmodule_free()
functions.

bpo-41697: Correctly handle KeywordOrStarred when parsing arguments in the parser (GH-22077)

2020-09-03T14:29:32+00:00

bpo-41690: Use a loop to collect args in the parser instead of recursion (GH-22053)

2020-09-02T16:44:19+00:00

This program can segfault the parser by stack overflow:

```
import ast

code = "f(" + ",".join(['a' for _ in range(100000)]) + ")"
print("Ready!")
ast.parse(code)
```

the reason is that the rule for arguments has a simple recursion when collecting args:

args[expr_ty]:
    [...]
    | a=named_expression b=[',' c=args { c }] {
        [...] }

bpo-38156: Fix compiler warning in PyOS_StdioReadline() (GH-21721)

2020-08-04T00:38:16+00:00

incr cannot be larger than INT_MAX: downcast to int explicitly.

closes bpo-38156: Always handle interrupts in PyOS_StdioReadline. (GH-21569)

2020-07-29T00:57:12+00:00

This consolidates the handling of my_fgets return values, so that interrupts are always handled, even if they come after EOF.

 I believe PyOS_StdioReadline is still buggy in that I/O errors will not result in a proper Python exception being set. However, that is a separate issue.

Validate the AST produced by the parser in debug mode (GH-21643)

2020-07-27T22:46:59+00:00

This will improve the debug experience if something fails in the produced AST. Previously, errors in the produced AST can be felt much later like in the garbage collector or the compiler, making debugging them much more difficult.