<feed xmlns='http://www.w3.org/2005/Atom'>
<title>delta/cpython-git.git/Parser/tokenizer.h, branch fix-misc-acks</title>
<subtitle>github.com: python/cpython.git
</subtitle>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/'/>
<entry>
<title>tokenizer: Remove unused tabs options (#4422)</title>
<updated>2017-11-17T09:25:47+00:00</updated>
<author>
<name>Victor Stinner</name>
<email>victor.stinner@gmail.com</email>
</author>
<published>2017-11-17T09:25:47+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/commit/?id=f2ddc6ac9370a1805ab1b751437df8f96f38bfcf'/>
<id>f2ddc6ac9370a1805ab1b751437df8f96f38bfcf</id>
<content type='text'>
Remove the following fields from tok_state structure which are now
used unused:

* altwarning: "Issue warning if alternate tabs don't match"
* alterror: "Issue error if alternate tabs don't match"
* alttabsize: "Alternate tab spacing"

Replace alttabsize variable with ALTTABSIZE define.</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Remove the following fields from tok_state structure which are now
used unused:

* altwarning: "Issue warning if alternate tabs don't match"
* alterror: "Issue error if alternate tabs don't match"
* alttabsize: "Alternate tab spacing"

Replace alttabsize variable with ALTTABSIZE define.</pre>
</div>
</content>
</entry>
<entry>
<title>bpo-30406: Make async and await proper keywords (#1669)</title>
<updated>2017-10-06T03:24:46+00:00</updated>
<author>
<name>Jelle Zijlstra</name>
<email>jelle.zijlstra@gmail.com</email>
</author>
<published>2017-10-06T03:24:46+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/commit/?id=ac317700ce7439e38a8b420218d9a5035bba92ed'/>
<id>ac317700ce7439e38a8b420218d9a5035bba92ed</id>
<content type='text'>
Per PEP 492, 'async' and 'await' should become proper keywords in 3.7.</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Per PEP 492, 'async' and 'await' should become proper keywords in 3.7.</pre>
</div>
</content>
</entry>
<entry>
<title>Remove obsolete declaration in tokenizer.h (#962)</title>
<updated>2017-04-03T16:18:32+00:00</updated>
<author>
<name>Jim Fasarakis-Hilliard</name>
<email>d.f.hilliard@gmail.com</email>
</author>
<published>2017-04-03T16:18:32+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/commit/?id=cf1958af4c762c970d1f2fa0e92577f577774c22'/>
<id>cf1958af4c762c970d1f2fa0e92577f577774c22</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Issue #24619: Simplify async/await tokenization.</title>
<updated>2015-07-23T12:01:58+00:00</updated>
<author>
<name>Yury Selivanov</name>
<email>yselivanov@sprymix.com</email>
</author>
<published>2015-07-23T12:01:58+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/commit/?id=96ec934e755355cfc5af036db8641646b7ddb45e'/>
<id>96ec934e755355cfc5af036db8641646b7ddb45e</id>
<content type='text'>
This commit simplifies async/await tokenization in tokenizer.c,
tokenize.py &amp; lib2to3/tokenize.py.  Previous solution was to keep
a stack of async-def &amp; def blocks, whereas the new approach is just
to remember position of the outermost async-def block.

This change won't bring any parsing performance improvements, but
it makes the code much easier to read and validate.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
This commit simplifies async/await tokenization in tokenizer.c,
tokenize.py &amp; lib2to3/tokenize.py.  Previous solution was to keep
a stack of async-def &amp; def blocks, whereas the new approach is just
to remember position of the outermost async-def block.

This change won't bring any parsing performance improvements, but
it makes the code much easier to read and validate.
</pre>
</div>
</content>
</entry>
<entry>
<title>Issue #24619: New approach for tokenizing async/await.</title>
<updated>2015-07-22T10:33:45+00:00</updated>
<author>
<name>Yury Selivanov</name>
<email>yselivanov@sprymix.com</email>
</author>
<published>2015-07-22T10:33:45+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/commit/?id=8fb307cd650511ba019c4493275cb6684ad308bc'/>
<id>8fb307cd650511ba019c4493275cb6684ad308bc</id>
<content type='text'>
This commit fixes how one-line async-defs and defs are tracked
by tokenizer.  It allows to correctly parse invalid code such
as:

&gt;&gt;&gt; async def f():
...     def g(): pass
...     async = 10

and valid code such as:

&gt;&gt;&gt; async def f():
...     async def g(): pass
...     await z

As a consequence, is is now possible to have one-line
'async def foo(): await ..' functions:

&gt;&gt;&gt; async def foo(): return await bar()
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
This commit fixes how one-line async-defs and defs are tracked
by tokenizer.  It allows to correctly parse invalid code such
as:

&gt;&gt;&gt; async def f():
...     def g(): pass
...     async = 10

and valid code such as:

&gt;&gt;&gt; async def f():
...     async def g(): pass
...     await z

As a consequence, is is now possible to have one-line
'async def foo(): await ..' functions:

&gt;&gt;&gt; async def foo(): return await bar()
</pre>
</div>
</content>
</entry>
<entry>
<title>PEP 0492 -- Coroutines with async and await syntax. Issue #24017.</title>
<updated>2015-05-12T02:57:16+00:00</updated>
<author>
<name>Yury Selivanov</name>
<email>yselivanov@sprymix.com</email>
</author>
<published>2015-05-12T02:57:16+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/commit/?id=7544508f0245173bff5866aa1598c8f6cce1fc5f'/>
<id>7544508f0245173bff5866aa1598c8f6cce1fc5f</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Issue #1772673: The type of `char*` arguments now changed to `const char*`.</title>
<updated>2013-10-19T18:03:34+00:00</updated>
<author>
<name>Serhiy Storchaka</name>
<email>storchaka@gmail.com</email>
</author>
<published>2013-10-19T18:03:34+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/commit/?id=c679227e31245b0e8dec74a1f7cc77710541d985'/>
<id>c679227e31245b0e8dec74a1f7cc77710541d985</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.</title>
<updated>2011-04-04T23:48:03+00:00</updated>
<author>
<name>Victor Stinner</name>
<email>victor.stinner@haypocalc.com</email>
</author>
<published>2011-04-04T23:48:03+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/commit/?id=fe7c5b5bdf7c21551b56be563fc604f2d4d3c756'/>
<id>fe7c5b5bdf7c21551b56be563fc604f2d4d3c756</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Issue #10785: Store the filename as Unicode in the Python parser.</title>
<updated>2011-04-04T22:39:01+00:00</updated>
<author>
<name>Victor Stinner</name>
<email>victor.stinner@haypocalc.com</email>
</author>
<published>2011-04-04T22:39:01+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/commit/?id=7f2fee36401f7b987a368fe043637b3ae7116600'/>
<id>7f2fee36401f7b987a368fe043637b3ae7116600</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>#10222: fix for overzealous AIX compiler.</title>
<updated>2010-10-29T04:54:13+00:00</updated>
<author>
<name>Georg Brandl</name>
<email>georg@python.org</email>
</author>
<published>2010-10-29T04:54:13+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/cpython-git.git/commit/?id=2b15bd810deb7172ffa62643a78a6611d4ba928b'/>
<id>2b15bd810deb7172ffa62643a78a6611d4ba928b</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
</feed>
