diff options
author | Tal Einat <taleinat+github@gmail.com> | 2018-10-24 10:33:00 +0300 |
---|---|---|
committer | Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com> | 2018-10-24 00:33:00 -0700 |
commit | b4c9874f5c7f64e1d41cbc588e515b8851bbb90c (patch) | |
tree | 56a831239c8d2d9e986848679d15139491164b3a /Doc/whatsnew | |
parent | 861f61b5a93d178e913ad3c760d529ee3155e66d (diff) | |
download | cpython-git-b4c9874f5c7f64e1d41cbc588e515b8851bbb90c.tar.gz |
[3.7] bpo-33899: Mention tokenize behavior change in What's New (GH-10073) (GH-10074)
(cherry picked from commit dfba1f67e7f1381ceb7cec8fbcfa37337620a9b0)
https://bugs.python.org/issue33899
Diffstat (limited to 'Doc/whatsnew')
-rw-r--r-- | Doc/whatsnew/3.6.rst | 8 | ||||
-rw-r--r-- | Doc/whatsnew/3.7.rst | 5 |
2 files changed, 13 insertions, 0 deletions
diff --git a/Doc/whatsnew/3.6.rst b/Doc/whatsnew/3.6.rst index fec7c620d3..bba1654368 100644 --- a/Doc/whatsnew/3.6.rst +++ b/Doc/whatsnew/3.6.rst @@ -2414,3 +2414,11 @@ Notable changes in Python 3.6.5 The :func:`locale.localeconv` function now sets temporarily the ``LC_CTYPE`` locale to the ``LC_NUMERIC`` locale in some cases. (Contributed by Victor Stinner in :issue:`31900`.) + +Notable changes in Python 3.6.7 +=============================== + +In 3.6.7 the :mod:`tokenize` module now implicitly emits a ``NEWLINE`` token +when provided with input that does not have a trailing new line. This behavior +now matches what the C tokenizer does internally. +(Contributed by Ammar Askar in :issue:`33899`.) diff --git a/Doc/whatsnew/3.7.rst b/Doc/whatsnew/3.7.rst index 9cc7932546..9a13dae13e 100644 --- a/Doc/whatsnew/3.7.rst +++ b/Doc/whatsnew/3.7.rst @@ -2523,3 +2523,8 @@ In 3.7.1 the C API for Context Variables :mod:`xml.dom.minidom` and :mod:`xml.sax` modules no longer process external entities by default. See also :issue:`17239`. + +In 3.7.1 the :mod:`tokenize` module now implicitly emits a ``NEWLINE`` token +when provided with input that does not have a trailing new line. This behavior +now matches what the C tokenizer does internally. +(Contributed by Ammar Askar in :issue:`33899`.) |