delta/cpython-git.git/Objects/stringlib/codecs.h, branch enum-lost-fixes

bpo-43179: Generalise alignment for optimised string routines (GH-24624)

2021-03-31T10:12:39+00:00

* Remove m68k-specific hack from ascii_decode

On m68k, alignments of primitives is more relaxed, with 4-byte and
8-byte types only requiring 2-byte alignment, thus using sizeof(size_t)
does not work. Instead, use the portable alternative.

Note that this is a minimal fix that only relaxes the assertion and the
condition for when to use the optimised version remains overly strict.
Such issues will be fixed tree-wide in the next commit.

NB: In C11 we could use _Alignof(size_t) instead, but for compatibility
we use autoconf.

* Optimise string routines for architectures with non-natural alignment

C only requires that sizeof(x) is a multiple of alignof(x), not that the
two are equal. Thus anywhere where we optimise based on alignment we
should be using alignof(x) not sizeof(x).

This is more annoying than it would be in C11 where we could just use
_Alignof(x) (and alignof(x) in C++11), but since we still require only
C99 we must plumb the information all the way from autoconf through the
various typedefs and defines.

bpo-38252: Use 8-byte step to detect ASCII sequence in 64bit Windows build (GH-16334)

2020-10-18T14:48:38+00:00

bpo-29882: Add _Py_popcount32() function (GH-20518)

2020-06-08T14:30:33+00:00

* Rename pycore_byteswap.h to pycore_bitutils.h.
* Move popcount_digit() to pycore_bitutils.h as _Py_popcount32().
* _Py_popcount32() uses GCC and clang builtin function if available.
* Add unit tests to _Py_popcount32().

bpo-40302: UTF-32 encoder SWAB4() macro use a|b rather than a+b (GH-19572)

2020-04-17T17:13:34+00:00

bpo-40302: Add pycore_byteswap.h header file (GH-19552)

2020-04-17T15:47:20+00:00

Add a new internal pycore_byteswap.h header file with the following
functions:

* _Py_bswap16()
* _Py_bswap32()
* _Py_bswap64()

Use these functions in _ctypes, sha256 and sha512 modules,
and also use in the UTF-32 encoder.

sha256, sha512 and _ctypes modules are now built with the internal
C API.

bpo-39943: Add the const qualifier to pointers on non-mutable PyUnicode data. (GH-19345)

2020-04-11T07:48:40+00:00

Update some www.unicode.org URLs to use HTTPS. (GH-18912)

2020-03-11T04:10:59+00:00

bpo-39087: Optimize PyUnicode_AsUTF8AndSize() (GH-18327)

2020-02-27T04:48:59+00:00

Avoid using temporary bytes object.

closes bpo-39605: Fix some casts to not cast away const. (GH-18453)

2020-02-12T02:28:35+00:00

gcc -Wcast-qual turns up a number of instances of casting away constness of pointers. Some of these can be safely modified, by either:

Adding the const to the type cast, as in:

-    return _PyUnicode_FromUCS1((unsigned char*)s, size);
+    return _PyUnicode_FromUCS1((const unsigned char*)s, size);

or, Removing the cast entirely, because it's not necessary (but probably was at one time), as in:

-    PyDTrace_FUNCTION_ENTRY((char *)filename, (char *)funcname, lineno);
+    PyDTrace_FUNCTION_ENTRY(filename, funcname, lineno);

These changes will not change code, but they will make it much easier to check for errors in consts

bpo-24214: Fixed the UTF-8 and UTF-16 incremental decoders. (GH-14304)

2019-06-25T08:54:18+00:00

* The UTF-8 incremental decoders fails now fast if encounter
  a sequence that can't be handled by the error handler.
* The UTF-16 incremental decoders with the surrogatepass error
  handler decodes now a lone low surrogate with final=False.