delta/cpython-git.git/Modules/cjkcodecs/_codecs_cn.c, branch master

bpo-33578: Add getstate/setstate for CJK codec (GH-6984)

2018-11-01T10:48:49+00:00

This implements getstate and setstate for the cjkcodecs multibyte incremental encoders/decoders, primarily to fix issues with seek/tell.

The encoder getstate/setstate is slightly tricky as the "state" is pending bytes + MultibyteCodec_State but only an integer can be returned. The approach I've taken is to encode this data into a long, similar to how .tell() encodes a "cookie_type" as a long.


https://bugs.python.org/issue33578

bpo-30003: Fix handling escape characters in HZ codec (#1556)

2017-05-22T14:42:05+00:00

bpo-29990: Fix range checking in GB18030 decoder (#1495)

2017-05-09T03:38:32+00:00

When decoding a 4-byte GB18030 sequence, the first and third byte cannot exceed 0xFE.

Issue #23181: More "codepoint" -> "code point".

2015-01-18T09:28:37+00:00

CJK codecs: less magical macros, semicolon is now explicit

2013-10-28T23:59:44+00:00

CJK codecs: less magic macros, require explicit semicolon

2013-10-28T23:19:27+00:00

CJK codecs: add newlines for readability

2013-10-28T23:09:41+00:00

CJK codecs: use less magic and more readable macros, write explicit if

2013-10-28T22:54:13+00:00

Issue #18509: handle PyUnicode_Writer() error

2013-10-28T22:18:39+00:00

Issue #17693: CJK encoders now use the new Unicode API (PEP 393)

2013-04-14T00:06:32+00:00