delta/python-packages/docutils.git/docutils/io.py, branch docutils-0.19

Document planned changes to input encoding handling.

2022-07-04T21:06:49+00:00

git-svn-id: https://svn.code.sf.net/p/docutils/code/trunk/docutils@9100 929543f6-e4f2-0310-98a6-ba3bd3dd1d04

Fix handling of UTF-16 encoded source without trailing newline.

2022-07-04T21:06:38+00:00

Decoding a UTF-16 encoded source with BOM after auto-detection of the
encoding failed.
The newline normalization in `docutils.FileInput.read()`
produced invalid UTF-16 because it added one byte
(binary ASCII newline).

Postponing the newline normalization after the decoding step solves
this problem.

git-svn-id: https://svn.code.sf.net/p/docutils/code/trunk/docutils@9099 929543f6-e4f2-0310-98a6-ba3bd3dd1d04

Don't use on Pythons default encoding if "input_encoding" setting is None.

2022-07-04T21:06:30+00:00

If the "input_encoding" setting is None, the encoding of an
input source should be auto-detected with a heuristic.

Under Python 3, auto-detection was only used if reading a file
with Python's default encoding failed.

Resulting problems:

* EncodingWarning (PEP 597) in Python >= 3.10.

* Optional BOM not dropped from utf-8 encoded files.

* If the usrers locale sets an 8-bit encoding,
  files in other 8-bit encodings, UTF-8, and UTF-16 show
  character mix-up (mojibake) (self-declared encoding ignored as
  reading in 8-bit encoding does not lead to errors).

git-svn-id: https://svn.code.sf.net/p/docutils/code/trunk/docutils@9098 929543f6-e4f2-0310-98a6-ba3bd3dd1d04

Minor code cleanup in `docutils.io`.

2022-06-22T09:54:13+00:00

Fix/expand a docstring.
Disambiguate local variable name "encodings".
Use f-string instead of %-replacements.

git-svn-id: https://svn.code.sf.net/p/docutils/code/trunk/docutils@9093 929543f6-e4f2-0310-98a6-ba3bd3dd1d04

Rename `io.locale_encoding` to mark it as internal.

2022-06-17T11:31:40+00:00

The attribute was moved to "io" after the last release.
Backwards compatibility is ensured via `locale_encoding`
in the (deprecated) "utils.error_reporting" module.

Fix HISTORY entries.

git-svn-id: https://svn.code.sf.net/p/docutils/code/trunk/docutils@9078 929543f6-e4f2-0310-98a6-ba3bd3dd1d04

Fix [r9074]: ensure backwards-compatible value for `io.locale_encoding`.

2022-06-17T11:31:09+00:00

`locale.getpreferredencoding()` returns 'utf-8' if Python is
started with the ``-X UTF-8`` option.

git-svn-id: https://svn.code.sf.net/p/docutils/code/trunk/docutils@9075 929543f6-e4f2-0310-98a6-ba3bd3dd1d04

Ensure locale_encoding is lower case.

2022-06-15T15:28:35+00:00

Use `locale.getpreferredencoding(False)` since we dropped support
for older Python versions with side-effects.

git-svn-id: https://svn.code.sf.net/p/docutils/code/trunk/docutils@9074 929543f6-e4f2-0310-98a6-ba3bd3dd1d04

Postpone deprecations to Docutils 2.0

2022-05-30T21:09:09+00:00

Starting in 1.0, we want to move to "semantic versioning":
no incompatible API changes in "minor" releases.

git-svn-id: https://svn.code.sf.net/p/docutils/code/trunk/docutils@9062 929543f6-e4f2-0310-98a6-ba3bd3dd1d04

core.Publisher.publish(): Prompt when waiting for input from a terminal.

2022-03-11T12:09:16+00:00

When front-end tools are used without arguments,
Docutils reads from stdin.

Currently, when a user calls a front-end without arguments,
there is no response until the user presses Ctrl-D (Ctrl-Z on Windows)
or aborts with Ctrl-C.

This commit changes the behaviour to tell the user what the front-end
expects and where to get more help.

git-svn-id: https://svn.code.sf.net/p/docutils/code/trunk/docutils@9043 929543f6-e4f2-0310-98a6-ba3bd3dd1d04

Remove unused local variables

2022-03-05T23:31:46+00:00

flake rule F841: local variable 'foo' is assigned to but never used

In test_odt.py, a no-op class definition is removed completely.

git-svn-id: https://svn.code.sf.net/p/docutils/code/trunk/docutils@9038 929543f6-e4f2-0310-98a6-ba3bd3dd1d04