diff options
| author | Leonard Richardson <leonardr@segfault.org> | 2021-02-13 11:51:13 -0500 |
|---|---|---|
| committer | Leonard Richardson <leonardr@segfault.org> | 2021-02-13 11:51:13 -0500 |
| commit | 8f763297abc8bb598c3aca25eccaef6db7f7c987 (patch) | |
| tree | b0ded4fe88e1c10883d13d0c2000bd9f9374f53e /tests/test_tree.py | |
| parent | 4d8d9af1c841d1eec0e9e838a467579831268b8b (diff) | |
Added a second way to pass specify encodings to UnicodeDammit and
EncodingDetector, based on the order of precedence defined in the
HTML5 spec, starting at:
https://html.spec.whatwg.org/multipage/parsing.html#parsing-with-a-known-character-encoding
Encodings in 'known_definite_encodings' are tried first, then
byte-order-mark sniffing is run, then encodings in 'user_encodings'
are tried. The old argument, 'override_encodings', is now a
deprecated alias for 'known_definite_encodings'.
This changes the default behavior of the html.parser and lxml tree
builders, in a way that may slightly improve encoding
detection but will probably have no effect. [bug=1889014]
Diffstat (limited to 'tests/test_tree.py')
0 files changed, 0 insertions, 0 deletions