Skip to content
main
Switch branches/tags
cpython/Parser/
Go to file
cpython/Parser/

Latest commit

@mdboom
mdboom gh-96268: Fix loading invalid UTF-8 (#96270)
8bc356a Sep 7, 2022
gh-96268: Fix loading invalid UTF-8 (#96270) 
This makes tokenizer.c:valid_utf8 match stringlib/codecs.h:decode_utf8.

It also fixes an off-by-one error introduced in 3.10 for the line number when the tokenizer reports bad UTF8.
8bc356a

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
. .
Python.asdl
bpo-46289: Make conversion of FormattedValue not optional on ASDL (GH…
Jan 7, 2022
action_helpers.c
bpo-47212: Improve error messages for un-parenthesized generator expr…
Apr 5, 2022
asdl.py
bpo-43651: PEP 597: Fix EncodingWarning in some tests (GH-25142)
Apr 2, 2021
asdl_c.py
gh-95185: Check recursion depth in the AST constructor (#95186)
Jul 24, 2022
myreadline.c
gh-93937: PyOS_StdioReadline() uses PyConfig.legacy_windows_stdio (#9…
Jun 20, 2022
parser.c
gh-96587: Raise SyntaxError for PEP654 on older feature_version (#…
Sep 5, 2022
peg_api.c
bpo-43244: Remove parser_interface.h header file (GH-25001)
Mar 24, 2021
pegen.c
gh-95778: CVE-2020-10735: Prevent DoS by very large int() (#96499)
Sep 2, 2022
pegen.h
gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#…
May 24, 2022
pegen_errors.c
gh-95876: Fix format string in pegen error location code (#95877)
Aug 11, 2022
string_parser.c
gh-94869: Fix the location in some expressions for multi-line f-strin…
Jul 16, 2022
string_parser.h
bpo-43244: Remove ast.h, asdl.h, Python-ast.h headers (GH-24933)
Mar 23, 2021
token.c
gh-92651: Remove the Include/token.h header file (#92652)
May 11, 2022
tokenizer.c
gh-96268: Fix loading invalid UTF-8 (#96270)
Sep 7, 2022
tokenizer.h
gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#…
May 24, 2022