Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.
Sign upbpo-39206: Add encoding detecting to modulefinder #17817
Conversation
This comment has been minimized.
This comment has been minimized.
the-knights-who-say-ni
commented
Jan 4, 2020
Hello, and thanks for your contribution! I'm a bot set up to make sure that the project can legally accept this contribution by verifying everyone involved has signed the PSF contributor agreement (CLA). CLA MissingOur records indicate the following people have not signed the CLA: For legal reasons we need all the people listed to sign the CLA before we can look at your contribution. Please follow the steps outlined in the CPython devguide to rectify this issue. If you have recently signed the CLA, please wait at least one business day You can check yourself to see if the CLA has been received. Thanks again for the contribution, we look forward to reviewing it! |
This comment has been minimized.
This comment has been minimized.
Just recording, I just signed the CLA. |
a47ad67
to
8251bd0
8251bd0
to
0c465a0
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
Could you also add some more tests for this issue? |
This comment has been minimized.
This comment has been minimized.
Thanks, will do it!
Of course! I will add some tests to |
This comment has been minimized.
This comment has been minimized.
It might be at least worth setting up tests to open files with odd encodings. Test it on a file with some Unicode characters in it, and on files with PEP263 style encoding declarations. On a different note, I would point out that when running files, they are opened in bytes mode and that's it. Encoding is inferred during the compilation process, simply by running the compile() function on the bytestring read from the file, with no need to import tokenize or open in 'r' mode or anything else. |
This comment has been minimized.
This comment has been minimized.
@plokmijnuhby I've added one example, could you please give me feedback on it? If it's ok, I will add one ow two more with different encoding types or testing default is type to |
LucianaMarques commentedJan 4, 2020
•
edited by bedevere-bot
Fixing issue 39206.
https://bugs.python.org/issue39206