Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bpo-39219: Fix SyntaxError attributes in the tokenizer. #17828

Merged

Conversation

@serhiy-storchaka
Copy link
Member

serhiy-storchaka commented Jan 5, 2020

  • Always set the text attribute.
  • Correct the offset attribute for non-ascii sources.

https://bugs.python.org/issue39219

@serhiy-storchaka serhiy-storchaka changed the title bpo-359331: Fix SyntaxError attributes in the tokenizer. bpo-39219: Fix SyntaxError attributes in the tokenizer. Jan 11, 2020
@serhiy-storchaka serhiy-storchaka force-pushed the serhiy-storchaka:tokenizer-syntax-error-text branch from aa5be8f to 309b924 Jan 11, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
@serhiy-storchaka serhiy-storchaka force-pushed the serhiy-storchaka:tokenizer-syntax-error-text branch from 309b924 to 51d0cdc Jan 11, 2020
@serhiy-storchaka serhiy-storchaka merged commit 0cc6b5e into python:master Feb 12, 2020
9 checks passed
9 checks passed
Docs
Details
Windows (x86)
Details
Windows (x64)
Details
macOS
Details
Ubuntu
Details
Azure Pipelines PR #20200111.17 succeeded
Details
bedevere/issue-number Issue number 39219 found
Details
bedevere/news News entry found in Misc/NEWS.d
continuous-integration/travis-ci/pr The Travis CI build passed
Details
@miss-islington

This comment has been minimized.

Copy link

miss-islington commented Feb 12, 2020

Thanks @serhiy-storchaka for the PR 🌮🎉.. I'm working now to backport this PR to: 3.8.
🐍🍒🤖

@serhiy-storchaka serhiy-storchaka deleted the serhiy-storchaka:tokenizer-syntax-error-text branch Feb 12, 2020
miss-islington added a commit to miss-islington/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
(cherry picked from commit 0cc6b5e)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@bedevere-bot

This comment has been minimized.

Copy link

bedevere-bot commented Feb 12, 2020

GH-18479 is a backport of this pull request to the 3.8 branch.

miss-islington added a commit that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
(cherry picked from commit 0cc6b5e)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
opavlyuk pushed a commit to opavlyuk/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
petdance added a commit to petdance/cpython that referenced this pull request Feb 12, 2020
* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

4 participants
You can’t perform that action at this time.