Skip to content

Treat UTF-8 BOM as whitespace#26

Merged
c42f merged 1 commit intomainfrom
cjf/bom-ws
May 18, 2022
Merged

Treat UTF-8 BOM as whitespace#26
c42f merged 1 commit intomainfrom
cjf/bom-ws

Conversation

@c42f
Copy link
Copy Markdown
Member

@c42f c42f commented May 18, 2022

Fixes #23

Ported from JuliaLang/Tokenize.jl#197, thanks to @pfitzseb :-)

@c42f c42f merged commit 3027f17 into main May 18, 2022
@c42f c42f deleted the cjf/bom-ws branch May 18, 2022 05:43
@c42f
Copy link
Copy Markdown
Member Author

c42f commented May 18, 2022

I'm just merging this as it passes tests and makes JuliaSyntax consistent with the decision upstream in Tokenize.

c42f added a commit to JuliaLang/julia that referenced this pull request Oct 17, 2025
Co-authored-by: Sebastian Pfitzner <pfitzseb@gmail.com>
topolarity pushed a commit to JuliaLang/julia that referenced this pull request Nov 14, 2025
Co-authored-by: Sebastian Pfitzner <pfitzseb@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

error when encountering format characters

2 participants