Skip to content

Command parser mangles unicode inputs #1133

@kevsmith

Description

@kevsmith

The new command parser added to Piper for the 0.16 Cog release mangles Unicode inputs. The mangling has two sources:

  • Use of Erlang binary and iolist conversion functions (:erlang.binary_to_list/1 and :erlang.iolist_to_binary/1) in the leex generated lexers and yecc generated parsers.
  • Omission of the unicode option in calls to re:run/3 and re:replace/3 also in the generated lexers and parsers.

This bug is likely present in the old parser as well.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions