v4.0

What's Changed

• Add streaming HTML tokenizer with CSS and JavaScript delegation by @Copilot in #39

Full Changelog: v3.0...v4.0

v3.0

What's Changed

• Issues/36 add csstokenizer by @crwsolutions in #37

Full Changelog: v2.1...v3.0

v2.1

• yaml fix
• sql fix
• inline fix

Full Changelog: v2.0...v2.1

v2.0

What's Changed

• Implement streaming YAML tokenizer with character-by-character state machine by @Copilot in #33
• Issues/34 rename markup to markdown by @crwsolutions in #35

Full Changelog: v1.0.1...v2.0

v1.0.1

Full Changelog: v1.0...v1.0.1

v1.0

What's Changed

• Implement XmlTokenizer with state machine parser by @Copilot in #3
• Fix XmlTokenizer missing opening angle brackets in complex XML by @Copilot in #9
• Add streaming SQL tokenizer with state machine parser by @Copilot in #13
• Add TypeScript tokenizer with character-by-character state machine parsing by @Copilot in #14
• Implement streaming C# tokenizer with state machine by @Copilot in #15
• Implement streaming MarkupTokenizer with semantic tokens, client-driven inline streaming, and native language-specific token support by @Copilot in #16
• converted lib to netstandard2 by @crwsolutions in #17
• Features/implement base tokenizers by @crwsolutions in #18
• Issues/improve await api by @crwsolutions in #19
• Add AnsiConsole extensions for JSON, TypeScript, C#, and SQL input by @Copilot in #21
• Fix async handling in tokenizer test helper methods by @Copilot in #23
• Split Spectre.Console.Extensions.NTokenizers.ShowCase into 6 separate projects by @Copilot in #25
• Split up NTokenizers.ShowCase into 6 separate projects by @Copilot in #27
• Add documentation pages for XML, JSON, TypeScript, SQL, and Markup tokenizers by @Copilot in #29
• Add CancellationToken support to stream parsing methods by @Copilot in #31

New Contributors

• @Copilot made their first contribution in #3
• @crwsolutions made their first contribution in #17

Full Changelog: https://github.com/crwsolutions/ntokenizers/commits/v1.0