Skip to content

Releases: tiktoken-go/tokenizer

Added GPT-5 Support

08 Aug 21:09
629192d

Choose a tag to compare

Merge pull request #21 from ando-masaki/gpt-5-fix

Added GPT-5 models

v0.6.2 Revert the last commit

09 May 22:25

Choose a tag to compare

v0.6.1

27 Mar 14:38

Choose a tag to compare

🏎️ Small performance improvements

v0.6.0

07 Mar 14:52

Choose a tag to compare

Support for O3-mini model

Full Changelog: v0.5.1...v0.6.0

v0.5.1

25 Feb 15:57

Choose a tag to compare

Full Changelog: v0.5.0...v0.5.1

v0.5.0

17 Feb 20:46
8ac6fdf

Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.4.0...v0.5.0

v0.4.0

12 Feb 23:00
03e0e5f

Choose a tag to compare

What's Changed

  • pre-compile regexp2 with regexp2cg by @terwey in #11

New Contributors

Full Changelog: v0.3.0...v0.4.0

Added support for the latest OpenAI model

28 Jan 18:45
025023d

Choose a tag to compare

Merge pull request #12 from DenisPalnitsky/chatgpt-4o-support

Add support of chatgpt-4o-latest model

Support for O1 models

22 Nov 22:16
2ad5811

Choose a tag to compare

Merge pull request #10 from ando-masaki/o1-preview-and-mini-fix

Added o1-preview and o1-mini

Added support for GPT-4o and o200k base models

13 Sep 15:32

Choose a tag to compare

This release adds support for the latest models from OpenAI