Releases: tiktoken-go/tokenizer
Releases · tiktoken-go/tokenizer
Added GPT-5 Support
Merge pull request #21 from ando-masaki/gpt-5-fix Added GPT-5 models
v0.6.2 Revert the last commit
Full Changelog: v0.6.1...v0.6.2
v0.6.1
🏎️ Small performance improvements
v0.6.0
Support for O3-mini model
Full Changelog: v0.5.1...v0.6.0
v0.5.1
Full Changelog: v0.5.0...v0.5.1
v0.5.0
What's Changed
- memory-efficient token counting functionality by @amalucelli in #13
New Contributors
- @amalucelli made their first contribution in #13
Full Changelog: v0.4.0...v0.5.0
v0.4.0
Added support for the latest OpenAI model
Merge pull request #12 from DenisPalnitsky/chatgpt-4o-support Add support of chatgpt-4o-latest model
Support for O1 models
Merge pull request #10 from ando-masaki/o1-preview-and-mini-fix Added o1-preview and o1-mini
Added support for GPT-4o and o200k base models
This release adds support for the latest models from OpenAI