Skip to content

Make OpenAIGPTTokenizer work with SpaCy 2.x and 3.x#15019

Merged
LysandreJik merged 7 commits intohuggingface:masterfrom
cody-moveworks:fix_tokenizer
Jan 10, 2022
Merged

Make OpenAIGPTTokenizer work with SpaCy 2.x and 3.x#15019
LysandreJik merged 7 commits intohuggingface:masterfrom
cody-moveworks:fix_tokenizer

Commits