Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

KBLab
/

spe-bpe-32k-pretok-small_data-tokenizer

Model card Files Files and versions

spe-bpe-32k-pretok-small_data-tokenizer

1.26 MB

1 contributor

History: 2 commits

robinq's picture

Upload tokenizer

3a07b02 about 3 years ago

.gitattributes

1.48 kB

initial commit about 3 years ago
special_tokens_map.json

173 Bytes

Upload tokenizer about 3 years ago
tokenizer.json

1.26 MB

Upload tokenizer about 3 years ago
tokenizer_config.json

322 Bytes

Upload tokenizer about 3 years ago