Hugging Face's logo

HPLT
/
hplt_bert_base_is

Fill-Mask
Transformers
PyTorch
Safetensors
Icelandic
BERT
HPLT
encoder
custom_code
Model card Files
xet
 Community
1
davda54 commited on
Commit
bdcbbde
·
verified ·
1 Parent(s): f7bc046

Upload tokenizer.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. tokenizer.json +2 -2
tokenizer.json CHANGED
@@ -991,7 +991,7 @@
991
  {
992
  "type": "Metaspace",
993
  "replacement": "▁",
994
- "add_prefix_space": true
995
  },
996
  {
997
  "type": "Split",
@@ -1104,7 +1104,7 @@
1104
  {
1105
  "type": "Metaspace",
1106
  "replacement": "▁",
1107
- "add_prefix_space": false
1108
  },
1109
  {
1110
  "type": "Strip",
 
991
  {
992
  "type": "Metaspace",
993
  "replacement": "▁",
994
+ "prepend_scheme": "always"
995
  },
996
  {
997
  "type": "Split",
 
1104
  {
1105
  "type": "Metaspace",
1106
  "replacement": "▁",
1107
+ "prepend_scheme": "never"
1108
  },
1109
  {
1110
  "type": "Strip",