clvp_dev / added_tokens.json
susnato's picture
Uploaded new saved tokenizer
75a9688
Raw
History Blame Contribute Delete
72 Bytes
{
"<|endoftext|>": 255,
"[SPACE]": 2,
"[STOP]": 0,
"[UNK]": 1
}