Download special_tokens_map.json from codefuse-ai/Rodimus-Plus-Coder-1.6B-Base: direct link, hf CLI and curl.
- Browser
- Download file 314 Bytes
-
https://huggingface.co/codefuse-ai/Rodimus-Plus-Coder-1.6B-Base/resolve/ec8a3d851f816a80a051dcdf073b7266374cfe60/special_tokens_map.json
- Command line
-
hf download hf://codefuse-ai/Rodimus-Plus-Coder-1.6B-Base@ec8a3d851f816a80a051dcdf073b7266374cfe60/special_tokens_map.json
-
curl -L -o special_tokens_map.json https://huggingface.co/codefuse-ai/Rodimus-Plus-Coder-1.6B-Base/resolve/ec8a3d851f816a80a051dcdf073b7266374cfe60/special_tokens_map.json
314 Bytes
| { | |
| "additional_special_tokens": [ | |
| "<|fim_begin|>", | |
| "<|fim_hole|>", | |
| "<|fim_end|>", | |
| "<|fim_pad|>", | |
| "<|repo_name|>", | |
| "<|file_sep|>" | |
| ], | |
| "bos_token": "<|startoftext|>", | |
| "cls_token": "[CLS]", | |
| "eos_token": "<|endoftext|>", | |
| "gmask_token": "[gMASK]" | |
| } | |