Infinity-eye / tokenizer.json
Ananthusajeev190's picture
Upload 7 files
2edd89d verified
{
"type": "word-level",
"vocab_size": 702,
"lowercase": true,
"unknown_token": "[UNK]"
}