Hacking_tool / tokenizer_config.json
Ananthusajeev190's picture
Upload 6 files
1e33fb0 verified
{
"do_lower_case": true,
"model_max_length": 512,
"tokenizer_class": "BertTokenizerFast"
}