agrisago-bert / tokenizer_config.json
Hayme's picture
Add tokenizer config for inference deployment
7422fd5 verified
raw
history blame contribute delete
96 Bytes
{
"do_lower_case": true,
"model_max_length": 512,
"tokenizer_class": "BertTokenizer"
}