Hugging Face's logo

flexitok
/
bpe_script_Slav_16000

Czech
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_script_Slav_16000 / script_1

Commit History

  1. Upload script_1/flexitok--bpe_script_Slav_16000_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    d2cf827

  2. Upload script_1/flexitok--bpe_script_Slav_16000_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    b00d25d

  1. Upload script_1/flexitok--bpe_script_Slav_16000_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    81d04d5

  2. Upload script_1/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    a1e1a14

  3. Upload script_1/flexitok--bpe_script_Slav_16000.yaml with huggingface_hub

    gsaltintas
    Verified signature
    c956e01

  4. Upload script_1/flexitok--bpe_script_Slav_16000_info.json with huggingface_hub

    gsaltintas
    Verified signature
    98d2f09

  5. Upload script_1/flexitok--bpe_script_Slav_16000_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    97eb56f

  6. Upload script_1/flexitok--bpe_script_Slav_16000_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    1675126