MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-hun-langspec-r16k32
Text Generation • Updated • 17
AI & ML interests
Multilingual Tokenization
Recent Activity
View all activity
models 506
MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-hun-original-r16k32
Text Generation • Updated • 16
MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-fin-langspec-r16k32
Text Generation • Updated • 10
MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-fin-original-r16k32
Text Generation • Updated • 6
MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-tur-langspec-r16k32
Text Generation • Updated • 32
MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-tur-original-r16k32
Text Generation • Updated • 4
MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-ft-langspec-r16k32
Updated
MultilingualUnigramLM/ft-langmap-gemma2-2b-fineweb100M-hun-langspec-r16k32
Text Generation • Updated • 3
MultilingualUnigramLM/ft-langmap-gemma2-2b-fineweb100M-fin-langspec-r16k32
Text Generation • Updated • 3
MultilingualUnigramLM/ft-langmap-gemma2-2b-fineweb100M-tur-langspec-r16k32
Text Generation • Updated • 22
datasets 35
MultilingualUnigramLM/FineWeb2-500M-tur_Latn
Viewer • Updated • 419k • 61
MultilingualUnigramLM/FineWeb2-500M-hun_Latn
Viewer • Updated • 312k • 59
MultilingualUnigramLM/FineWeb2-500M-fin_Latn
Viewer • Updated • 387k • 106 • 1
MultilingualUnigramLM/FineWeb2-khm_Khmr-100M
Viewer • Updated • 1.01M • 9
MultilingualUnigramLM/FineWeb2-tha_Thai-100M
Viewer • Updated • 710k • 8
MultilingualUnigramLM/FineWeb2-tam_Taml-100M
Viewer • Updated • 264k • 17
MultilingualUnigramLM/FineWeb2-arb_Arab-100M
Viewer • Updated • 188k • 9
MultilingualUnigramLM/FineWeb2-ben_Beng-100M
Viewer • Updated • 254k • 16
MultilingualUnigramLM/FineWeb2-amh_Ethi-100M
Viewer • Updated • 197k • 23
MultilingualUnigramLM/FineWeb2-yor_Latn-100M
Viewer • Updated • 80k • 8