Transformers
segment_tokenizer / tokenizer.json
TenzinGayche's picture
Upload tokenizer
2bb70cf verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
f6394e37278a3d7db07d91b9c1895daef2c756e718a71908c4815ae6fa2f67dd
Pointer size:
133 Bytes
·
Size of remote file:
33.4 MB
·
Xet hash:
39d28cac5f2750d46c5fe8ddf9980be4bb226b128a6930b4a63e0ead091ec8a4

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.