MiniLLM/MiniLLM-gpt2-340M
Text Generation • Updated • 323 • 5
AI & ML interests
Training efficient language models (MiniLLM, MiniPLM)
MiniLLM/SFT-gpt2-120M
Text Generation • 0.1B • Updated • 434
MiniLLM/SFT-gpt2-760M
Text Generation • 0.8B • Updated • 85
MiniLLM/MiniPLM-Qwen-500M
Text Generation • 0.5B • Updated • 185 • • 7
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • 0.2B • Updated • 45 • 6
MiniLLM/MiniPLM-Mamba-130M
Text Generation • 0.1B • Updated • 87 • 4
MiniLLM/MiniPLM-Qwen-1.2B
Text Generation • 1B • Updated • 234 • 4
MiniLLM/Ref-Pretrain-Qwen-104M
Text Generation • 0.1B • Updated • 648 • 5
MiniLLM/Pretrain-Qwen-1.2B
Text Generation • 1B • Updated • 32
MiniLLM/Pretrain-Qwen-500M
Text Generation • 0.5B • Updated • 44
MiniLLM/Pretrain-Qwen-200M
Text Generation • 0.2B • Updated • 588
MiniLLM/VanillaKD-Pretrain-Qwen-200M
Text Generation • 0.2B • Updated • 35
MiniLLM/VanillaKD-Pretrain-Qwen-500M
Text Generation • 0.5B • Updated • 32 •
MiniLLM/VanillaKD-Pretrain-Qwen-1.2B
Text Generation • 1B • Updated • 35
MiniLLM/init-gpt2-120M
Text Generation • 0.1B • Updated • 981 • 1
MiniLLM/teacher-Llama-13B
Text Generation • Updated • 53
MiniLLM/MiniLLM-Llama-7B
Text Generation • Updated • 432 • 3
MiniLLM/MiniPLM-Qwen-200M
Text Generation • 0.2B • Updated • 8.88k • 9
MiniLLM/init-Llama-7B
Text Generation • Updated • 10
MiniLLM/teacher-OPT-13B
Text Generation • Updated • 65
MiniLLM/SeqKD-Llama-7B
Text Generation • Updated • 49
MiniLLM/KD-Llama-7B
Text Generation • Updated • 56
MiniLLM/SFT-Llama-7B
Text Generation • Updated • 46
MiniLLM/init-OPT-6.7B
Text Generation • Updated • 15
MiniLLM/init-OPT-2.7B
Text Generation • Updated • 16
MiniLLM/init-OPT-1.3B
Text Generation • Updated • 29
MiniLLM/SeqKD-OPT-6.7B
Text Generation • Updated • 51
MiniLLM/SeqKD-OPT-2.7B
Text Generation • Updated • 59
MiniLLM/SeqKD-OPT-1.3B
Text Generation • Updated • 66
MiniLLM/KD-OPT-6.7B
Text Generation • Updated • 55