Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
androiddrew
/
Devstral-Small-2-24B-Instruct-2512-AWQ-4bit
like
0
Safetensors
vllm
mistral3
mistral-common
compressed-tensors
arxiv:
2501.19399
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Sort: Recently created
AWQ 4-bit produces repetitive gibberish on long outputs with vLLM v0.15.1 — same bug as cyankiwi variant
#1 opened 12 days ago by
BigBlueWhale