Article
Jonna Matthiesen
JonnaMat
AI & ML interests
None yet
Recent Activity
published an
article
about 6 hours ago
FlashHead: Accelerating Language Model Inference ~ *Efficient drop-in replacement for the classification head* updated
a dataset about 8 hours ago
embedl/documentation-images posted an
update
about 9 hours ago
🚀 FlashHead: Efficient Drop-In Replacement for the Classification Head in Language Model Inference
🔎 Check out our latest FlashHead-enabled model: https://huggingface.co/embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
🧩 Seamless integration with vllm:
```
docker run --rm -it \
--network host \
--shm-size=8g \
--ulimit memlock=-1 \
--ulimit stack=67108864 \
--runtime=nvidia \
--name=vllm-serve \
-e HF_TOKEN=hf_*** \
-e HF_HOME=/root/.cache/huggingface \
embedl/vllm:latest-jetson-orin-flashhead \
vllm serve "embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead" \
--max-model-len 8192 \
--gpu-memory-utilization 0.75 \
--max-num-seqs 2 \
--trust-remote-code
```
Organizations
published an
article about 6 hours ago
published an
article 11 days ago
Article