Luke Alonso
lukealonso
AI & ML interests
None yet
Recent Activity
new activity
about 7 hours ago
lukealonso/MiniMax-M2.5-NVFP4:VLLM error for kv weight scaling - workaround
new activity
about 14 hours ago
lukealonso/MiniMax-M2.5-NVFP4:fp8 kv cache
updated
a model
1 day ago
lukealonso/MiniMax-M2.5-NVFP4
Organizations
None yet
VLLM error for kv weight scaling - workaround
5
#6 opened 1 day ago
by
ShaunEvansMD
fp8 kv cache
15
#4 opened 2 days ago
by
festr2
Thanks for your effort
5
#5 opened 1 day ago
by
darkstar3537
KeyError: '110.w1.input_scale' with TRT
2
#3 opened 3 days ago
by
guanwenyu1995
"w1_weight_scale_2 must match w3_weight_scale_2. Accuracy may be affected."
👍
1
16
#2 opened 4 days ago
by
zenmagnets
Here's the vLLM recipe I'm using with 2x RTX Pro 6000
👍
2
13
#1 opened 4 days ago
by
zenmagnets
one more time..? Minimax-M2.5 🔥
4
#4 opened 5 days ago
by
reneho
This is perfect! Thank you!
🔥
1
14
#1 opened about 2 months ago
by
ktsaou
MinimaxM2.1
3
#5 opened about 2 months ago
by
reneho
Devstral-2 NVFP4?
3
#3 opened 2 months ago
by
reneho
you know which nightly it worked with? because it does not with current one
31
#1 opened 3 months ago
by
willfalco