mlx-community/Kimi-K2.5-3bit
This model mlx-community/Kimi-K2.5-3bit was converted to MLX format from moonshotai/Kimi-K2.5 using mlx-lm version 0.30.6.
Usage
Please see the model card of the original model for example code. Note that this quant is for text-only usage.
Remember to allow remote code for tokenizer usage.
- Downloads last month
- 1,108
Model size
1T params
Tensor type
BF16
路
U32
路
F32
路
Hardware compatibility
Log In
to add your hardware
4-bit
Model tree for mlx-community/Kimi-K2.5-3bit
Base model
moonshotai/Kimi-K2.5