NickyNicky/Phi-3-mini-128k-instruct_function-GGUF

Name	Quant method	Size
phi-3-mini-128k-instruct_function.fp16.gguf	fp16	7.64 GB
phi-3-mini-128k-instruct_function.q2_k.gguf	q2_k	1.42 GB
phi-3-mini-128k-instruct_function.q3_k_m.gguf	q3_k_m	1.96 GB
phi-3-mini-128k-instruct_function.q4_k_m.gguf	q4_k_m	2.39 GB
phi-3-mini-128k-instruct_function.q5_k_m.gguf	q5_k_m	2.82 GB
phi-3-mini-128k-instruct_function.q6_k.gguf	q6_k	3.14 GB
phi-3-mini-128k-instruct_function.q8_0.gguf	q8_0	4.06 GB

Original Model Card:

GGUF

Model size

4B params

Architecture

phi3

Hardware compatibility

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Base model

Quantized

(1)

this model