Hugging Face's logo

Echo9Zulu
/
Hermes-4-70B-int4_asym-ov

Text Generation
OpenVINO
llama
OpenArc
Optimum-Intel
OpenVINO
OpenVINO GenAI
conversational
Model card Files
xet
 Community

This openvino IR was prepared with weight only quantization to int4-asym.

Downloads last month
8
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Echo9Zulu/Hermes-4-70B-int4_asym-ov

Base model

meta-llama/Llama-3.1-70B
Finetuned
NousResearch/Hermes-4-70B
Finetuned
(4)
this model

Collection including Echo9Zulu/Hermes-4-70B-int4_asym-ov