Qwen3.5-9B-Abliterated-Claude-4.6-Opus-gptq-w4a16

AutoRound quantization in GPTQ format (W4A16) of Qwen3.5-9B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled. Calibrated with OpenCodeCal, group 64, sequence length 1024, norm 192, full attention in fp16.

Quantization Details

  • Quantization method: AutoRound (GPTQ format)
  • Bits/Config: W4A16 (group 64, seq 1024, norm 192, OpenCodeCal, full-attn fp16)
  • Base model: Qwen3.5-9B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled
Downloads last month
8
Safetensors
Model size
3B params
Tensor type
I32
BF16
F16
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for groxaxo/Qwen3.5-9B-Abliterated-Claude-4.6-Opus-gptq-w4a16