ai-babai/gigachat-audio-mlx
Audio-Text-to-Text • 11B • Updated • 184
Offline GigaChat Audio on Apple Silicon with MLX: ask about audio, transcribe or translate speech, detect emotion, find moments and make summaries.
Note BF16 — best measured answer quality: 22.54 GB model, 22.84 GiB measured process memory, 10.41 s for 5:17 audio on M4 Pro / 48 GB.
Note Q8/BF16 — smaller and faster: 13.75 GB model, 14.80 GiB measured process memory, 6.90 s for 5:17 audio; factual errors in 3 more reviewed cases than BF16.