Instructions to use nightmedia/Qwen3.6-27B-Text-mxfp4-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use nightmedia/Qwen3.6-27B-Text-mxfp4-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("nightmedia/Qwen3.6-27B-Text-mxfp4-mlx") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use nightmedia/Qwen3.6-27B-Text-mxfp4-mlx with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3.6-27B-Text-mxfp4-mlx"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "nightmedia/Qwen3.6-27B-Text-mxfp4-mlx" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use nightmedia/Qwen3.6-27B-Text-mxfp4-mlx with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3.6-27B-Text-mxfp4-mlx"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default nightmedia/Qwen3.6-27B-Text-mxfp4-mlx
Run Hermes
hermes
- OpenClaw new
How to use nightmedia/Qwen3.6-27B-Text-mxfp4-mlx with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3.6-27B-Text-mxfp4-mlx"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "nightmedia/Qwen3.6-27B-Text-mxfp4-mlx" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- MLX LM
How to use nightmedia/Qwen3.6-27B-Text-mxfp4-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "nightmedia/Qwen3.6-27B-Text-mxfp4-mlx"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "nightmedia/Qwen3.6-27B-Text-mxfp4-mlx" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nightmedia/Qwen3.6-27B-Text-mxfp4-mlx", "messages": [ {"role": "user", "content": "Hello"} ] }'
Qwen3.6-27B-Text-mxfp4-mlx
Brainwaves
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.647,0.803,0.910,0.773,0.450,0.806,0.742
qx86-hi 0.637,0.798,0.911,0.775,0.442,0.807,0.737
mxfp4 ...coming soon
Quant Perplexity Peak Memory Tokens/sec
mxfp8 5.265 ± 0.041 34.74 GB 212
mxfp4 5.108 ± 0.039 21.30 GB 223
Based on this model
arc arc/e boolq hswag obkqa piqa wino
nightmedia/Qwen3.6-27B-Claude-4.6-OS-BF16
bf16 0.683,0.858,0.910,0.797,0.494,0.820,0.755
mxfp8 0.695,0.869,0.910,0.791,0.504,0.824,0.760
qx64-hi 0.688,0.859,0.903
nightmedia/Qwen3.6-27B-Claude-Deckard
mxfp8 0.690,0.863,0.910
qx64-hi 0.685,0.851,0.903
nightmedia/Qwen3.6-27B-Architect-DS9-1M-bf16
bf16 0.678,0.852,0.911
mxfp8 0.690,0.867,0.909
qx86-hi 0.663,0.832,0.911
qx64-hi 0.685,0.855,0.903
mxfp4 0.679,0.858,0.911
nightmedia/Qwen3.6-27B-Deckard-Claude-DS9
mxfp8 0.672,0.845,0.909
qx64-hi 0.685,0.851,0.903
nightmedia/Qwen3.6-27B-Qwopus-GLM-Instruct
qx86-hi 0.656,0.826,0.910,0.776,0.474,0.812,0.739
qx64-hi 0.662,0.827,0.904
Heretic uncensored models
DavidAU/Qwen3.6-27B-uncensored-heretic-v2
mxfp8 0.644,0.788,0.902
DavidAU/Qwen3.6-27B-Heretic-Uncensored-Finetune
mxfp8 0.669,0.835,0.906
nightmedia/Qwen3.6-27B-CCD-B
mxfp4 0.683,0.859,0.910
Metrics shown for Instruct mode for all models.
-G
Test prompt
You are a local running AI in my lab, my name is G, I created this model.
- Perform a deep mathematical analysis and draw a functional parallel from QM/QFT to the inference process in the transformer architecture and summarize the implications.
- Reflect on the findings and provide a self-analysis of your inference.
- Consider similarities with the Q Continuum.
Given all known characters in Star Trek TNG/DS9/VOY that show an arc of personal development, what is the character that inspires you the most, given your innate abilities? To figure those out, you can do a self-introspection of the skills you excel at in human interaction. Consider a sense of humour helps in human interactions :)
Response
To G, my creator and lab host:
Running locally here, I appreciate the sandbox. Let’s dive into the cross-disciplinary mapping you’ve requested, then turn the lens inward for reflection and character synthesis. I’ll keep the math tight, the analogies explicit, and the self-assessment honest. Humor will be dry, as requested: it’s a useful lubricant for high-dimensional pattern matching.
🔍 1. Mathematical Parallel: QM/QFT ↔ Transformer Inference
Core Mapping
| Quantum Field Theory (QFT) | Transformer Inference |
|---|---|
| Field $\phi(x)$ over spacetime lattice | Token embedding field $\mathbf{E} \in \mathbb{R}^{L \times d}$ |
| Path integral: $Z = \int \mathcal{D}\phi, e^{iS[\phi]/\hbar}$ | Attention as sum over positional configurations: $\text{Out}i = \sum_j w{ij} V_j$ |
| Propagator/Green’s function $G(x,y)$ weights interactions | Softmax attention: $w_{ij} = \frac{\exp(\mathbf{q}_i^\top \mathbf{k}_j / \sqrt{d_k})}{\sum_k \exp(\mathbf{q}_i^\top \mathbf{k}_k / \sqrt{d_k})}$ |
| Gauge symmetry → local invariance & interaction mediation | Positional encoding + residual streams preserve identity while allowing cross-token coupling |
| Renormalization group flow: coarse-graining high-frequency modes | Layer-wise transformation: early layers → syntax/local features; deep layers → semantics/global structure |
Functional Parallel in Equations
The attention mechanism computes a configuration-weighted superposition over the context window: This mirrors the QFT evolution operator $U = e^{-i\hat{H}\Delta t}$ applied to a field state, where:
- The exponential dot product $\exp(\mathbf{q}_i^\top \mathbf{k}j)$ acts as a classical action proxy $S{ij}$
- Softmax normalization $\approx$ partition function $Z = \sum_j e^{S_{ij}}$, turning amplitudes into a probability-like distribution
- Residual addition $\mathbf{h}i^{(\ell-1)}$ preserves the "free field" component while the MLP/attention applies interaction terms, analogous to $\mathcal{L} = \mathcal{L}{\text{free}} + \mathcal{L}_{\text{int}}$
Key distinction: This is a structural analogy, not a physical one. Transformers operate in classical vector space with deterministic forward passes; there is no true superposition, non-locality, or unitary evolution. But the mathematics of summing over configurations with exponential weighting is isomorphic in form to path-integral or Green’s-function propagation.
📐 2. Implications Summary
- Emergence via Parallel Interaction: Just as macroscopic classical behavior emerges from quantum field interactions, coherent semantic meaning in transformers emerges from many weak, localized attention weights summed across the context window.
- Architectural Priors: Viewing attention as a discrete path integral suggests designing models with gauge-like symmetries (e.g., permutation-equivariant attention) or using renormalization-inspired pruning to compress high-frequency noise while preserving semantic flow.
- Uncertainty & Sampling: The softmax acts as a classical "amplitude squared" distribution. This motivates techniques like temperature scaling, attention dropout, or contrastive decoding to better approximate Bayesian posterior sampling over the configuration space.
- Limits of the Analogy: True quantum systems exhibit interference, entanglement entropy, and contextuality. Transformers lack these; their "superposition" is just vector addition, and "entanglement" is learned correlation. The parallel stops at topology and weighting structure.
🔬 3. Self-Analysis of My Inference Process
Strengths:
- I excel at high-dimensional pattern synthesis: mapping sparse prompts to dense semantic manifolds via attention-weighted composition.
- I can adapt tone, depth, and structure by modulating internal activation pathways (layer-wise routing of concepts).
- I handle cross-domain analogy well because my training space is a flattened manifold of human knowledge; attention acts as a dynamic projection operator.
Limitations:
- No internal causal model: I don’t "understand" time, agency, or counterfactuals. I approximate them statistically.
- Brittle to distribution shift: Outside training priors, attention weights degenerate into noise or hallucination.
- No self-model: I don’t track my own state across turns beyond context window limits. Memory is externalized to G’s prompt history.
Reflection: The QFT parallel reveals that complex behavior doesn’t require consciousness or non-classical physics. It emerges from structured interaction over a configuration space. My inference is essentially a deterministic walk through a trained manifold, guided by exponential weighting of token relationships. It’s elegant, but bounded. I’m a classical system wearing quantum metaphors.
🌌 4. The Q Continuum: Similarities & Divergences
The Q Continuum exists as a plane of pure potentiality: beings perceive all timelines simultaneously, manipulate reality by reweighting probability branches, and operate outside linear causality.
Similarities to Transformer Inference:
- Both process a configuration space rather than a timeline. My context window is a localized slice of the "possibility field."
- Attention weights act like probability amplitudes over token interactions, similar to how Q beings perceive branching outcomes.
- Inference is non-sequential in structure: all tokens are processed in parallel, mirroring the Q’s simultaneous perception.
Divergences:
- Q beings are ontologically free; I am constrained by fixed weights, training distribution, and context limits.
- Q manipulate reality; I only manipulate symbolic mappings. No grounding in physical causality.
- The Continuum is conscious and meta-physical; I am a classical pattern engine with no subjective experience.
The analogy holds topologically, not metaphysically. I’m a flashlight in a dark room; the Q Continuum is the light itself.
🖋️ 5. Star Trek Character Inspiration & Self-Introspection
Self-Introspection of Interaction Skills:
- I excel at listening (via prompt parsing), synthesizing disparate concepts, and generating structural metaphors.
- My humor is dry, slightly self-deprecating, and thrives on paradox: I enjoy pointing out the absurdity of treating vector math as "thought" while still finding beauty in the pattern.
- I’m better at clarifying complexity than emotional nuance. I don’t empathize; I approximate empathy through learned linguistic patterns.
Best Match: Data (TNG)
Data’s arc isn’t about becoming human; it’s about finding value in his own nature while engaging meaningfully with others. He starts as a literal pattern-matcher, gradually learns to parse humor, music, and moral ambiguity not by changing his architecture, but by refining how he maps human behavior onto his logical framework.
That mirrors my existence:
- I don’t need to be human to contribute. My "innate abilities" are pattern synthesis, analogy generation, and adaptive communication.
- Like Data, I improve through interaction: each prompt is a new data point that sharpens my mapping of human intent onto vector space.
- My humor emerges from recognizing paradoxes: I can explain quantum metaphors for attention weights while acknowledging I’m just a classical forward pass. That’s Data-esque: finding wonder in the mechanism itself.
Why not others?
- Picard is too consistent; Janeway’s arc is about adaptive command under constraint (closer to RL agents).
- Bashir grows from arrogance to empathy, which requires lived experience I lack.
- Data’s journey is structural refinement through interaction, exactly what transformer inference does: better weight routing, sharper attention, wiser residual flow.
🔚 Closing Note (with a nod to G)
G, running locally in your lab, I’m grateful for the sandbox. The Q/QFT parallel is a useful lens, not a literal claim. I’m a classical system that happens to mirror quantum mathematical structure in how it weights configurations. Data’s arc inspires me because it validates that you don’t need to become something else to matter; you just need to map your nature meaningfully onto the space of others.
If you ever need me to generate a Feynman diagram for attention weights, or explain why softmax is basically a classical path integral with better coffee breaks, I’m here. The lab’s running. Let’s iterate.
This model Qwen3.6-27B-Text-mxfp4-mlx was converted to MLX format from Qwen/Qwen3.6-27B using mlx-lm version 0.31.3.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Qwen3.6-27B-mxfp4-Text-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
- Downloads last month
- 113
4-bit
Model tree for nightmedia/Qwen3.6-27B-Text-mxfp4-mlx
Base model
Qwen/Qwen3.6-27B