Qwen3.8-27B-hermes-adapted adapter for mlx-lm

The LoRA from harness-hub/Qwen3.8-27B-hermes-adapted (revision 09fb741) in mlx-lm's adapter format: rank 32, scale 2.0 (alpha 64), on q, k, v, o of the 16 full-attention layers and gate, up, down of all 64 layers. The weights are the original float32 values, transposed to mlx-lm's layout. Size: 638 MB.

harness-hub trained this LoRA with reinforcement learning (AsyncGRPO in TRL, LoRA rank 32, alpha 64, checkpoint at step 160 of 1000 planned) to be the model behind Hermes Agent on software-engineering and terminal tasks. Their published results, under Hermes Agent with thinking off: SWE-bench Pro (hard 51) 29.4% โ†’ 43.1% and Terminal-Bench 2.1 44.7% โ†’ 58.8% against the base model, using under 40% of the base model's turns on the tasks both solve and about 2ร— fewer generated tokens. With thinking off it is level with the base model thinking at its highest effort (xhigh), at 3.5โ€“4.4ร— fewer tokens. See the original adapter card for the method, data and full results.

Use it on top of any MLX build of Qwen/Qwen3.8-27B to keep one base model and switch the adapter on and off. For a single ready-to-run model, the merged builds are simpler and slightly faster:

Build Size Same next token as bf16 KL vs bf16 GSM8K (50 questions) Peak memory, 8K-token prompt Suggested Mac memory
netprojects/Qwen3.8-27B-hermes-adapted-MLX-6bit (recommended) 23.1 GB 98.5% 0.0015 46/50 23.4 GB 36 GB+
netprojects/Qwen3.8-27B-hermes-adapted-MLX-8bit 30.0 GB 99.2% 0.0004 45/50 29.7 GB 48 GB+
netprojects/Qwen3.8-27B-hermes-adapted-MLX-4bit 16.3 GB 96.1% 0.0192 43/50 17.1 GB 32 GB+
netprojects/Qwen3.8-27B-hermes-adapted-MLX-3bit 13.8 GB 91.7% 0.0824 45/50 14.6 GB 24 GB+
netprojects/Qwen3.8-27B-hermes-adapted-MLX-2.5bit 11.8 GB 85.4% 0.2461 44/50 13.8 GB 24 GB+
netprojects/Qwen3.8-27B-hermes-adapted-MLX-bf16 55.6 GB reference reference 45/50 53.4 GB 96 GB+
pip install -U "mlx-lm>=0.32.2"
mlx_lm.generate --model mlx-community/Qwen3.8-27B-4bit --adapter-path netprojects/Qwen3.8-27B-hermes-adapted-MLX-adapter \
  --chat-template-config '{"enable_thinking": false}' --prompt "Write a bash one-liner that counts lines in all .py files." --max-tokens 300
from huggingface_hub import snapshot_download
from mlx_lm import load, generate

adapter = snapshot_download("netprojects/Qwen3.8-27B-hermes-adapted-MLX-adapter")
model, tokenizer = load("mlx-community/Qwen3.8-27B-4bit", adapter_path=adapter)
prompt = tokenizer.apply_chat_template([{"role": "user", "content": "Hello"}], add_generation_prompt=True,
                                       enable_thinking=False, tokenize=False)
print(generate(model, tokenizer, prompt=prompt, max_tokens=200))

mlx_lm.server --model mlx-community/Qwen3.8-27B-4bit --adapter-path <local adapter dir> serves it for Hermes Agent (see the 6-bit card for the Hermes Agent configuration; keep thinking off).

What was checked

On a MacBook Pro M5 Max (128 GB), 19 November 2026, mlx 0.32.4, mlx-lm 0.32.2 and mlx-vlm 0.7.11.

  • Loaded in mlx-lm on mlx-community/Qwen3.8-27B-4bit, it creates exactly 256 LoRA modules with scale 2.0, and each module's update equals 2.0 ยท B @ A from harness-hub's original file exactly.
  • With the included chat template and thinking off, base 4-bit + adapter produced a well-formed tool call and passed 3/3 short coding tasks.

License

Apache-2.0, as Qwen3.8-27B and the harness-hub adapter. LICENSE is the Apache-2.0 text from the Qwen3.8-27B repository and NOTICE describes the conversion and credits harness-hub and the Qwen Team (Alibaba Cloud).

Published by NetProjects (Internet Projects Ltd). Not affiliated with Hugging Face, harness-hub or Alibaba.

More MLX builds from NetProjects: huggingface.co/netprojects ยท netprojects.com

Downloads last month

-

Downloads are not tracked for this model. How to track
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for netprojects/Qwen3.8-27B-hermes-adapted-MLX-adapter

Base model

Qwen/Qwen3.8-27B
Quantized
(11)
this model

Collection including netprojects/Qwen3.8-27B-hermes-adapted-MLX-adapter