Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

39

Base only

Active filters: group-size-64

lukaskremla/Qwen3.8-27B-3bit-MLX-TextOnly

Text Generation • 27B • Updated 6 days ago • 7.93k • 15

lukaskremla/Qwen3.8-27B-2bit-MLX-TextOnly

Text Generation • 27B • Updated 6 days ago • 5.99k • 6

lukaskremla/Qwen3.8-27B-3bit-MLX

Image-Text-to-Text • 27B • Updated 23 days ago • 2.42k • 4

lukaskremla/Qwen3.8-27B-MTP-3bit-MLX

Text Generation • 0.4B • Updated 23 days ago • 932 • 1

lukaskremla/Ornith-1.5-35B-A3B-2bit-MLX

Image-Text-to-Text • 35B • Updated 5 days ago • 95 • 1

halley-ai/gpt-oss-120b-MLX-6bit-gs64

Text Generation • 117B • Updated Sep 8, 2025 • 49 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-4bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 44 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-6bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 42 • 1

lukaskremla/Qwen3.8-27B-6bit-MLX-TextOnly

Text Generation • 27B • Updated 6 days ago • 709

lukaskremla/Qwen3.8-27B-5bit-MLX-TextOnly

Text Generation • 27B • Updated 6 days ago • 618

lukaskremla/Qwen3.8-27B-8bit-MLX-TextOnly

Text Generation • 27B • Updated 6 days ago • 821 • 1

lukaskremla/Qwen3.8-27B-4bit-MLX-TextOnly

Text Generation • 27B • Updated 6 days ago • 1.64k • 2

lukaskremla/Qwen3.8-27B-8bit-MLX

Image-Text-to-Text • 27B • Updated 23 days ago • 249

lukaskremla/Qwen3.8-27B-6bit-MLX

Image-Text-to-Text • 27B • Updated 23 days ago • 239

lukaskremla/Qwen3.8-27B-5bit-MLX

Image-Text-to-Text • 27B • Updated 23 days ago • 180

lukaskremla/Qwen3.8-27B-4bit-MLX

Image-Text-to-Text • 27B • Updated 23 days ago • 340

lukaskremla/Qwen3.8-27B-2bit-MLX

Image-Text-to-Text • 27B • Updated 23 days ago • 1.32k • 1

lukaskremla/Qwen3.8-27B-MTP-8bit-MLX

Text Generation • 0.4B • Updated 23 days ago • 394

lukaskremla/Qwen3.8-27B-MTP-6bit-MLX

Text Generation • 0.4B • Updated 23 days ago • 560

lukaskremla/Qwen3.8-27B-MTP-5bit-MLX

Text Generation • 0.4B • Updated 23 days ago • 363

lukaskremla/Qwen3.8-27B-MTP-4bit-MLX

Text Generation • 0.4B • Updated 23 days ago • 462

lukaskremla/Qwen3.8-27B-MTP-2bit-MLX

Text Generation • 0.4B • Updated 23 days ago • 1.08k • 1

lukaskremla/Ornith-1.5-35B-A3B-MTP-2bit-MLX

Text Generation • 0.8B • Updated 5 days ago • 36

lukaskremla/Ornith-1.5-35B-A3B-MTP-3bit-MLX

Text Generation • 0.8B • Updated 5 days ago • 36

lukaskremla/Ornith-1.5-35B-A3B-MTP-4bit-MLX

Text Generation • 0.8B • Updated 5 days ago • 73

lukaskremla/Ornith-1.5-35B-A3B-MTP-5bit-MLX

Text Generation • 0.8B • Updated 5 days ago • 35

lukaskremla/Ornith-1.5-35B-A3B-MTP-6bit-MLX

Text Generation • 0.8B • Updated 5 days ago • 36

lukaskremla/Ornith-1.5-35B-A3B-MTP-8bit-MLX

Text Generation • 0.8B • Updated 5 days ago • 68

lukaskremla/Ornith-1.5-35B-A3B-3bit-MLX-TextOnly

Text Generation • 35B • Updated 5 days ago • 35

lukaskremla/Ornith-1.5-35B-A3B-2bit-MLX-TextOnly

Text Generation • 35B • Updated 5 days ago • 31