antirez/deepseek-v4-gguf
Text Generation • 284B • Updated • 833k • 232
Edit Models filters
Model Tree
Apps
Inference Providers
Models
45,654
Active filters: 4-bit
huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF
284B • Updated • 23.7k • 42
mlx-community/LocateAnything-3B-4bit
Image-Text-to-Text • 1B • Updated • 2.47k • 12
mlx-community/gemma-4-12B-it-4bit
Image-Text-to-Text • 3B • Updated • 20.3k • 9
LilaRest/gemma-4-31B-it-NVFP4-turbo
Text Generation • 33B • Updated • 112k • 291
mlx-community/Qwen3.6-27B-4bit
Image-Text-to-Text • 5B • Updated • 34.7k • 29
mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit
Text Generation • 35B • Updated • 10k • 16
Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed
Text Generation • 5B • Updated • 44.3k • 36
mlx-community/gemma-4-12B-it-OptiQ-4bit
Text Generation • 12B • Updated • 3.44k • 6
mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-4bit
27B • Updated • 32.7k • 210
mlx-community/Qwen3.6-35B-A3B-4bit
Image-Text-to-Text • 6B • Updated • 120k • 62
mlx-community/MiniCPM5-1B-OptiQ-4bit
Text Generation • 0.2B • Updated • 925 • 5
mlx-community/gemma-4-12B-4bit
Any-to-Any • 3B • Updated • 6.45k • 6
mlx-community/gemma-4-12B-it-qat-4bit
Image-Text-to-Text • 3B • Updated • 4.53k • 5
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation • 9B • Updated • 147k • 53
unsloth/Qwen3.6-35B-A3B-UD-MLX-4bit
Image-Text-to-Text • 6B • Updated • 84.1k • 90
mlx-community/Qwen3.6-27B-OptiQ-4bit
Text Generation • 27B • Updated • 16.2k • 28
deadbydawn101/gemma-4-E4B-mlx-4bit
Image-Text-to-Text • 2B • Updated • 539 • 10
Jackrong/Qwopus3.6-27B-v2-MLX-4bit
Text Generation • 27B • Updated • 4.23k • 17
LiquidAI/LFM2.5-8B-A1B-MLX-4bit
Text Generation • 1B • Updated • 3.02k • 5
mlx-community/Qwen3.6-27B-MTP-4bit
Text Generation • 66.4M • Updated • 1.79k • 3
jedisct1/Mellum2-12B-A2.5B-Thinking-mlx-4bit
Text Generation • 12B • Updated • 972 • 3
openbmb/MiniCPM-o-2_6-GPTQ
Any-to-Any • 9B • Updated • 22 • 3
sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx
12B • Updated • 390 • 3
mlx-community/gemma-4-12B-it-nvfp4
Image-Text-to-Text • 3B • Updated • 4.02k • 3
mlx-community/gemma-4-12B-nvfp4
Any-to-Any • 3B • Updated • 1.79k • 3
LiquidAI/LFM2.5-1.2B-JP-202606-MLX-4bit
Text Generation • 0.2B • Updated • 168 • 3
Intel/gemma-4-12B-it-int4-AutoRound
3B • Updated • 8.82k • 3
Reza2kn/Higgs-Audio-v3-TTS-4bit-AWQ
Text-to-Speech • Updated • 55 • 3
Reza2kn/Higgs-Audio-v3-TTS-4bit-NVFP4
Text-to-Speech • Updated • 57 • 3