majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-4bit
Text Generation • 35B • Updated • 900 • 17
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
144
Active filters: kv-cache-quantization
majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-6bit
Text Generation • 35B • Updated • 374 • 1
majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-5bit
Text Generation • 35B • Updated • 290 • 1
rungalileo/llama-3.2-3B-instruct-trtllm-ckpt-wq_int4_awq-kv_int8
Text Generation • Updated • 7
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8
Text Generation • Updated • 6
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_fp8-kv_fp8
Text Generation • Updated • 7
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_fp8-kv_fp8
Text Generation • Updated • 7
rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_fp8-kv_fp8
Text Generation • Updated • 6
rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8
Text Generation • Updated • 7
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8
Text Generation • Updated • 11
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8
Text Generation • Updated • 10
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8
Text Generation • Updated • 7
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8
Text Generation • Updated • 4
majentik/gemma-4-E4B-turboquant
Image-Text-to-Text • 8B • Updated • 27 • 8
majentik/Qwen3.5-27B-RotorQuant-MLX-4bit
Text Generation • 27B • Updated • 177 • 1
majentik/Qwen3.5-27B-RotorQuant-MLX-8bit
Text Generation • 27B • Updated • 116
majentik/Mistral-Small-4-119B-TurboQuant-MLX-4bit
Text Generation • 119B • Updated • 184
majentik/Mistral-Small-4-119B-TurboQuant-MLX-2bit
Text Generation • 120B • Updated • 554 • 1
majentik/Leanstral-TurboQuant-MLX-2bit
Text Generation • 238B • Updated • 471
majentik/gemma-4-31B-TurboQuant-MLX-4bit
Image-Text-to-Text • 31B • Updated • 132 • 2
majentik/gemma-4-31B-TurboQuant-MLX-2bit
Image-Text-to-Text • 31B • Updated • 136 • 1
majentik/gemma-4-31B-TurboQuant-MLX-8bit
Image-Text-to-Text • 31B • Updated • 96 • 1
majentik/gemma-4-31B-it-TurboQuant-MLX-8bit
Image-Text-to-Text • 31B • Updated • 153 • 3
majentik/gemma-4-31B-it-RotorQuant-MLX-4bit
Image-Text-to-Text • 31B • Updated • 122 • 2
majentik/gemma-4-31B-it-RotorQuant-MLX-2bit
Image-Text-to-Text • 31B • Updated • 168
majentik/gemma-4-26B-A4B-it-RotorQuant-MLX-8bit
Image-Text-to-Text • 26B • Updated • 160 • 1
majentik/gemma-4-26B-A4B-it-RotorQuant-MLX-4bit
Image-Text-to-Text • 26B • Updated • 112
majentik/gemma-4-26B-A4B-it-RotorQuant-MLX-2bit
Image-Text-to-Text • 26B • Updated • 230
majentik/gemma-4-E2B-it-TurboQuant-MLX-8bit
Image-Text-to-Text • 5B • Updated • 101
majentik/gemma-4-E2B-it-RotorQuant-MLX-4bit
Image-Text-to-Text • 5B • Updated • 66 • 1