Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

214

Base only

Active filters: gpu

magiccodingman/Qwen3-4B-Thinking-2507-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 39 • 1

magiccodingman/Qwen3-4B-Thinking-2507-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 46 • 1

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 124 • 2

magiccodingman/Seed-OSS-36B-Instruct-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 36B • Updated Dec 3, 2025 • 20 • 1

magiccodingman/Granite-4.0-H-350M-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 0.3B • Updated Dec 2, 2025 • 33

magiccodingman/Granite-4.0-H-1B-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 1B • Updated Dec 3, 2025 • 34

magiccodingman/Apriel-1.5-15b-Thinker-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 14B • Updated Apr 25 • 188

magiccodingman/Qwen3-VL-8B-Thinking-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 8B • Updated Apr 25 • 227 • 1

magiccodingman/Qwen3-VL-8B-Instruct-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 8B • Updated Dec 3, 2025 • 137 • 2

magiccodingman/Qwen3-VL-32B-Thinking-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 33B • Updated Dec 3, 2025 • 34

magiccodingman/Granite-4.0-H-350M-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 0.3B • Updated Apr 25 • 73 • 1

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 338 • 8

magiccodingman/Qwen3-4B-Thinking-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 251 • 2

magiccodingman/Qwen3-30B-A3B-Thinking-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 271 • 5

magiccodingman/Qwen3-30B-A3B-Instruct-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 272 • 4

magiccodingman/Seed-OSS-36B-Instruct-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 36B • Updated Apr 25 • 704 • 10

magiccodingman/Apriel-1.5-15b-Thinker-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 14B • Updated Apr 25 • 296 • 2

Stan31/quantumflow-prototypes

Updated Dec 19, 2025

Jong-Seong/qwen3-next-gb10-guide

Hellohal2064/vllm-dgx-spark-gb10

Text Generation • Updated Jan 6 • 7

Jens-Duttke/DepthPro-ONNX-HighPerf

Depth Estimation • Updated Jan 30 • 15 • 1

wekkel/Qwen3-32B-Instruct-DirectML-INT4

Text Generation • Updated Jan 17 • 11

raipolymath/triton-windows

Updated Jan 23 • 1

mahwizzzz/ur_int8_ct2

Updated Feb 17 • 8

Jay0515/onnxruntime-gpu-aarch64-cuda13-sm121

Other • Updated Mar 16 • 6

WeilJimmer/onnxruntime-gpu-aarch64-cuda13-sm121

Other • Updated Apr 4

Qanatpharma/tensorflow-2.21.0-cuda13-aarch64

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated 19 days ago • 12.1k • 22

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 18B • Updated 19 days ago • 8.8k • 13

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated 19 days ago • 359 • 2