Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31,140

Base only

Active filters: 8-bit

deepseek-ai/DeepSeek-V4-Pro-DSpark

Text Generation • 889B • Updated 5 days ago • 29.2k • 450

nvidia/Qwen3.6-27B-NVFP4

Text Generation • 18B • Updated 9 days ago • 748k • 331

nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4

Text Generation • 45B • Updated 2 days ago • 17k • 75

deepseek-ai/DeepSeek-V4-Flash-DSpark

Text Generation • 165B • Updated 5 days ago • 118k • 180

nvidia/GLM-5.2-NVFP4

Text Generation • 381B • Updated 13 days ago • 626k • 256

deepseek-ai/DeepSeek-V4-Pro

Text Generation • 862B • Updated 17 days ago • 1.29M • • 5.19k

deepseek-ai/DeepSeek-V4-Flash

Text Generation • 158B • Updated 17 days ago • 2.48M • • 1.72k

madeby561/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid

347B • Updated 2 days ago • 875 • 29

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated 27 days ago • 8M • 448

AEON-7/Ornith-1.0-35B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 21B • Updated 10 days ago • 37.1k • 49

google/gemma-4-E2B-it-qat-mobile-transformers

Any-to-Any • 2B • Updated Jun 5 • 25.2k • 118

openai/gpt-oss-20b

Text Generation • 22B • Updated Aug 26, 2025 • 7.34M • • 4.77k

openai/gpt-oss-120b

Text Generation • 120B • Updated Aug 26, 2025 • 4.43M • • 4.96k

sakamakismile/ThinkingCap-Qwen3.6-27B-NVFP4

Image-Text-to-Text • 17B • Updated 1 day ago • 313 • 14

RedHatAI/GLM-5.2-NVFP4-FP8

Text Generation • 425B • Updated 2 days ago • 436 • 15

meituan-longcat/LongCat-2.0-INT8

Text Generation • 1.8T • Updated 1 day ago • 171 • 13

PhalaCloud/GLM-5.2-W4AFP8

Text Generation • 392B • Updated 1 day ago • 31.9k • 33

nvidia/Qwen3.5-122B-A10B-NVFP4

Text Generation • 65B • Updated Jun 2 • 98.4k • 37

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4

Text Generation • 335B • Updated 15 days ago • 435k • • 244

nvidia/MiniMax-M3-NVFP4

Text Generation • 247B • Updated 13 days ago • 127k • 56

kodelow/Hy3-NVFP4-W4A16

Text Generation • 172B • Updated 1 day ago • 3.08k • 9

nvidia/DeepSeek-V4-Flash-NVFP4

Text Generation • 167B • Updated 25 days ago • 663k • 64

nvidia/diffusiongemma-26B-A4B-it-NVFP4

Text Generation • 14B • Updated 5 days ago • 1.92M • 98

poolside/Laguna-XS-2.1-NVFP4

Text Generation • 20B • Updated 2 days ago • 3.8k • 7

rdtand/Ornith-1.0-35B-PrismaAURA-4.75bit-vllm-MTP

Text Generation • 22B • Updated 5 days ago • 2.59k • 6

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

Text Generation • 67B • Updated May 1 • 1.43M • 382

nvidia/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 11 • 1.96M • 113

mlx-community/gemma-4-12b-coder-fable5-composer2.5-8bit

Text Generation • 12B • Updated 18 days ago • 12.8k • 24

OpenYourMind/GLM-5.2-abliterated

432B • Updated 10 days ago • 2 • 23

nvidia/Mistral-Medium-3.5-128B-NVFP4

Text Generation • 84B • Updated 8 days ago • 14.9k • 21