Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,711

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 20 days ago • 784k • • 1.17k

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated 21 days ago • 2.65M • 744

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 56.3k • 144

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 17.6k • 120

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated Jun 27 • 35.6k • 60

ggml-org/bge-m3-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Oct 12, 2025 • 7.35k • 15

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 70.8k • 765

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 1.07k • 275

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 51.6k • 86

mudler/Qwen3.5-35B-A3B-APEX-GGUF

Text Generation • 35B • Updated Apr 27 • 23k • 93

DavidOKB/MathThink-Qwen-3.5-4B

4B • Updated Apr 12 • 217 • 12

majentik/Qwen3-Embedding-4B-GGUF-Q8_0

Feature Extraction • 4B • Updated 18 days ago • 327 • 2

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 8.8k • 31

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 131k • 132

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 12.2k • 67

Youssofal/Kimi-K2.6-Abliterated-Heretic-GGUF

Text Generation • Updated Apr 21 • 23

Prototype3550/Qwen3.6-9B-Heretic-Uncensored-Thinking-Sweet-Madness-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Jun 18 • 6.37k • 4

BennyDaBall/Krea-2-Engineer-V1-GGUF

Text Generation • 4B • Updated Jun 28 • 5.37k • 33

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 20 days ago • 9.27k • 17

zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF

Sentence Similarity • 1B • Updated 21 days ago • 7.96k • 4

jcbtc/Ternary-Bonsai-27B-AMD-Strix-Halo

Text Generation • Updated 18 days ago • 16

Hikari07jp/Ternary-Bonsai-27B-Abliterated-LowDeg-GGUF

Text Generation • 27B • Updated 16 days ago • 13.4k • 23

UICO/GRM-3.2-Cliff-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated 6 days ago • 304 • 2

prithivMLmods/oMEGA-4B-SpatialThink-0804-GGUF

Image-Text-to-Text • 4B • Updated 3 days ago • 271 • 2

hus960/Llama-3-13B-Instruct-Q4_K_M-GGUF

13B • Updated Apr 27, 2024 • 42 • 1

v8karlo/UNCENSORED-Phi-3-mini-4k-geminified-Q4_K_M-GGUF

Text Generation • 4B • Updated Jun 6, 2024 • 594 • 10

SkyNotion/deepseek-coder-7b-instruct-v1.5-Q4_K_M-GGUF

7B • Updated Jul 30, 2024 • 436 • 2

hellork/Phi-3-mini-4k-geminified-IQ4_NL-GGUF

Text Generation • 4B • Updated Sep 17, 2024 • 82 • 1

NikolayKozloff/Phi-3.5-mini-3.8B-ArliAI-RPMax-v1.1-Q8_0-GGUF

4B • Updated Sep 10, 2024 • 41 • 3

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 112k • 31