Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

structured outputs

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

125

Base only

Active filters: structured outputs

mlx-community/Hermes-4-70B-8bit

Text Generation • 71B • Updated Aug 26, 2025 • 79 • 1

unsloth/Hermes-4-70B-GGUF

71B • Updated Aug 27, 2025 • 2.44k • 24

unsloth/Hermes-4-70B

Text Generation • 71B • Updated Aug 27, 2025 • 46 • • 1

unsloth/Hermes-4-405B

Text Generation • 406B • Updated Aug 27, 2025 • 21 • 1

unsloth/Hermes-4-405B-GGUF

Text Generation • 406B • Updated Aug 28, 2025 • 862 • 4

mlx-community/Hermes-4-405B-4bit

Text Generation • 406B • Updated Aug 27, 2025 • 48 • 1

cyankiwi/Hermes-4-70B-AWQ-4bit

Text Generation • 13B • Updated Jul 21 • 557 • 7

cyankiwi/Hermes-4-70B-AWQ-8bit

Text Generation • 21B • Updated Jul 21 • 20 • 1

mradermacher/Hermes-4-70B-GGUF

71B • Updated Aug 28, 2025 • 3.02k • 1

mradermacher/Hermes-4-70B-i1-GGUF

71B • Updated Dec 23, 2025 • 328 • 1

NousResearch/Hermes-4-14B-FP8

Text Generation • 15B • Updated Sep 3, 2025 • 6.42k • 30

gabriellarson/Hermes-4-14B-GGUF

15B • Updated Sep 2, 2025 • 3.24k • 11

NikolayKozloff/Hermes-4-14B-Q5_K_M-GGUF

15B • Updated Sep 2, 2025 • 98 • 1

NikolayKozloff/Hermes-4-14B-Q5_K_S-GGUF

15B • Updated Sep 2, 2025 • 26 • 1

NikolayKozloff/Hermes-4-14B-Q4_K_M-GGUF

15B • Updated Sep 2, 2025 • 87 • 1

NikolayKozloff/Hermes-4-14B-Q4_K_S-GGUF

15B • Updated Sep 2, 2025 • 22 • 2

warshanks/Hermes-4-14B-AWQ

Text Generation • 3B • Updated Sep 3, 2025 • 427 • 1

cyankiwi/Hermes-4-14B-AWQ-4bit

Text Generation • 4B • Updated Jul 21 • 3.68k • 4

cyankiwi/Hermes-4-14B-AWQ-8bit

Text Generation • 5B • Updated Jul 21 • 30

mlx-community/Hermes-4-14B-8bit

Text Generation • 15B • Updated Sep 3, 2025 • 330 • 2

mlx-community/Hermes-4-14B-4bit

Text Generation • 15B • Updated Sep 3, 2025 • 2.01k • 5

mlx-community/Hermes-4-14B-6bit

Text Generation • 15B • Updated Sep 3, 2025 • 104

mlx-community/Hermes-4-14B-5bit

Text Generation • 15B • Updated Sep 3, 2025 • 59

mradermacher/Hermes-4-14B-GGUF

15B • Updated Sep 3, 2025 • 1.46k • 3

mradermacher/Hermes-4-14B-i1-GGUF

15B • Updated Dec 28, 2025 • 514 • 3

Mungert/Hermes-4-14B-GGUF

15B • Updated Sep 24, 2025 • 797 • 1

ArtusDev/NousResearch_Hermes-4-14B-EXL3

Updated Oct 13, 2025 • 19

ArtusDev/NousResearch_Hermes-4-70B-EXL3

Text Generation • Updated Oct 13, 2025 • 5 • 2

Gustav0-Freind/Hermes-4-14B-Q4_K_M-GGUF

15B • Updated Sep 7, 2025 • 11

mrtoots/unsloth-Hermes-4-405B-mlx-2Bit

Text Generation • 406B • Updated Sep 10, 2025 • 39