Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

460

Base only

Active filters: fp16

Webagil/lfm2-colbert-350m-onnx-fp16

Sentence Similarity • Updated Jun 10

KryptykAngel/Qwen3.6-35B-A3B-Uncensored-HauhauCS-FP16-i1-GGUF

36B • Updated Jun 10 • 29

dror201031/DreamLite-mobile-ONNX-WebGPU

Text-to-Image • Updated Jun 10 • 1

brodatech/Sharp-onnx

Image-to-3D • Updated Jun 10 • 1

corsairnui/diffusiongemma-26b-a4b-it-strix-halo-fp16

Text Generation • 25B • Updated Jun 12 • 721 • 8

Reza2kn/visualears-fastconformer-fa-full-ab-coreml-fp16

Automatic Speech Recognition • Updated Jun 11 • 1

Reza2kn/visualears-fastconformer-fa-full-ab-fp16

Automatic Speech Recognition • Updated Jun 11 • 15

durgasai299792458/QWEN-3.5-4B-OPENVINO-NPU-MODEL

Text Generation • Updated Jun 11 • 6

smkrv/gigaam-v3-e2e-rnnt-coreml

Automatic Speech Recognition • Updated Jul 8 • 111 • 1

Reza2kn/visualears-fastconformer-fa-full-ab-onnx-fp16

Automatic Speech Recognition • Updated 22 days ago

Reza2kn/visualears-fastconformer-fa-full-ab-litert-fp16

Automatic Speech Recognition • Updated 22 days ago • 30

darkc0de/XORTRON-NXTXPRTXXL

Image-Text-to-Text • 128B • Updated Jul 13 • 273 • 7

tonythethompson/Silero-VAD-FP16-ONNX

Voice Activity Detection • Updated Jun 15

tonythethompson/Kokoro-82M-FP16-ONNX

Text-to-Speech • Updated Jun 15

durgasai299792458/QWEN-3.5-4B-int-4-openvino-npu

Text Generation • Updated Jun 13 • 8

mradermacher/XORTRON-NXTXPRTXXL-GGUF

Image-Text-to-Text • 125B • Updated Jul 18 • 261 • 2

durgasai299792458/qwen35-4b-openvino-genai-npu

Text Generation • Updated Jun 14 • 15

mradermacher/XORTRON-NXTXPRTXXL-i1-GGUF

Image-Text-to-Text • 125B • Updated Jul 18 • 536 • 2

Reza2kn/visualears-fastconformer-fa32m-streaming-bpe1024-onnx-fp16

Automatic Speech Recognition • Updated Jun 15

Reza2kn/visualears-fastconformer-fa32m-streaming-bpe1024-litert-fp16

Automatic Speech Recognition • Updated Jun 15 • 13

raoqu/index-tts2-metal

Text-to-Speech • Updated Jun 17 • 1

trysem/wav2vec2-malayalam-fp16

Automatic Speech Recognition • 0.3B • Updated Jun 15 • 7

cp500/infon-extract

Updated Jun 16 • 8

lxz8798/qwen3.6-35b-moe-kuato-base

Image-Text-to-Text • 36B • Updated Jun 16 • 5

dustbeast/SAM3.1-CoreML-FP16

Mask Generation • Updated Jun 16 • 4

sourav-paramanya/qwen2.5-3b-esim-assistant-final

Text Generation • 3B • Updated Jun 17 • 7

shameez/nemotron-speech-streaming-en-0.6b-onnx-560ms

Automatic Speech Recognition • Updated Jun 18 • 8

shameez/nemotron-speech-streaming-en-0.6b-onnx-160ms

Automatic Speech Recognition • Updated Jun 18 • 5

shameez/nemotron-speech-streaming-en-0.6b-onnx-80ms

Automatic Speech Recognition • Updated Jun 18 • 5

shameez/nemotron-speech-streaming-en-0.6b-onnx-1120ms

Automatic Speech Recognition • Updated Jun 18 • 7