Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

soyrsoyr published a model about 5 hours ago

inference-optimization/Inkling-Dense-54M-MTP

soyrsoyr updated a model about 7 hours ago

inference-optimization/Inkling-0.92B-MTP

RelaxingSnorlax published a model about 10 hours ago

inference-optimization/dflash2-qwen38-27b-regen-test

View all activity

inference-optimization 's models 483

inference-optimization/Inkling-Dense-54M-MTP

Updated about 5 hours ago

inference-optimization/Inkling-0.92B-MTP

Image-Text-to-Text • 0.9B • Updated about 7 hours ago • 15

inference-optimization/dflash2-qwen38-27b-regen-test

Updated about 10 hours ago

inference-optimization/qwe3.8-27B-perfectblend_replace_25ksteps_ckpt0

Updated 2 days ago

inference-optimization/qwen3.8-27B-speculator.dflash2.updatedparams.epoch1_end

Updated 6 days ago

inference-optimization/GLM-5-0.88B-MTP

Text Generation • 0.9B • Updated 6 days ago • 16

inference-optimization/DeepSeek-V3-0.86B-MTP

Text Generation • 0.9B • Updated 6 days ago • 18

inference-optimization/GLM-4.7-Flash-0.82B-MTP

Text Generation • 0.8B • Updated 6 days ago • 17

inference-optimization/GLM-4.5-Air-0.72B-MTP

Text Generation • 0.7B • Updated 6 days ago • 16

inference-optimization/gemma-4-31b-it-speculator.dflash.latestrecipe.ckpt2

3B • Updated 8 days ago • 27

inference-optimization/qwen38-dspark-cooldown-fineweb

2B • Updated 12 days ago • 35

inference-optimization/qwen38-dspark-pretrain-fineweb

2B • Updated 12 days ago • 52

inference-optimization/Qwen3-30B-A3B-Thinking-2507-REAP-25-nonuniform

Text Generation • 23B • Updated 15 days ago • 175

inference-optimization/Qwen3-30B-A3B-Thinking-2507-REAP-25-uniform

Text Generation • 23B • Updated 15 days ago • 304 • 1

inference-optimization/qwen3.8-27B-speculator.dflash2.comparisonrecipe.v2.epoch1_end

2B • Updated 15 days ago • 135

inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.bs8.ckp0

3B • Updated 16 days ago • 43

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 16 days ago • 105

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 16 days ago • 103

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 16 days ago • 102

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 16 days ago • 104

inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 16 days ago • 236

inference-optimization/Qwen3.8-27B-DSpark-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 16 days ago • 233

inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-FP8-W8A8

Text Generation • 2B • Updated 16 days ago • 91

inference-optimization/Qwen3.8-27B-DSpark-Gauss-FP8-W8A8

Text Generation • 2B • Updated 16 days ago • 92

inference-optimization/Qwen3.8-27B-DSpark-FP8-DYNAMIC

Text Generation • 2B • Updated 16 days ago • 97

inference-optimization/Qwen3.8-27B-DSpark-FP8-BLOCK

Text Generation • 2B • Updated 16 days ago • 82

inference-optimization/qwen3.8-27B-speculator.dflash2.comparisonrecipe.v2.epoch1_step107505

2B • Updated 16 days ago • 64

inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated 17 days ago • 68

inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-Gauss-NVFP4-W4A4

Text Generation • 1B • Updated 17 days ago • 66

inference-optimization/Qwen3-8B-DFlash-GPTQ-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated 17 days ago • 62