Zero-Shot Classification
Transformers
Safetensors
qwen3_5
feature-extraction
decision-model
classification
system-one
multimodal
vision
video
quantized
compressed-tensors
awq
w4a16
custom_code
Eval Results
Instructions to use vllm-sr/d3-W4A16-AWQ with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vllm-sr/d3-W4A16-AWQ with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-classification", model="vllm-sr/d3-W4A16-AWQ", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModel processor = AutoProcessor.from_pretrained("vllm-sr/d3-W4A16-AWQ", trust_remote_code=True) model = AutoModel.from_pretrained("vllm-sr/d3-W4A16-AWQ", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Card: first-start note, same-machine vision baseline, Typed Decisions note; drop unmeasured throughput line
#1
by TheoHsiung - opened
README only; no hashed file changes.
- Remove the "Throughput under load: not measured yet" bullet.
- Run with vLLM Semantic Router: note that the first start downloads the package and, if it stops at the runtime's 10-minute ready timeout, the same command run again only loads.
- Explain the LocalLLaMA/typed-decisions result in the page's evaluation widget (separate run, score_model.py, d3 0.7485 on the same setup).
- Highlights: give d3's same-machine vision score (73.93) next to 74.15.
Second commit: d3q/load.py docstring no longer names d3-FP8 or the personal repo TheoHsiung/d3-W4A16-G128 (now vllm-sr/d3-W4A16-GPTQ); the README links bench/d3-quant-eval at a fixed commit (7908956a) instead of a branch; MODEL_MANIFEST.json carries the new hashes and sizes of README.md and d3q/load.py, so the manifest matches this PR. It also corrects runtime.files_sha256["d3_runtime.py"], which still held an older hash (3a38391f) than the shipped file (2d90e93a). Identity (model_sha256) unchanged; checked with vllm_srun decision3 package.verify (upstream main 4e37669a) and d3_runtime.verify_package(release) on the full package.
Xunzhuo changed pull request status to merged