Instructions to use MeTask-Rain/metask-jev-rain-31B-trained with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use MeTask-Rain/metask-jev-rain-31B-trained with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="MeTask-Rain/metask-jev-rain-31B-trained")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("MeTask-Rain/metask-jev-rain-31B-trained")
model = AutoModelForMultimodalLM.from_pretrained("MeTask-Rain/metask-jev-rain-31B-trained", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use MeTask-Rain/metask-jev-rain-31B-trained with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "MeTask-Rain/metask-jev-rain-31B-trained"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "MeTask-Rain/metask-jev-rain-31B-trained",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/MeTask-Rain/metask-jev-rain-31B-trained

SGLang

How to use MeTask-Rain/metask-jev-rain-31B-trained with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "MeTask-Rain/metask-jev-rain-31B-trained" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "MeTask-Rain/metask-jev-rain-31B-trained",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "MeTask-Rain/metask-jev-rain-31B-trained" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "MeTask-Rain/metask-jev-rain-31B-trained",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use MeTask-Rain/metask-jev-rain-31B-trained with Docker Model Runner:
```
docker model run hf.co/MeTask-Rain/metask-jev-rain-31B-trained
```

Configuration Parsing Warning:In config.json: "num_experts" must be a number

Configuration Parsing Warning:In config.json: "num_experts_per_tok" must be a number

metask-jev-rain-31B-trained

MeTask's 31B model makes structured decisions: given a state and a question, the service returns a judgment and probabilities for the available options. Our trained adapter, together with the base checkpoint it runs on, is available for download and private deployment. On JevBench, it scores 79.6 and ranks #3 in the qualifying open-weight capability ranking as of 2026-10-17 (service v3).

Organizer-measured results

Results below are organizer-measured Capability Scores, checked on 2026-10-17 against JevBench board v1.7.46 (page updated 2026-10-16). Ranks refer to the 129 open-weight systems qualifying for the capability ranking under the official cost and latency limits, not the composite-score ranking or every listed system. The leaderboard's 'official #' label refers to its separate composite ranking.

For these full-set results, the operator measures each system on 1,500 decisions: 1,200 sealed items that submitters cannot access and 300 public items.

Evaluated service	Trained	Capability Score	Capability rank	Checked
metask-jev-rain-31B-trained service v3	yes	79.6	3	2026-10-17
metask-jev-rain-31B-trained	yes	78.9	5	2026-10-17

The entries ranked #3 and #5 use the same 31B model and identical weights, released in this repository. The #3 evaluation updated the service layer, including the probability setting for yes/no questions. We proactively disclosed the changes to the benchmark operator, which records them on the leaderboard. The weights are public so others can download, use and inspect them. The two rows are evaluations of different service versions, not two independently trained models.

The leaderboard records this disclosure on the #3 row. The yes/no probability constant actually deployed is the yes/no accuracy on our own 1,419-item development set; an earlier draft value that had drawn on the previous row's published aggregate was dropped before submission. The data behind every service parameter is listed in the service disclosure.

Data and evaluation

Training and checkpoint selection used our own data; no JevBench item, public or sealed, was used for either. The 231 public items available to us at the time were used for service-parameter fitting and service measurements; the organizer's score is measured on 1,200 sealed items plus 300 public items. These are in-sample service checks, not independent evidence of generalization. See the service disclosure for the data used by each parameter and the measurement conditions. The organizer-measured results above evaluate the complete service; a different runtime or calibration setup may give different results with the same weights.

Use and deployment

We trained this model for decision tasks on Google's open-weight Gemma 4 31B base. The download contains the Gemma 4 base checkpoint and our trained decision adapter; both must be loaded together, and loading the base alone omits our training.

Use the service package to reproduce the structured decision interface. Both the base checkpoint and adapter/ are required. The service uses vLLM 0.31.0 and applies the adapter on every request. It may use a short second reasoning pass for some decisions; it is not always a single-pass system.

HF-generated Transformers examples may load only the base checkpoint; follow the service instructions to include our adapter and structured decision interface.

Base revisions, adapter structure, quantization and the serving example are in Technical notes. Evaluate decision accuracy and probability calibration on your own tasks before deployment.

License and attribution

Apache-2.0, following the base model's Gemma 4 license. Base-model attribution is retained in this card's metadata and the technical notes. Retain the applicable license and attribution notices when redistributing.

Contact: chenyuwang166@gmail.com

Related releases

Model	Weights	Evaluated service and disclosure
MeTask 31B	Model repository	Service package
MeTask 12B	Model repository	Service package

Downloads last month: 856

Safetensors

Model size

33B params

Tensor type

I32

BF16

Model tree for MeTask-Rain/metask-jev-rain-31B-trained

Base model

google/gemma-4-31B

Finetuned

google/gemma-4-31B-it

Adapter

(365)

this model