Instructions to use IAAR-Shanghai/Metis-27B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use IAAR-Shanghai/Metis-27B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="IAAR-Shanghai/Metis-27B", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("IAAR-Shanghai/Metis-27B", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use IAAR-Shanghai/Metis-27B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "IAAR-Shanghai/Metis-27B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "IAAR-Shanghai/Metis-27B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/IAAR-Shanghai/Metis-27B

SGLang

How to use IAAR-Shanghai/Metis-27B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "IAAR-Shanghai/Metis-27B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "IAAR-Shanghai/Metis-27B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "IAAR-Shanghai/Metis-27B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "IAAR-Shanghai/Metis-27B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use IAAR-Shanghai/Metis-27B with Docker Model Runner:
```
docker model run hf.co/IAAR-Shanghai/Metis-27B
```

astarkkk commited on Jul 31

Commit

4a3d62e

verified ·

1 Parent(s): 929570b

Update Metis-27B model release and paper metadata

Browse files

Files changed (4) hide show

.gitattributes +32 -0
README.md +13 -1
config.json +0 -3
tokenizer_config.json +0 -1

.gitattributes CHANGED Viewed

@@ -1,4 +1,36 @@
 *.bin filter=lfs diff=lfs merge=lfs -text
 *.pt filter=lfs diff=lfs merge=lfs -text
 *.safetensors filter=lfs diff=lfs merge=lfs -text
 tokenizer.json filter=lfs diff=lfs merge=lfs -text

+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
 *.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
 *.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
 *.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
 tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md CHANGED Viewed

@@ -1,11 +1,13 @@
 ---
 license: apache-2.0
 library_name: transformers
 base_model: Qwen/Qwen3.5-27B
 tags:
 - metis
 - memory
-- custom-code
 ---
 # Metis-27B
@@ -13,6 +15,16 @@ tags:
 Metis-27B is a Metis persistent-memory model built on `Qwen/Qwen3.5-27B`.
 The repository contains the complete merged model weights rather than a delta-only checkpoint.
 ## Load
 ```python

 ---
 license: apache-2.0
 library_name: transformers
+pipeline_tag: image-text-to-text
 base_model: Qwen/Qwen3.5-27B
 tags:
 - metis
 - memory
+- custom_code
+- arxiv:2607.26760
 ---
 # Metis-27B
 Metis-27B is a Metis persistent-memory model built on `Qwen/Qwen3.5-27B`.
 The repository contains the complete merged model weights rather than a delta-only checkpoint.
+## Paper
+This model is introduced in:
+**Metis: Memory Foundation Model**
+- [Hugging Face Paper](https://huggingface.co/papers/2607.26760)
+- [arXiv](https://arxiv.org/abs/2607.26760)
+- [Code](https://github.com/MemTensor/Metis)
 ## Load
 ```python

config.json CHANGED Viewed

@@ -7,7 +7,6 @@
     "AutoModelForCausalLM": "modeling_metis.MetisForCausalLM"
   },
   "backbone_configs": {
-    "_name_or_path": "/mnt/afs/models/Qwen3.5-27B",
     "architectures": [
       "Qwen3_5ForConditionalGeneration"
     ],
@@ -29,7 +28,6 @@
     "problem_type": null,
     "return_dict": true,
     "text_config": {
-      "_name_or_path": "",
       "architectures": null,
       "attention_bias": false,
       "attention_dropout": 0.0,
@@ -158,7 +156,6 @@
     "tie_word_embeddings": false,
     "video_token_id": 248057,
     "vision_config": {
-      "_name_or_path": "",
       "architectures": null,
       "chunk_size_feed_forward": 0,
       "deepstack_visual_indexes": [],

     "AutoModelForCausalLM": "modeling_metis.MetisForCausalLM"
   },
   "backbone_configs": {
     "architectures": [
       "Qwen3_5ForConditionalGeneration"
     ],
     "problem_type": null,
     "return_dict": true,
     "text_config": {
       "architectures": null,
       "attention_bias": false,
       "attention_dropout": 0.0,
     "tie_word_embeddings": false,
     "video_token_id": 248057,
     "vision_config": {
       "architectures": null,
       "chunk_size_feed_forward": 0,
       "deepstack_visual_indexes": [],

tokenizer_config.json CHANGED Viewed

@@ -9,7 +9,6 @@
   "eos_token": "<|im_end|>",
   "errors": "replace",
   "image_token": "<|image_pad|>",
-  "is_local": true,
   "model_max_length": 262144,
   "model_specific_special_tokens": {
     "audio_bos_token": "<|audio_start|>",

   "eos_token": "<|im_end|>",
   "errors": "replace",
   "image_token": "<|image_pad|>",
   "model_max_length": 262144,
   "model_specific_special_tokens": {
     "audio_bos_token": "<|audio_start|>",