Instructions to use meituan-longcat/LongCat-Flash-Lite-Sparse with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use meituan-longcat/LongCat-Flash-Lite-Sparse with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="meituan-longcat/LongCat-Flash-Lite-Sparse")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import LongcatCausalLM
model = LongcatCausalLM.from_pretrained("meituan-longcat/LongCat-Flash-Lite-Sparse", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use meituan-longcat/LongCat-Flash-Lite-Sparse with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "meituan-longcat/LongCat-Flash-Lite-Sparse"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "meituan-longcat/LongCat-Flash-Lite-Sparse",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/meituan-longcat/LongCat-Flash-Lite-Sparse

SGLang

How to use meituan-longcat/LongCat-Flash-Lite-Sparse with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "meituan-longcat/LongCat-Flash-Lite-Sparse" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "meituan-longcat/LongCat-Flash-Lite-Sparse",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "meituan-longcat/LongCat-Flash-Lite-Sparse" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "meituan-longcat/LongCat-Flash-Lite-Sparse",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use meituan-longcat/LongCat-Flash-Lite-Sparse with Docker Model Runner:
```
docker model run hf.co/meituan-longcat/LongCat-Flash-Lite-Sparse
```

Wen-Z commited on about 1 month ago

Commit

bc076cb

verified ·

1 Parent(s): 80b7bb3

Add files using upload-large-folder tool

Browse files

Files changed (26) hide show

model-00001-of-00026.safetensors +3 -0
model-00002-of-00026.safetensors +3 -0
model-00003-of-00026.safetensors +3 -0
model-00004-of-00026.safetensors +3 -0
model-00005-of-00026.safetensors +3 -0
model-00006-of-00026.safetensors +3 -0
model-00007-of-00026.safetensors +3 -0
model-00008-of-00026.safetensors +3 -0
model-00009-of-00026.safetensors +3 -0
model-00010-of-00026.safetensors +3 -0
model-00011-of-00026.safetensors +3 -0
model-00012-of-00026.safetensors +3 -0
model-00013-of-00026.safetensors +3 -0
model-00014-of-00026.safetensors +3 -0
model-00015-of-00026.safetensors +3 -0
model-00016-of-00026.safetensors +3 -0
model-00017-of-00026.safetensors +3 -0
model-00018-of-00026.safetensors +3 -0
model-00019-of-00026.safetensors +3 -0
model-00020-of-00026.safetensors +3 -0
model-00021-of-00026.safetensors +3 -0
model-00022-of-00026.safetensors +3 -0
model-00023-of-00026.safetensors +3 -0
model-00024-of-00026.safetensors +3 -0
model-00025-of-00026.safetensors +3 -0
model-00026-of-00026.safetensors +3 -0

model-00001-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2fb49398091706f121475c80e918e547f5de93547548cc110cae497fcfadab79
+size 5318653312

model-00002-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:17e6058ca6affcf1c90a756b819768fa3221d89ad5a771bfeab4ad41e94c3939
+size 5318652280

model-00003-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ca32f971a8989c3bef1c02470e9f36d15935b841834bc3336f77e7e49c86ba61
+size 5318651344

model-00004-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c9370e39deb740c2077969ebc44831a5117fc88fe09e6d76def69f386a5c1248
+size 5318584592

model-00005-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dff0e3a6173ebb2eecedcc12c9f41df350c5d6f1f69e88ba42d7957bdf154e6b
+size 5318584712

model-00006-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1a55ddbe7614f6b1f88f9545afba9d4c61bda00f95b481740fe4d66226df03fb
+size 5318584496

model-00007-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c4cd6f30831f1b675d8ca40123a180499d88c33321d1022b1d9143af689c719a
+size 5318647304

model-00008-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5b3c2f447f247a4f74db7e42a06f4f7c25eaacbc2cf9e019cfc8ae4a509c976a
+size 5318646272

model-00009-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fb90a17dbdaac0f7f0d0b594ae08f6d58c88a266ffd699cb7cd1263b627bf0b8
+size 5318645248

model-00010-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:11eed99f78530f5166e165c0f252025a1639273cfc510c67130654eb66c95754
+size 5318644232

model-00011-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a59ffb6f26e2e0e4bc85f24f77bc0added4d7c9093fb6c50e2281590a5c36605
+size 5318643200

model-00012-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5f81ce51d012b20e1b8f211f460ae3c18d88c89dd3046598f27d070659a424c5
+size 5318642184

model-00013-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:24987f390b96dc4d0d5cb1efa281a7cd6dfca3c10e43163941e316f12985f20c
+size 5319122848

model-00014-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4194a825ebd5920fb21f6f0fdd0e94d6e424fa20378c2d381f501f75ae203957
+size 5319122584

model-00015-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:51501179424ba7031850b5dd7094444a2241ff4c1c0be2643d43c440c9e4690b
+size 5319122888

model-00016-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c9813f810fe5332e00c0b78d028460c92327456ae5ee7db12c97b7511ce1de6b
+size 5319131544

model-00017-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3955ef4f2508e14cca50ef884a19022b60512f88d74fd6ba4d5216d801822fd2
+size 5319131560

model-00018-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b3b8cdd06afb11f3f3a608d985ce3dc15e0f08a0927a05b11538cc93f170f6bb
+size 5319131544

model-00019-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e4602c818bbc03a96d008a8c061b8c730f324fc5dd3257ab45f8dfd853fef8d2
+size 5319131488

model-00020-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:418fd675799d48ed2323e15b246a1c8a22aa5041a71cd17db29ad293078ffc93
+size 5319131520

model-00021-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b3e96619782535b8c782559c0259bc31f7dbbf3c4b4948cb5bf17165624c2de4
+size 5319000480

model-00022-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2346eca2c879c23ec4370ff1c216b08b6229b423a00242bd3f10952a9cdb7758
+size 5319000536

model-00023-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3a5afe6a902a8411ff1346057574dbe1b759d53e3f966b8d8d0b84d3a47dcbef
+size 5318680248

model-00024-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f76d22fd4324e5b9f03a329cb4463fcecb413112cbd5783a8e20ce6a4479012f
+size 5318680368

model-00025-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5fc3726ff25d0cae69939c2eac3235964702f7b61720f29cdf84553d6390ccd6
+size 5319131528

model-00026-of-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:59771722261f80c4d33e97dfdd1b0b96c32f658c8b00cb7b6f4a13f865e1b563
+size 5319131608