Leo PRO

leideng

·

https://leideng.github.io/

AI & ML interests

Efficient AI, Sparse Attention

Recent Activity

liked a model 8 days ago

ai21labs/AI21-Jamba-Mini-1.7

published a dataset 12 days ago

updated a bucket 12 days ago

leideng/KVPacket

View all activity

Organizations

None yet

upvoted a paper 12 days ago

KV Packet: Recomputation-Free Context-Independent KV Caching for LLMs

Paper • 2604.13226 • Published Apr 14 • 11

upvoted a paper 21 days ago

Generative Recursive Reasoning

Paper • 2605.19376 • Published May 20 • 31

upvoted 2 articles 27 days ago

Article

Unlocking Agentic RL Training for GPT-OSS: A Practical Retrospective

LinkedIn

•

Jan 27

• 80

Article

Nanochat-Ascend: Training Karpathy's Nanochat on Ascend NPU (Part 1)

leideng

•

28 days ago

• 1

upvoted a paper 27 days ago

On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification

Paper • 2508.05629 • Published Aug 7, 2025 • 190

upvoted an article about 1 month ago

Article

TRL v1.0: Post-Training Library Built to Move with the Field

+2

qgallouedec, stevhliu, pcuenq, sergiopaniego

•

Mar 31

• 58

upvoted a collection about 2 months ago

Open Coding Agents

13 items • Updated Mar 5 • 54

upvoted an article 3 months ago

Article

Fine-Tuning Your First Large Language Model (LLM) with PyTorch and Hugging Face

dvgodoy

•

Feb 11, 2025

• 125

upvoted 2 collections 3 months ago

Gemma 4

15 items • Updated 24 days ago • 1.01k

Transformers.js V4 demos

A collection of demos built with Transformers.js V4 • 24 items • Updated Apr 16 • 67

upvoted 2 papers 3 months ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

Paper • 2506.20920 • Published Jun 26, 2025 • 79

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25, 2024 • 105

upvoted 2 collections 3 months ago

Qwen3.5

21 items • Updated Mar 9 • 1.71k

Olmo Hybrid

6 items • Updated Mar 5 • 28

upvoted a collection 5 months ago

NVIDIA Nemotron v3

Open, Production-ready Enterprise Models • 23 items • Updated 23 days ago • 333

upvoted an article 5 months ago

Article

~Don't~ Repeat Yourself

patrickvonplaten

•

Apr 5, 2022

• 55

upvoted a collection over 1 year ago

SmolLM2

State-of-the-art compact LLMs for on-device applications: 1.7B, 360M, 135M • 16 items • Updated May 5, 2025 • 309