Papers
arxiv:2607.21694

Oxygen-TryOn: Fashion-Native Foundation Model for Any-item Virtual Try-On

Published on Jul 23
ยท Submitted by
YongLiu
on Jul 28
ยท JD-company JD.com
Authors:
,
,
,
,
,
,

Abstract

We present Oxygen-TryOn, a unified foundation model for any-item virtual try-on. Rather than repurposing a general-purpose image editor, Oxygen-TryOn is fashion-native, built for try-on through a dedicated data engine and try-on-specific training. Given one or more reference items (clean product shots or in-the-wild worn-on photos) and a single target subject image, it synthesizes a photorealistic image of the subject wearing the items across virtually any fashion category. Prior systems handle a single garment category in a studio setting, and recent multi-reference methods remain garment-centric; in contrast, Oxygen-TryOn supports diverse items and scenarios, including full- and half-body views, a variable number of references, and free multi-item composition, while faithfully preserving both subject identity and item appearance. Instead of mask-based inpainting, we reformulate try-on as a multi-reference, understanding-driven generation task. We build a data engine that collects, manufactures, annotates, and filters high-quality try-on data at scale, and design a three-stage recipe of continued pre-training (CPT), supervised fine-tuning (SFT), and reinforcement learning (RL). The RL stage uses a hybrid reward combining an in-house try-on reward model with a proprietary, rubric-guided general-purpose model, jointly supervising fine-grained consistency and instruction-level quality. It also follows general editing instructions (e.g., pose changes) in the same pass. Across public benchmarks and our in-house Oxygen-TryOn Bench, it achieves state-of-the-art consistency and realism on single-item try-on and leads on multi-item try-on, matching or surpassing both leading proprietary systems (Nano Banana Pro, GPT-Image-2, Seedream5 Lite) and open-source models (FLUX.2).

Community

Paper author Paper submitter
โ€ข
edited 2 days ago

๐Ÿ” Overview

Oxygen-TryOn is a unified, open-source foundation model for any-item virtual try-on. Given one or more reference items โ€” provided either as clean product shots or as in-the-wild photos of someone already wearing them โ€” together with a single target subject image, the model synthesizes a photorealistic image of that subject wearing the referenced items, spanning virtually any fashion category: clothing, outerwear, accessories, footwear, bags, and beyond.

Unlike general-purpose image editors merely prompted for the task, Oxygen-TryOn is fashion-native: instead of treating try-on as mask-based inpainting, it reformulates it as a multi-reference, understanding-driven generation task, and is built specifically for try-on through a dedicated data engine and try-on-specific training. It accepts a variable number of references, composes multiple items in a single generation pass, and reasons holistically about layering and occlusion across full-body and half-body views, diverse poses, and non-standard subjects.

Under the hood, Oxygen-TryOn is built on the JoyAI-Image-Edit architecture and initialized from its pretrained weights, coupling a multimodal large language model (MLLM) for reference and instruction understanding with a multimodal diffusion transformer (MMDiT) for high-fidelity synthesis. It is trained with a three-stage recipe โ€” continued pre-training (CPT), large-scale supervised fine-tuning (SFT), and reinforcement learning (RL) under a hybrid reward โ€” and retains the general instruction-based editing ability of its foundation (e.g., pose change) within the same generation pass.

To our knowledge, Oxygen-TryOn is the first open-source system to deliver any-item, multi-reference try-on at this level of fidelity, achieving state-of-the-art consistency and realism that surpasses strong proprietary systems such as Nano Banana Pro, GPT-Image-2, and Seedream5 Lite, as well as leading open-source models such as FLUX.2.

โœจ Key Features

  • ๐Ÿงฅ Any item, any combination โ€” garments, outerwear, accessories, shoes, bags, and more; from a single item to free multi-item outfits, with the model resolving layering and occlusion ("OOTD"-style full-outfit composition).
  • ๐Ÿ–ผ๏ธ Heterogeneous references โ€” accepts both clean product shots and in-the-wild worn-on photos; full- or half-body subjects with a variable number of references.
  • ๐Ÿง Faithful preservation โ€” keeps both the subject's identity and the referenced items' appearance intact.
  • โœ๏ธ Built-in editing โ€” general instruction-based edits (e.g., pose change) within the same generation pass, with no second model or pass.
  • ๐ŸŽญ Cross-domain generalization โ€” even dresses stylized 3D avatars, illustrated characters, statues, or posters while respecting the original style and geometry.
  • ๐Ÿ† State-of-the-art single-item consistency & realism, surpassing strong proprietary systems (Nano Banana Pro, GPT-Image-2, Seedream5 Lite) and leading open-source models (FLUX.2).

Great work! Will the model or future distilled models be open-sourced?

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2607.21694
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2607.21694 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2607.21694 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2607.21694 in a Space README.md to link it from this page.

Collections including this paper 2