Instructions to use hcarrion/glomangioma with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use hcarrion/glomangioma with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("fill-in-base-model", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("hcarrion/glomangioma") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Add model card, metadata, and links to paper and repository (#1)
Browse files- Add model card, metadata, and links to paper and repository (47b9e071fd7bad11b73738f83a39718e4a81861b)
Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>
README.md
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
library_name: diffusers
|
| 4 |
+
pipeline_tag: text-to-image
|
| 5 |
+
tags:
|
| 6 |
+
- medical
|
| 7 |
+
- lora
|
| 8 |
+
- dermatology
|
| 9 |
+
- textual-inversion
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# cgDDI: Controllable Generation of Diverse Dermatological Imagery
|
| 13 |
+
|
| 14 |
+
This repository contains a disease-conditioned LoRA checkpoint from **cgDDI** (**C**ontrollable **G**eneration of **D**iverse **D**ermatological **I**magery), a hybrid framework designed for fair and efficient malignancy classification.
|
| 15 |
+
|
| 16 |
+
For more details, please refer to the paper: [Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification](https://huggingface.co/papers/2607.12987).
|
| 17 |
+
|
| 18 |
+
## Resources
|
| 19 |
+
- **Repository:** [GitHub - ControllableGenDDI](https://github.com/hectorcarrion/ControllableGenDDI)
|
| 20 |
+
- **Dataset:** [🤗 hcarrion/ControllableGenDDI Dataset](https://huggingface.co/datasets/hcarrion/ControllableGenDDI)
|
| 21 |
+
|
| 22 |
+
## Method Description
|
| 23 |
+
|
| 24 |
+
cgDDI is a hybrid framework designed to address the systematic lack of expertly annotated images in dermatology, especially for underrepresented skin tones and rare diseases. It operates by:
|
| 25 |
+
1. Synthesizing realistic healthy skin samples without disturbing other input properties.
|
| 26 |
+
2. Mapping single-sample rare lesions onto novel skin-tones and locations non-parametrically.
|
| 27 |
+
3. Allowing for efficient parametric generation with as few as 10 training samples via Textual Inversion and LoRA adapters.
|
| 28 |
+
|
| 29 |
+
For more details on the training and generation pipeline, please refer to the official GitHub repository.
|
| 30 |
+
|
| 31 |
+
## Citation
|
| 32 |
+
|
| 33 |
+
```bibtex
|
| 34 |
+
@inproceedings{carrion2026cgddi,
|
| 35 |
+
title = {Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification},
|
| 36 |
+
author = {Carri{\'o}n, H{\'e}ctor and Norouzi, Narges},
|
| 37 |
+
booktitle = {Medical Image Computing and Computer-Assisted Intervention (MICCAI)},
|
| 38 |
+
year = {2026},
|
| 39 |
+
publisher = {Springer},
|
| 40 |
+
series = {Lecture Notes in Computer Science}
|
| 41 |
+
}
|
| 42 |
+
```
|