ControlEdit: A MultiModal Local Clothing Image Editing Method


Di Cheng (Beijing Institute of Fashion Technology), Yingjie Shi (Beijing Institute of Fashion Technology), sun shixin (Beijing Institute Of Fashion Technology), JiaFu Zhang (Beijing Institute of Fashion Technology), weijing wang (Beijing Institution of Fashion Technology), YULiu (Beijing Institute Of Fashion Technology)
The 35th British Machine Vision Conference
PDFSupplementary

Abstract

$$Multimodal clothing image editing refers to the precise adjustment and modification of clothing images using data such as textual descriptions and visual images as control conditions, which effectively improves the work efficiency of designers and reduces the threshold for user design. In this paper, we propose a new image editing method-ControlEdit, which transfers clothing image editing to multimodal- guided local inpainting of clothing images. We address the difficulty of collecting real image datasets by leveraging the self-supervised learning approach. Based on this learning approach, we extend the channels of the feature extraction network to ensure consistent clothing image style before and after editing, and we design an inverse latent loss function to achieve soft control over the content of non-edited areas. In addition, we use Blended Latent Diffusion as the sampling method to make the editing boundaries transition naturally and enforce consistency of non-edited area content. Extensive experiments demonstrate that ControlEdit surpasses baseline algorithms in both qualitative and quantitative evaluations.$$

Citation

@inproceedings{Cheng_2024_BMVC,
author    = {Di Cheng and Yingjie Shi and sun shixin and JiaFu Zhang and weijing wang and YULiu},
title     = {ControlEdit: A MultiModal Local Clothing Image Editing Method},
booktitle = {35th British Machine Vision Conference 2024, {BMVC} 2024, Glasgow, UK, November 25-28, 2024},
publisher = {BMVA},
year      = {2024},
url       = {https://papers.bmvc2024.org/0723.pdf}
}


Copyright © 2024 The British Machine Vision Association and Society for Pattern Recognition
The British Machine Vision Conference is organised by The British Machine Vision Association and Society for Pattern Recognition. The Association is a Company limited by guarantee, No.2543446, and a non-profit-making body, registered in England and Wales as Charity No.1002307 (Registered Office: Dept. of Computer Science, Durham University, South Road, Durham, DH1 3LE, UK).

Imprint | Data Protection