Weak Segmentation-Guided GAN for~Realistic Color Edition

Abstract:Editing the color of images in a realistic way finds many applications such as changing the perception of an image, data augmentation or film post processing. The design of an automatic tool is a complex and long addressed challenge. In particular, two properties are difficult to meet altogether: generating realistic results without artifacts and the possibility to precisely choose the future color. Conventional methods using segmentation and histogram matching maximize the controllability but also introduce a lack of realism or are complex to automate. On the contrary, GANs that specialize in realism are difficult to control. To overcome these challenges, we propose a novel GAN architecture leveraging any differentiable segmentation model. We demonstrate the genericness of our framework that presents state of the art results on different use cases. It generates images that look realistic while offering a precise color control.

Artificial Intelligence (cs.AI)

arXiv:2610.16620 [cs.AI]

(or arXiv:2610.16620v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2610.16620 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

Image Analysis and Processing -- ICIAP 2023, 14233, Springer Nature Switzerland, pp.487-499, 2023, Lecture Notes in Computer Science

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.