CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art

Abstract:Text-to-Image (T2I) diffusion models have made rapid progress on semantic alignment (generating what is described in the prompt), yet users still lack reliable control over aesthetic composition (how visual elements are put together). Prior work often treats aesthetics as a single, preference-driven notion (e.g., "high quality", "detailed", "breathtaking"), which does not map cleanly to compositional intent. We propose Aesthetic Alignment: aligning generated images to explicit, user-specified compositional constraints. We operationalize these constraints using the Principles of Art (PoA)-e.g., Balance, Rhythm, and Emphasis-commonly used in art education to describe composition. To support this task, we introduce CompArt, a dataset of 80,032 WikiArt images augmented with captions and PoA analyses produced by a multimodal LLM under structured prompting. We further propose ArtDapter, a lightweight and disentangled adapter that enables steering a pretrained T2I model along 10 PoA dimensions while retaining the base model's semantic capability. Experiments on CompArt show improved adherence to PoA controls over strong baselines under a dual evaluation protocol.

Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

I.3.3; H.3.3; I.2.10; J.5

arXiv:2503.12018 [cs.CV]

(or arXiv:2503.12018v2 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2503.12018 Focus to learn more arXiv-issued DOI via DataCite

Proceedings of the 2026 International Conference on Multimedia Retrieval (ICMR '26), pp. 2200-2209, Association for Computing Machinery (ACM), 2026

https://doi.org/10.1145/3805622.3810794 Focus to learn more DOI(s) linking to related resources

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.