Skip to content
aiqbench takeAI Research

aiqbench analysis

This paper introduces CART, a novel framework that dynamically allocates computational resources and task-specific expertise to handle multiple co-occurring image degradations simultaneously. By routing patches based on local restoration difficulty and conditioning on global task features, it overcomes the limitations of uniform computation in existing all-in-one methods. The approach achieves state-of-the-art results on composite degradation benchmarks, marking a significant step forward in efficient computer vision models.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Learning Where and What to Restore for Composite Image Restoration

arXiv2 min read

arXiv:2503.17915v2 Announce Type: replace-cross Abstract: Real-world degraded images often contain multiple co-occurring degradation types, making composite image restoration fundamentally different from the single-degradation setting assumed by most existing all-in-one methods. These methods typically apply uniform spatial computation and single-label task conditioning, limiting both spatial adaptivity and explicit modeling of degradation mixtures. We propose CART (Composite-Adaptive Routing and Task Conditioning), a unified framework that jointly decides where to spend computation and what degradation cues should guide restoration: a spatial mixer routes patches to graded-capacity experts by local restoration difficulty, and a channel mixer routes each image through degradation-specific experts, conditioned on the global task feature with multi-hot classification supervision. Empirically, CART achieves state-of-the-art performance for composite degradation restoration on CDD-11 and delivers the best results to date on the conventional 3-task and 5-task all-in-one benchmarks.

Abstract:Real-world degraded images often contain multiple co-occurring degradation types, making composite image restoration fundamentally different from the single-degradation setting assumed by most existing all-in-one methods. These methods typically apply uniform spatial computation and single-label task conditioning, limiting both spatial adaptivity and explicit modeling of degradation mixtures. We propose CART (Composite-Adaptive Routing and Task Conditioning), a unified framework that jointly decides where to spend computation and what degradation cues should guide restoration: a spatial mixer routes patches to graded-capacity experts by local restoration difficulty, and a channel mixer routes each image through degradation-specific experts, conditioned on the global task feature with multi-hot classification supervision. Empirically, CART achieves state-of-the-art performance for composite degradation restoration on CDD-11 and delivers the best results to date on the conventional 3-task and 5-task all-in-one benchmarks.

Accepted to NeurIPS 2026. 16 pages, 7 figures, 4 tables. v2: substantially revised camera-ready version; title changed from "Cat-AIR: Content and Task-Aware All-in-One Image Restoration"; method renamed from Cat-AIR to CART and extended to composite degradations

Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

arXiv:2503.17915 [eess.IV]

(or arXiv:2503.17915v2 [eess.IV] for this version)

Full text under the publisher's open licence · 190 words

Related coverage