aiqbench analysis
This study establishes a rigorous 3D benchmark for medical image-to-image translation, comparing seven generative models across oncological datasets to evaluate their clinical viability. Results indicate that while SRGAN currently leads in quantitative fidelity, all tested architectures face challenges with small lesions and struggle to accurately synthesize tracer uptake values compared to tumor shape. The inclusion of a physician-led Visual Turing test provides critical insight into the perceptual gap between synthetic images and ground truth data, highlighting remaining hurdles for clinical deployment.
Cross Modality Image Translation In Medical Imaging Using Generative Frameworks
arXiv:2605.13686v2 Announce Type: replace-cross Abstract: Magnetic Resonance Imaging (MRI), Computed Tomography (CT), and Positron Emission Tomography (PET) provide complementary information about tissues. Medical image-to-image (I2I) translation enables virtual scanning by synthesizing a target modality from a source one without requiring an additional acquisition. Despite growing interest, many methods operate on 2D slices, are evaluated on isolated tasks under different experimental settings, and lack clinically oriented assessment. This work presents a reproducible benchmark for 3D I2I translation in oncological imaging that compares seven generative models: three Generative Adversarial Networks (Pix2Pix, CycleGAN, and SRGAN) and four latent models (Latent Diffusion Model, Latent Diffusion Model+ControlNet, Brownian Bridge, and Flow Matching). The benchmark comprises 77 experiments across eleven configurations drawn from five datasets, covering three anatomical regions (head/neck, lung, and pelvis) and four translation directions (cone-beam CT to CT, MRI to CT, CT to PET, and T2-weighted MRI to T2-FLAIR). Under the evaluated configurations, SRGAN achieves the highest quantitative image fidelity across all tasks, while latent models perform less well, due to information loss introduced by the variational autoencoder. A tumor-level analysis reveals that all models struggle with small lesions and that, in CT to PET synthesis, models reproduce tumor shape more reliably than tracer uptake values. A Visual Turing test involving 17 physicians, including 15 radiologists, shows near-chance classification accuracy (56.7\%), suggesting that experts struggle to distinguish real from synthetic volumes under the viewing conditions of the study. Expert preferences do not follow quantitative rankings, exposing a dissociation between quantitative metrics and clinical preference.
Authors:Giulia Romoli, Filippo Ruffini, Francesco Di Feola, Alessia Capoccia, Luca Boldrini, Arturo Chiti, Renato Cuocolo, Tugba Akinci D'Antonoli, Fatemeh Darvizeh, Marcello Di Pumpo, Bradley J. Erickson, Liu Fang, Deborah Fazzini, Paola Feraco, Fabrizia Gelardi, Francesco Gossetti, Ana Isabel Hernáiz Ferrer, Michail E. Klontzas, Seyedmehdi Payabvash, Katrine Riklund, Sara N. Strandberg, Valerio Guarrasi, Paolo Soda
Abstract:Magnetic Resonance Imaging (MRI), Computed Tomography (CT), and Positron Emission Tomography (PET) provide complementary information about tissues. Medical image-to-image (I2I) translation enables virtual scanning by synthesizing a target modality from a source one without requiring an additional acquisition. Despite growing interest, many methods operate on 2D slices, are evaluated on isolated tasks under different experimental settings, and lack clinically oriented assessment. This work presents a reproducible benchmark for 3D I2I translation in oncological imaging that compares seven generative models: three Generative Adversarial Networks (Pix2Pix, CycleGAN, and SRGAN) and four latent models (Latent Diffusion Model, Latent Diffusion Model+ControlNet, Brownian Bridge, and Flow Matching). The benchmark comprises 77 experiments across eleven configurations drawn from five datasets, covering three anatomical regions (head/neck, lung, and pelvis) and four translation directions (cone-beam CT to CT, MRI to CT, CT to PET, and T2-weighted MRI to T2-FLAIR). Under the evaluated configurations, SRGAN achieves the highest quantitative image fidelity across all tasks, while latent models perform less well, due to information loss introduced by the variational autoencoder. A tumor-level analysis reveals that all models struggle with small lesions and that, in CT to PET synthesis, models reproduce tumor shape more reliably than tracer uptake values. A Visual Turing test involving 17 physicians, including 15 radiologists, shows near-chance classification accuracy (56.7\%), suggesting that experts struggle to distinguish real from synthetic volumes under the viewing conditions of the study. Expert preferences do not follow quantitative rankings, exposing a dissociation between quantitative metrics and clinical preference.
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
arXiv:2605.13686 [cs.CV]
(or arXiv:2605.13686v2 [cs.CV] for this version)
Full text under the publisher's open licence · 317 words
Related coverage
Synthesize Realistic 3D Medical Images at Scale to Ship Pre‑Trained Models
NVIDIA · May 22, 2026
News
Quantum Computing Report · Jun 7, 2026
Amazon is investing in the Lean Focused Research Organization
Amazon Science · Jul 26, 2026
Hands-free first notice of loss: Using Strands Agents and Amazon Bedrock AgentCore Browser Tool for intelligent claims intake
AWS · Jun 9, 2026