ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis

Onat Dalmaz, Mahmut Yurt, Tolga Çukur

2022 · IEEE Transactions on Medical Imaging · 548 citations

Generative adversarial models with convolutional neural network (CNN) backbones have recently been established as state-of-the-art in numerous medical image synthesis tasks. However, CNNs are designed to perform local processing with compact filters, and this inductive bias compromises learning of contextual features. Here, we propose a novel generative adversarial approach for medical image synthesis, ResViT, that leverages the contextual sensitivity of vision transformers along with the precision of convolution operators and realism of adversarial learning. ResViT's generator employs a cent…

Read the paper →

Explore this paper's citation graph on Constellation.