Vision transformers — citation graph of key research

Explore the most influential research on vision transformers as an interactive citation graph on Constellation. The papers below are connected by direct citations and shared references — open any one to center the graph on it and discover related work.

Top papers on vision transformers

  1. PVT v2: Improved baselines with pyramid vision transformer
    Wenhai Wang, Enze Xie, Xiang Li et al. — 2022 · Computational Visual Media · 2,355 citations
  2. Vision Transformers for Single Image Dehazing
    Yuda Song, Zhuqing He, Hui Qian et al. — 2023 · IEEE Transactions on Image Processing · 1,125 citations
  3. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
    Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov et al. — 2020 · arXiv (Cornell University) · 22,023 citations
  4. Vision Transformers for Remote Sensing Image Classification
    Yakoub Bazi, Laila Bashmal, Mohamad Mahmoud Al Rahhal et al. — 2021 · Remote Sensing · 631 citations
  5. ConViT: improving vision transformers with soft convolutional inductive biases*
    Stéphane d’Ascoli, Hugo Touvron, Matthew L. Leavitt et al. — 2022 · Journal of Statistical Mechanics Theory and Experiment · 737 citations
  6. Twins: Revisiting the Design of Spatial Attention in Vision Transformers
    Xiangxiang Chu, Zhi Tian, Yuqing Wang et al. — 2021 · arXiv (Cornell University) · 618 citations
  7. A survey of the vision transformers and their CNN-transformer based variants
    Asifullah Khan, Asifullah Khan, Zunaira Rauf et al. — 2023 · Artificial Intelligence Review · 427 citations
  8. Conditional Positional Encodings for Vision Transformers
    Xiangxiang Chu, Zhi Tian, Bo Zhang et al. — 2021 · arXiv (Cornell University) · 410 citations
  9. ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis
    Onat Dalmaz, Mahmut Yurt, Tolga Çukur — 2022 · IEEE Transactions on Medical Imaging · 579 citations
  10. Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
    Ze Liu, Yutong Lin, Yue Cao et al. — 2021 · arXiv (Cornell University) · 410 citations
  11. Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review
    José Maurício, Inês Domingues, Jorge Bernardino — 2023 · Applied Sciences · 566 citations
  12. MedViT: A robust vision transformer for generalized medical image classification
    Omid Nejati Manzari, Hamid Ahmadabadi, Hossein Kashiani et al. — 2023 · Computers in Biology and Medicine · 490 citations