Vision transformers — citation graph of key research

Explore the most influential research on vision transformers as an interactive citation graph on Constellation. The papers below are connected by direct citations and shared references — open any one to center the graph on it and discover related work.

Top papers on vision transformers

  1. PVT v2: Improved baselines with pyramid vision transformer
    Wenhai Wang, Enze Xie, Xiang Li et al. — 2022 · Computational Visual Media · 2,215 citations
  2. Vision Transformers for Single Image Dehazing
    Yuda Song, Zhuqing He, Hui Qian et al. — 2023 · IEEE Transactions on Image Processing · 1,034 citations
  3. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
    Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov et al. — 2020 · arXiv (Cornell University) · 21,701 citations
  4. Vision Transformers for Remote Sensing Image Classification
    Yakoub Bazi, Laila Bashmal, Mohamad Mahmoud Al Rahhal et al. — 2021 · Remote Sensing · 613 citations
  5. Twins: Revisiting the Design of Spatial Attention in Vision Transformers
    Xiangxiang Chu, Zhi Tian, Yuqing Wang et al. — 2021 · arXiv (Cornell University) · 617 citations
  6. ConViT: improving vision transformers with soft convolutional inductive biases*
    Stéphane d’Ascoli, Hugo Touvron, Matthew L. Leavitt et al. — 2022 · Journal of Statistical Mechanics Theory and Experiment · 716 citations
  7. Conditional Positional Encodings for Vision Transformers
    Xiangxiang Chu, Zhi Tian, Bo Zhang et al. — 2021 · arXiv (Cornell University) · 407 citations
  8. A survey of the vision transformers and their CNN-transformer based variants
    Asifullah Khan, Zunaira Rauf, Anabia Sohail et al. — 2023 · Artificial Intelligence Review · 384 citations
  9. ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis
    Onat Dalmaz, Mahmut Yurt, Tolga Çukur — 2022 · IEEE Transactions on Medical Imaging · 548 citations
  10. Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
    Ze Liu, Yutong Lin, Yue Cao et al. — 2021 · arXiv (Cornell University) · 399 citations
  11. Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review
    José Maurício, Inês Domingues, Jorge Bernardino — 2023 · Applied Sciences · 546 citations
  12. DeepViT: Towards Deeper Vision Transformer
    Daquan Zhou, Bingyi Kang, Xiaojie Jin et al. — 2021 · arXiv (Cornell University) · 349 citations