Self supervised learning — citation graph of key research

Explore the most influential research on self supervised learning as an interactive citation graph on Constellation. The papers below are connected by direct citations and shared references — open any one to center the graph on it and discover related work.

Top papers on self supervised learning

  1. ALBERT: A Lite BERT for Self-supervised Learning of Language\n Representations
    Zhenzhong Lan, Mingda Chen, Sebastian Goodman et al. — 2019 · arXiv (Cornell University) · 4,064 citations
  2. Bootstrap your own latent: A new approach to self-supervised Learning
    Jean-Bastien Grill, Florian Strub, Florent Altché et al. — 2020 · arXiv (Cornell University) · 3,442 citations
  3. A Survey on Contrastive Self-Supervised Learning
    Ashish Jaiswal — 2020 · MDPI (MDPI AG) · 1,515 citations
  4. ProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning
    Ahmed Elnaggar, Michael Heinzinger, Christian Dallago et al. — 2021 · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2,230 citations
  5. Self-supervised Learning: Generative or Contrastive
    Xiao Liu, Fanjin Zhang, Zhenyu Hou et al. — 2021 · IEEE Transactions on Knowledge and Data Engineering · 1,011 citations
  6. Self-supervised learning in medicine and healthcare
    Rayan Krishnan, Pranav Rajpurkar, Eric J. Topol — 2022 · Nature Biomedical Engineering · 577 citations
  7. CutPaste: Self-Supervised Learning for Anomaly Detection and Localization
    Chunliang Li, Kihyuk Sohn, Jinsung Yoon et al. — 2021 · 888 citations
  8. Barlow Twins: Self-Supervised Learning via Redundancy Reduction
    Jure Žbontar, Jing Li, Ishan Misra et al. — 2021 · arXiv (Cornell University) · 778 citations
  9. ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
    Zhenzhong Lan, Mingda Chen, Sebastian Goodman et al. — 2019 · arXiv (Cornell University) · 984 citations
  10. Graph Self-Supervised Learning: A Survey
    Yixin Liu, Ming Jin, Shirui Pan et al. — 2022 · IEEE Transactions on Knowledge and Data Engineering · 492 citations
  11. Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
    Lerrel Pinto, Abhinav Gupta — 2016 · 1,097 citations
  12. Masked Autoencoders for Point Cloud Self-supervised Learning
    Yatian Pang, Wenxiao Wang, Francis E. H. Tay et al. — 2022 · Lecture notes in computer science · 494 citations