Self supervised learning — citation graph of key research

Explore the most influential research on self supervised learning as an interactive citation graph on Constellation. The papers below are connected by direct citations and shared references — open any one to center the graph on it and discover related work.

Top papers on self supervised learning

  1. ALBERT: A Lite BERT for Self-supervised Learning of Language\n Representations
    Zhenzhong Lan, Mingda Chen, Sebastian Goodman et al. — 2019 · arXiv (Cornell University) · 4,072 citations
  2. Bootstrap your own latent: A new approach to self-supervised Learning
    Jean-Bastien Grill, Florian Strub, Florent Altché et al. — 2020 · arXiv (Cornell University) · 3,449 citations
  3. A Survey on Contrastive Self-Supervised Learning
    Ashish Jaiswal — 2020 · MDPI (MDPI AG) · 1,546 citations
  4. ProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning
    Ahmed Elnaggar, Michael Heinzinger, Christian Dallago et al. — 2021 · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2,334 citations
  5. Self-supervised Learning: Generative or Contrastive
    Xiao Liu, Fanjin Zhang, Zhenyu Hou et al. — 2021 · IEEE Transactions on Knowledge and Data Engineering · 1,031 citations
  6. Self-supervised learning in medicine and healthcare
    Rayan Krishnan, Pranav Rajpurkar, Eric J. Topol — 2022 · Nature Biomedical Engineering · 590 citations
  7. ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
    Zhenzhong Lan, Mingda Chen, Sebastian Goodman et al. — 2019 · arXiv (Cornell University) · 984 citations
  8. Barlow Twins: Self-Supervised Learning via Redundancy Reduction
    Jure Žbontar, Jing Li, Ishan Misra et al. — 2021 · arXiv (Cornell University) · 779 citations
  9. Graph Self-Supervised Learning: A Survey
    Yixin Liu, Ming Jin, Shirui Pan et al. — 2022 · IEEE Transactions on Knowledge and Data Engineering · 499 citations
  10. Self-supervised learning for medical image analysis using image context restoration
    Liang Chen, Paul Bentley, Kensaku Mori et al. — 2019 · Medical Image Analysis · 587 citations
  11. Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
    Longlong Jing, Yingli Tian — 2020 · IEEE Transactions on Pattern Analysis and Machine Intelligence · 1,950 citations
  12. A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
    Jie Gui, Tuo Chen, Jing Zhang et al. — 2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence · 451 citations