Part-3 Contd. Quick overview of different self-supervised learning approaches.

Опубликовано: 21 Октябрь 2024
на канале: Anuj shah

2,971

This is the continuation of - • Part-3 Quick overview of different se...

This is the 3rd part where a quick overview of different self supervised learning are touched upon.
They can be categorized into
Pretext task based
Generative model based
contrastive learning (discriminative based)

References -
1. ICML workshop on Representation Learning - https://icml.cc/Conferences/2020/Sche...

2. Paperswithcode - https://paperswithcode.com/sota/self-...

3.Alexei (Alyosha) Efros - Self-Supervised Deep Learning - https://www.youtube.com/watch?v=YhYsv...

4.Professor Zisserman lecture slides - https://project.inria.fr/paiss/files/...

5.Lilan weng amazing introductory blog - https://lilianweng.github.io/lil-log/...

6. Blog on SimCLR, MoCo and BYOL Comparison - https://untitled-ai.github.io/underst...

7. Blog on SwAV - https://wandb.ai/authors/swav-tf/repo...

8. Energy based models - https://bdtechtalks.com/2020/03/23/ya...

9.Colorization - https://richzhang.github.io/ideepcolor/

10. Neural Scene Representation Blog - https://deepmind.com/blog/article/neu...

11. Contrastive Learning Blog-https://ai.googleblog.com/2020/04/adv...

Papers
1. MoCo - https://arxiv.org/pdf/1911.05722.pdf
2. SimCLR - https://arxiv.org/pdf/2002.05709.pdf
3. SimCLR v2 - https://arxiv.org/abs/2006.10029
4. SwAV - https://arxiv.org/pdf/2006.09882.pdf