Update JULAIN Journal Club authored by Susanne Wenzel's avatar Susanne Wenzel
......@@ -13,38 +13,35 @@ If you’re interested in more details about the Journal Club, please subscribe
## Next Meeting
### 20 July 2020 - Summer break
### 17 August 2020 - Attention Networks
### 21 September 2020 - Attention Networks
Venue: if possible f2f INM seminar room, bldg. 15.9, room 4001b
alternatively online: https://webconf.fz-juelich.de/b/wen-mym-pj7
* Attention Is All You Need
Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, Polosukhin, NIPS 2017
https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf
https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf <br>
9 pages
* Self-Attention Generative Adversarial Networks
Zhang, Goodfellow, Metaxas, Odena, ICML 2019
https://arxiv.org/abs/1805.08318
https://arxiv.org/abs/1805.08318<br>
8 pages
## Schedule for upcoming Meetings
### 21 September 2020 Self-Supervised Visual Representation Learning
### 19 October 2020 Self-Supervised Visual Representation Learning
Venue: if possible f2f INM seminar room, bldg. 15.9, room 4001b
alternatively online: https://webconf.fz-juelich.de/b/wen-mym-pj7
* A Simple Framework for Contrastive Learning of Visual Representations
T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, 2020
http://arxiv.org/abs/2002.05709
http://arxiv.org/abs/2002.05709 <br>
15 pages, incl appendix
* Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey
L. Jing and Y. Tian, CVPR2019
http://arxiv.org/abs/1902.06162
http://arxiv.org/abs/1902.06162 <br>
21 pages
The first paper presents a state-of-the-art approach for self-supervised learning of strong visual features based on contrastive learning. Random data augmentation is applied to images from the ImageNet dataset and a model is trained to match augmented and original images. The second paper revisits several self-supervised training techniques for visual representation learning and offers a nice overview over different approaches.
......@@ -52,6 +49,10 @@ The first paper presents a state-of-the-art approach for self-supervised learnin
## Past Meetings
### 17 August 2020 - Canceled
### 20 July 2020 - Summer break
### 15 June 2020 - Generative Adversarial Networks (and VAE)
Venue: JSC meetingroom 2, building 16.3; room 315
......
......