| ... | ... | @@ -13,38 +13,35 @@ If you’re interested in more details about the Journal Club, please subscribe |
|
|
|
|
|
|
|
## Next Meeting
|
|
|
|
|
|
|
|
### 20 July 2020 - Summer break
|
|
|
|
|
|
|
|
### 17 August 2020 - Attention Networks
|
|
|
|
### 21 September 2020 - Attention Networks
|
|
|
|
|
|
|
|
Venue: if possible f2f INM seminar room, bldg. 15.9, room 4001b
|
|
|
|
alternatively online: https://webconf.fz-juelich.de/b/wen-mym-pj7
|
|
|
|
|
|
|
|
* Attention Is All You Need
|
|
|
|
Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, Polosukhin, NIPS 2017
|
|
|
|
https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf
|
|
|
|
https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf <br>
|
|
|
|
9 pages
|
|
|
|
* Self-Attention Generative Adversarial Networks
|
|
|
|
Zhang, Goodfellow, Metaxas, Odena, ICML 2019
|
|
|
|
https://arxiv.org/abs/1805.08318
|
|
|
|
https://arxiv.org/abs/1805.08318<br>
|
|
|
|
8 pages
|
|
|
|
|
|
|
|
|
|
|
|
## Schedule for upcoming Meetings
|
|
|
|
|
|
|
|
|
|
|
|
### 21 September 2020 Self-Supervised Visual Representation Learning
|
|
|
|
### 19 October 2020 Self-Supervised Visual Representation Learning
|
|
|
|
|
|
|
|
Venue: if possible f2f INM seminar room, bldg. 15.9, room 4001b
|
|
|
|
alternatively online: https://webconf.fz-juelich.de/b/wen-mym-pj7
|
|
|
|
|
|
|
|
* A Simple Framework for Contrastive Learning of Visual Representations
|
|
|
|
T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, 2020
|
|
|
|
http://arxiv.org/abs/2002.05709
|
|
|
|
http://arxiv.org/abs/2002.05709 <br>
|
|
|
|
15 pages, incl appendix
|
|
|
|
* Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey
|
|
|
|
L. Jing and Y. Tian, CVPR2019
|
|
|
|
http://arxiv.org/abs/1902.06162
|
|
|
|
http://arxiv.org/abs/1902.06162 <br>
|
|
|
|
21 pages
|
|
|
|
|
|
|
|
The first paper presents a state-of-the-art approach for self-supervised learning of strong visual features based on contrastive learning. Random data augmentation is applied to images from the ImageNet dataset and a model is trained to match augmented and original images. The second paper revisits several self-supervised training techniques for visual representation learning and offers a nice overview over different approaches.
|
| ... | ... | @@ -52,6 +49,10 @@ The first paper presents a state-of-the-art approach for self-supervised learnin |
|
|
|
|
|
|
|
## Past Meetings
|
|
|
|
|
|
|
|
### 17 August 2020 - Canceled
|
|
|
|
|
|
|
|
### 20 July 2020 - Summer break
|
|
|
|
|
|
|
|
### 15 June 2020 - Generative Adversarial Networks (and VAE)
|
|
|
|
|
|
|
|
Venue: JSC meetingroom 2, building 16.3; room 315
|
| ... | ... | |
