... | ... | @@ -13,23 +13,6 @@ If you’re interested in more details about the Journal Club, please subscribe |
|
|
|
|
|
## Next Meeting
|
|
|
|
|
|
### 21 September 2020 - Attention Networks
|
|
|
[minutes](minutes Journal Club 21-09-2020)
|
|
|
|
|
|
Virtual meeting: [BigBlueButton](https://webconf.fz-juelich.de/b/wen-mym-pj7)
|
|
|
|
|
|
* Attention Is All You Need
|
|
|
Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, Polosukhin, NIPS 2017
|
|
|
https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf <br>
|
|
|
9 pages
|
|
|
* Self-Attention Generative Adversarial Networks
|
|
|
Zhang, Goodfellow, Metaxas, Odena, ICML 2019
|
|
|
https://arxiv.org/abs/1805.08318<br>
|
|
|
8 pages
|
|
|
|
|
|
|
|
|
## Schedule for upcoming Meetings
|
|
|
|
|
|
### 19 October 2020 Self-Supervised Visual Representation Learning
|
|
|
|
|
|
Venue: if possible f2f INM seminar room, bldg. 15.9, room 4001b
|
... | ... | @@ -45,10 +28,29 @@ http://arxiv.org/abs/1902.06162 <br> |
|
|
21 pages
|
|
|
|
|
|
The first paper presents a state-of-the-art approach for self-supervised learning of strong visual features based on contrastive learning. Random data augmentation is applied to images from the ImageNet dataset and a model is trained to match augmented and original images. The second paper revisits several self-supervised training techniques for visual representation learning and offers a nice overview over different approaches.
|
|
|
|
|
|
|
|
|
## Schedule for upcoming Meetings
|
|
|
|
|
|
tbd
|
|
|
|
|
|
|
|
|
## Past Meetings
|
|
|
|
|
|
### 21 September 2020 - Attention Networks
|
|
|
[minutes](minutes Journal Club 21-09-2020)
|
|
|
|
|
|
Virtual meeting: [BigBlueButton](https://webconf.fz-juelich.de/b/wen-mym-pj7)
|
|
|
|
|
|
* Attention Is All You Need
|
|
|
Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, Polosukhin, NIPS 2017
|
|
|
https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf <br>
|
|
|
9 pages
|
|
|
* Self-Attention Generative Adversarial Networks
|
|
|
Zhang, Goodfellow, Metaxas, Odena, ICML 2019
|
|
|
https://arxiv.org/abs/1805.08318<br>
|
|
|
8 pages
|
|
|
|
|
|
### 17 August 2020 - Canceled
|
|
|
|
|
|
### 20 July 2020 - Summer break
|
... | ... | |