Update JULAIN Journal Club authored by Susanne Wenzel's avatar Susanne Wenzel
...@@ -13,25 +13,6 @@ If you’re interested in more details about the Journal Club, please subscribe ...@@ -13,25 +13,6 @@ If you’re interested in more details about the Journal Club, please subscribe
## Next Meeting ## Next Meeting
### Monday 18 May 10-11:30am Variational Autoencoders
Venue: if possible f2f JSC meetingroom 2, building 16.3; room 315 <br>
alternatively online: https://webconf.fz-juelich.de/b/wen-mym-pj7
* Original VAE paper<br>
Auto-Encoding Variational Bayes<br>
Diederik P Kingma, Max Welling, ICLR 2014<br>
https://arxiv.org/abs/1312.6114 <br>
https://openreview.net/forum?id=33X9fd2-9FyZd <br>
14 pages, incl appendix
* Recent VAE review / tutorial<br>
An Introduction to Variational Autoencoders<br>
Diederik P. Kingma, Max Welling (2019) Foundations and Trends in Machine Learning. 12. 307-392. 10.1561/2200000056. <br>
https://arxiv.org/abs/1906.02691<br>
86 pages <br>
## Schedule for upcoming Meetings
### 15 June 2020 - Generative Adversarial Networks (and VAE) ### 15 June 2020 - Generative Adversarial Networks (and VAE)
Venue: JSC meetingroom 2, building 16.3; room 315 <br> Venue: JSC meetingroom 2, building 16.3; room 315 <br>
...@@ -50,6 +31,9 @@ https://arxiv.org/abs/1706.00550 <br> ...@@ -50,6 +31,9 @@ https://arxiv.org/abs/1706.00550 <br>
https://openreview.net/forum?id=rylSzl-R- <br> https://openreview.net/forum?id=rylSzl-R- <br>
16 pages, incl appendix 16 pages, incl appendix
## Schedule for upcoming Meetings
### 20 July 2020 - Summer break ### 20 July 2020 - Summer break
### 17 August 2020 - Attention Networks ### 17 August 2020 - Attention Networks
...@@ -75,16 +59,35 @@ alternatively online: https://webconf.fz-juelich.de/b/wen-mym-pj7 ...@@ -75,16 +59,35 @@ alternatively online: https://webconf.fz-juelich.de/b/wen-mym-pj7
* A Simple Framework for Contrastive Learning of Visual Representations <br> * A Simple Framework for Contrastive Learning of Visual Representations <br>
T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, 2020<br> T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, 2020<br>
http://arxiv.org/abs/2002.05709 http://arxiv.org/abs/2002.05709<br>
15 pages, incl appendix
* Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey <br> * Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey <br>
L. Jing and Y. Tian, CVPR2019<br> L. Jing and Y. Tian, CVPR2019<br>
http://arxiv.org/abs/1902.06162 http://arxiv.org/abs/1902.06162<br>
21 pages
The first paper presents a state-of-the-art approach for self-supervised learning of strong visual features based on contrastive learning. Random data augmentation is applied to images from the ImageNet dataset and a model is trained to match augmented and original images. The second paper revisits several self-supervised training techniques for visual representation learning and offers a nice overview over different approaches. The first paper presents a state-of-the-art approach for self-supervised learning of strong visual features based on contrastive learning. Random data augmentation is applied to images from the ImageNet dataset and a model is trained to match augmented and original images. The second paper revisits several self-supervised training techniques for visual representation learning and offers a nice overview over different approaches.
## Past Meetings ## Past Meetings
### Monday 18 May 10-11:30am Variational Autoencoders
Venue: if possible f2f JSC meetingroom 2, building 16.3; room 315 <br>
alternatively online: https://webconf.fz-juelich.de/b/wen-mym-pj7
* Original VAE paper<br>
Auto-Encoding Variational Bayes<br>
Diederik P Kingma, Max Welling, ICLR 2014<br>
https://arxiv.org/abs/1312.6114 <br>
https://openreview.net/forum?id=33X9fd2-9FyZd <br>
14 pages, incl appendix
* Recent VAE review / tutorial<br>
An Introduction to Variational Autoencoders<br>
Diederik P. Kingma, Max Welling (2019) Foundations and Trends in Machine Learning. 12. 307-392. 10.1561/2200000056. <br>
https://arxiv.org/abs/1906.02691<br>
86 pages <br>
### Monday 20 April - Learning discrete representations from data ### Monday 20 April - Learning discrete representations from data
* A. van den Oord, O. Vinyals, K. Kavukcuoglu, Neural Discrete Representation Learning, NeurIPS 2017<br> * A. van den Oord, O. Vinyals, K. Kavukcuoglu, Neural Discrete Representation Learning, NeurIPS 2017<br>
...@@ -155,4 +158,4 @@ A training schedule using filter pruning and orthogonal reinitialization ...@@ -155,4 +158,4 @@ A training schedule using filter pruning and orthogonal reinitialization
--- ---
last change: 24.4.2020 sw last change: 18.5.2020 sw
\ No newline at end of file \ No newline at end of file