JULAIN-Journal-Club.md

@@ -43,19 +43,34 @@ tbd
 
 ## Next Meeting
 
-### 18 October 2021
+### 15 November 2021
 
 Virtual Meeting using [BigBlueButton](https://webconf.fz-juelich.de/b/wen-mym-pj7)
 
+**Rethinking the Self-Attention in Vision Transformers**."**<br> 
+Kyungmin Kim, Bichen Wu, Xiaoliang Dai, Peizhao Zhang, Zhicheng Yan, Peter Vajda, Seon Joo Kim<br>
+CVPR Workshops series, 2021<br>
+[link](https://openaccess.thecvf.com/content/CVPR2021W/ECV/html/Kim_Rethinking_the_Self-Attention_in_Vision_Transformers_CVPRW_2021_paper.html)
+
+* complementary, **optional** further reading:<br>
+**Synthesizer: Rethinking self-attention for transformer models**<br>
+Tay, Y., Bahri, D., Metzler, D., Juan, D. C., Zhao, Z., & Zheng, C.<br>
+In: International Conference on Machine Learning (pp. 10183-10192). PMLR. ICML 2021<br>
+[link](https://proceedings.mlr.press/v139/tay21a.html)<br>
+[ArXiv](https://arxiv.org/abs/2005.00743)<br>
+ICLR 2021 (tight reject) discussion [here](https://openreview.net/forum?id=H-SPvQtMwm)
+
+
+## Past Meetings
+
+### 18 October 2021
+
 * Physics-informed machine learning: case studies for weather and climate modelling<br>
 Kashinath K., Mustafa M., Albert A., Wu J-L., Jiang C., Esmaeilzadeh S., Azizzadenesheli K., Wang R., Chattopadhyay A., Singh A., Manepalli A., Chirila D., Yu R., Walters R., White B., Xiao H., Tchelepi H. A., Marcus P., Anandkumar A., Hassanzadeh P. and Prabhat; 2021;<br>
 Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences; [http://doi.org/10.1098/rsta.2020.0093](http://doi.org/10.1098/rsta.2020.0093)
 * Karim will give a short intro
 * Karim and Clara will moderate the meeting
 
-
-## Past Meetings
-
 ### 20 September 2021 Few-Shot Learning
 
 * A Closer Look at Few-shot Classification<br>
@@ -343,4 +358,4 @@ A training schedule using filter pruning and orthogonal reinitialization
 
 
 ---
-last change: 12.10.2021 sw
+last change: 2.11.2021 sw
\ No newline at end of file