... | @@ -43,19 +43,34 @@ tbd |
... | @@ -43,19 +43,34 @@ tbd |
|
|
|
|
|
## Next Meeting
|
|
## Next Meeting
|
|
|
|
|
|
### 18 October 2021
|
|
### 15 November 2021
|
|
|
|
|
|
Virtual Meeting using [BigBlueButton](https://webconf.fz-juelich.de/b/wen-mym-pj7)
|
|
Virtual Meeting using [BigBlueButton](https://webconf.fz-juelich.de/b/wen-mym-pj7)
|
|
|
|
|
|
|
|
**Rethinking the Self-Attention in Vision Transformers**."**<br>
|
|
|
|
Kyungmin Kim, Bichen Wu, Xiaoliang Dai, Peizhao Zhang, Zhicheng Yan, Peter Vajda, Seon Joo Kim<br>
|
|
|
|
CVPR Workshops series, 2021<br>
|
|
|
|
[link](https://openaccess.thecvf.com/content/CVPR2021W/ECV/html/Kim_Rethinking_the_Self-Attention_in_Vision_Transformers_CVPRW_2021_paper.html)
|
|
|
|
|
|
|
|
* complementary, **optional** further reading:<br>
|
|
|
|
**Synthesizer: Rethinking self-attention for transformer models**<br>
|
|
|
|
Tay, Y., Bahri, D., Metzler, D., Juan, D. C., Zhao, Z., & Zheng, C.<br>
|
|
|
|
In: International Conference on Machine Learning (pp. 10183-10192). PMLR. ICML 2021<br>
|
|
|
|
[link](https://proceedings.mlr.press/v139/tay21a.html)<br>
|
|
|
|
[ArXiv](https://arxiv.org/abs/2005.00743)<br>
|
|
|
|
ICLR 2021 (tight reject) discussion [here](https://openreview.net/forum?id=H-SPvQtMwm)
|
|
|
|
|
|
|
|
|
|
|
|
## Past Meetings
|
|
|
|
|
|
|
|
### 18 October 2021
|
|
|
|
|
|
* Physics-informed machine learning: case studies for weather and climate modelling<br>
|
|
* Physics-informed machine learning: case studies for weather and climate modelling<br>
|
|
Kashinath K., Mustafa M., Albert A., Wu J-L., Jiang C., Esmaeilzadeh S., Azizzadenesheli K., Wang R., Chattopadhyay A., Singh A., Manepalli A., Chirila D., Yu R., Walters R., White B., Xiao H., Tchelepi H. A., Marcus P., Anandkumar A., Hassanzadeh P. and Prabhat; 2021;<br>
|
|
Kashinath K., Mustafa M., Albert A., Wu J-L., Jiang C., Esmaeilzadeh S., Azizzadenesheli K., Wang R., Chattopadhyay A., Singh A., Manepalli A., Chirila D., Yu R., Walters R., White B., Xiao H., Tchelepi H. A., Marcus P., Anandkumar A., Hassanzadeh P. and Prabhat; 2021;<br>
|
|
Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences; [http://doi.org/10.1098/rsta.2020.0093](http://doi.org/10.1098/rsta.2020.0093)
|
|
Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences; [http://doi.org/10.1098/rsta.2020.0093](http://doi.org/10.1098/rsta.2020.0093)
|
|
* Karim will give a short intro
|
|
* Karim will give a short intro
|
|
* Karim and Clara will moderate the meeting
|
|
* Karim and Clara will moderate the meeting
|
|
|
|
|
|
|
|
|
|
## Past Meetings
|
|
|
|
|
|
|
|
### 20 September 2021 Few-Shot Learning
|
|
### 20 September 2021 Few-Shot Learning
|
|
|
|
|
|
* A Closer Look at Few-shot Classification<br>
|
|
* A Closer Look at Few-shot Classification<br>
|
... | @@ -343,4 +358,4 @@ A training schedule using filter pruning and orthogonal reinitialization |
... | @@ -343,4 +358,4 @@ A training schedule using filter pruning and orthogonal reinitialization |
|
|
|
|
|
|
|
|
|
---
|
|
---
|
|
last change: 12.10.2021 sw |
|
last change: 2.11.2021 sw |
|
\ No newline at end of file |
|
\ No newline at end of file |