Changes

Page history
Update Tips and Tricks authored by Susanne Wenzel's avatar Susanne Wenzel
Show whitespace changes
Inline Side-by-side
Tips-and-Tricks.md
View page @ 5c9f2b40
......@@ -30,8 +30,8 @@ https://www.fast.ai/2018/08/10/fastai-diu-imagenet/<br>
# How to implement multiple nodes computing using horovod (19.3.2021)
* @ebert1: https://github.com/horovod/horovod#supported-frameworks
* @jitsev1: Have a look on our workshop's tutorials, especially Day 2 Tutorial 2 that gives intro into "Horovodifying" single node code for multi node execution: https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_public/sharedspace/teaching/intro[…]course-material/-/tree/master/tutorials/day2/tutorial2
* In general, our "Intro into Scalable Deep Learning Course" is a good way to start (Horovod things come from Day 2 on) https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_public/sharedspace/teaching/intro_scalable_dl_2021/course-material/<br>
* @jitsev1: Have a look on our workshop's tutorials, especially [Day 2 Tutorial 2](https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_public/sharedspace/teaching/intro_scalable_dl_2021/course-material/-/tree/master/tutorials/day2/tutorial2) that gives intro into "Horovodifying" single node code for multi node execution
* In general, our [Intro into Scalable Deep Learning Course](https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_public/sharedspace/teaching/intro_scalable_dl_2021/course-material/-/tree/master/tutorials/day2/tutorial2) is a good way to start (Horovod things come from Day 2 on) <br>
There are also code examples there how to run training on our HPC machines with Horovod on multiple nodes
......
......