* @jitsev1: Have a look on our workshop's tutorials, especially [Day 2 Tutorial 2](https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_public/sharedspace/teaching/intro_scalable_dl_2021/course-material/-/tree/master/tutorials/day2/tutorial2) that gives intro into "Horovodifying" single node code for multi node execution
* In general, our [Intro into Scalable Deep Learning Course](https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_public/sharedspace/teaching/intro_scalable_dl_2021/course-material/-/tree/master/tutorials/day2/tutorial2) is a good way to start (Horovod things come from Day 2 on) <br>
* In general, our [Intro into Scalable Deep Learning Course](https://gitlab.version.fz-juelich.de/MLDL_FZJ/juhaicu/jsc_public/sharedspace/teaching/intro_scalable_dl_2021/course-material/) is a good way to start (Horovod things come from Day 2 on) <br>
There are also code examples there how to run training on our HPC machines with Horovod on multiple nodes