distribution of training on multiple nodes

  • distribute model on multiple GPUs
  • use horovood to distribute on multiple nodes

maybe worth to read: https://theaisummer.com/distributed-training/

Edited by Ghost User