... | ... | @@ -60,7 +60,7 @@ If everything runs fine, you can change the paths in the `sbatch` scripts accord |
|
|
## (Data Parallel) Training with Horovod
|
|
|
Example of a job:
|
|
|
|
|
|
```
|
|
|
```sh
|
|
|
#!/usr/bin/env bash
|
|
|
|
|
|
#SBATCH --nodes 1
|
... | ... | @@ -128,7 +128,7 @@ srun -A cstdl --cpu-bind=none \ |
|
|
## Training with DeepSpeed
|
|
|
Example of a job:
|
|
|
|
|
|
```
|
|
|
```sh
|
|
|
|
|
|
#!/usr/bin/env bash
|
|
|
|
... | ... | |