Skip to content
Snippets Groups Projects
Commit c040e4d9 authored by Jan Ebert's avatar Jan Ebert
Browse files

Prefer setting up with `nice`

Good practice in order not to hog the login nodes during setup.
parent 75b389a0
No related branches found
No related tags found
No related merge requests found
...@@ -169,13 +169,13 @@ the same template to your own projects that may use `pip`-installed ...@@ -169,13 +169,13 @@ the same template to your own projects that may use `pip`-installed
PyTorch versions, or even a container. This also means that you need PyTorch versions, or even a container. This also means that you need
to set up a virtual environment with `torchrun_jsc` installed before to set up a virtual environment with `torchrun_jsc` installed before
being able to use the example out-of-the-box. This can be done by being able to use the example out-of-the-box. This can be done by
executing `bash set_up.sh` once on a login node. executing `nice bash set_up.sh` once on a login node.
### Job submission ### Job submission
As a reminder, before being able to submit a job, you have to manually As a reminder, before being able to submit a job, you have to manually
create an environment by executing `bash set_up.sh` once on a login create an environment by executing `nice bash set_up.sh` once on a
node. login node.
The `sbatch` scripts are written so that they take arguments like a The `sbatch` scripts are written so that they take arguments like a
usual script. To launch a job with different arguments, you can just usual script. To launch a job with different arguments, you can just
...@@ -187,10 +187,10 @@ sbatch run.sbatch --train-num-workers=8 --valid-num-workers=3 ...@@ -187,10 +187,10 @@ sbatch run.sbatch --train-num-workers=8 --valid-num-workers=3
### Interactive use ### Interactive use
After the environment has been created by executing `bash set_up.sh` After the environment has been created by executing `nice bash
once on a login node, it can also be used interactively by activating set_up.sh` once on a login node, it can also be used interactively by
it. This activation has to be done in each new terminal session; it activating it. This activation has to be done in each new terminal
does not persist between login sessions: session; it does not persist between login sessions:
```shell ```shell
source activate.sh source activate.sh
......
...@@ -17,13 +17,13 @@ fi ...@@ -17,13 +17,13 @@ fi
source "$curr_dir"/modules.sh source "$curr_dir"/modules.sh
if ! [ -d "$venv_dir" ]; then if ! [ -d "$venv_dir" ]; then
echo "Please manually execute \`bash ${curr_dir@Q}/set_up.sh\`" \ echo "Please manually execute \`nice bash ${curr_dir@Q}/set_up.sh\`" \
"on a login node to create the \`venv\`." "on a login node to create the \`venv\`."
exit 1 exit 1
elif ! [ -f "$venv_dir"/bin/activate ]; then elif ! [ -f "$venv_dir"/bin/activate ]; then
echo "Something seems to be wrong with the \`venv\` at \`$venv_dir\`." \ echo "Something seems to be wrong with the \`venv\` at \`$venv_dir\`." \
"Please delete it (\`rm -rf ${venv_dir@Q}\`) and" \ "Please delete it (\`nice rm -rf ${venv_dir@Q}\`) and" \
"execute \`bash ${curr_dir@Q}/set_up.sh\`" \ "execute \`nice bash ${curr_dir@Q}/set_up.sh\`" \
"on a login node to re-create the \`venv\`." "on a login node to re-create the \`venv\`."
exit 1 exit 1
fi fi
......
...@@ -19,8 +19,8 @@ if ! [ -d "$venv_dir" ]; then ...@@ -19,8 +19,8 @@ if ! [ -d "$venv_dir" ]; then
if ! [ -f "$venv_dir"/bin/activate ]; then if ! [ -f "$venv_dir"/bin/activate ]; then
echo "Something seems to be wrong with the \`venv\` at \`$venv_dir\`." \ echo "Something seems to be wrong with the \`venv\` at \`$venv_dir\`." \
"Please delete it (\`rm -rf ${venv_dir@Q}\`) and" \ "Please delete it (\`nice rm -rf ${venv_dir@Q}\`) and" \
"execute \`bash ${curr_dir@Q}/set_up.sh\`" \ "execute \`nice bash ${curr_dir@Q}/set_up.sh\`" \
"on a login node to re-create the \`venv\`." "on a login node to re-create the \`venv\`."
exit 1 exit 1
fi fi
...@@ -37,5 +37,5 @@ if ! [ -d "$venv_dir" ]; then ...@@ -37,5 +37,5 @@ if ! [ -d "$venv_dir" ]; then
deactivate deactivate
else else
echo "\`venv\` is already set up at \`$venv_dir\`. Please" \ echo "\`venv\` is already set up at \`$venv_dir\`. Please" \
"delete it (\`rm -rf ${venv_dir@Q}\`) to force a re-generation." "delete it (\`nice rm -rf ${venv_dir@Q}\`) to force a re-generation."
fi fi
...@@ -17,13 +17,13 @@ fi ...@@ -17,13 +17,13 @@ fi
source "$curr_dir"/modules.sh source "$curr_dir"/modules.sh
if ! [ -d "$venv_dir" ]; then if ! [ -d "$venv_dir" ]; then
echo "Please manually execute \`bash ${curr_dir@Q}/set_up.sh\`" \ echo "Please manually execute \`nice bash ${curr_dir@Q}/set_up.sh\`" \
"on a login node to create the \`venv\`." "on a login node to create the \`venv\`."
exit 1 exit 1
elif ! [ -f "$venv_dir"/bin/activate ]; then elif ! [ -f "$venv_dir"/bin/activate ]; then
echo "Something seems to be wrong with the \`venv\` at \`$venv_dir\`." \ echo "Something seems to be wrong with the \`venv\` at \`$venv_dir\`." \
"Please delete it (\`rm -rf ${venv_dir@Q}\`) and" \ "Please delete it (\`nice rm -rf ${venv_dir@Q}\`) and" \
"execute \`bash ${curr_dir@Q}/set_up.sh\`" \ "execute \`nice bash ${curr_dir@Q}/set_up.sh\`" \
"on a login node to re-create the \`venv\`." "on a login node to re-create the \`venv\`."
exit 1 exit 1
fi fi
......
...@@ -19,8 +19,8 @@ if ! [ -d "$venv_dir" ]; then ...@@ -19,8 +19,8 @@ if ! [ -d "$venv_dir" ]; then
if ! [ -f "$venv_dir"/bin/activate ]; then if ! [ -f "$venv_dir"/bin/activate ]; then
echo "Something seems to be wrong with the \`venv\` at \`$venv_dir\`." \ echo "Something seems to be wrong with the \`venv\` at \`$venv_dir\`." \
"Please delete it (\`rm -rf ${venv_dir@Q}\`) and" \ "Please delete it (\`nice rm -rf ${venv_dir@Q}\`) and" \
"execute \`bash ${curr_dir@Q}/set_up.sh\`" \ "execute \`nice bash ${curr_dir@Q}/set_up.sh\`" \
"on a login node to re-create the \`venv\`." "on a login node to re-create the \`venv\`."
exit 1 exit 1
fi fi
...@@ -37,5 +37,5 @@ if ! [ -d "$venv_dir" ]; then ...@@ -37,5 +37,5 @@ if ! [ -d "$venv_dir" ]; then
deactivate deactivate
else else
echo "\`venv\` is already set up at \`$venv_dir\`. Please" \ echo "\`venv\` is already set up at \`$venv_dir\`. Please" \
"delete it (\`rm -rf ${venv_dir@Q}\`) to force a re-generation." "delete it (\`nice rm -rf ${venv_dir@Q}\`) to force a re-generation."
fi fi
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment