From 4ef3140c04ba71855a8da86182b478e8a6b11543 Mon Sep 17 00:00:00 2001 From: Felix Kleinert <f.kleinert@fz-juelich.de> Date: Tue, 7 Apr 2020 20:05:05 +0200 Subject: [PATCH] update readme oh how to set up things on JUWELS #106 --- README.md | 12 +++++++++--- src/run_modules/partition_check.py | 0 test/test_modules/test_partition_check.py | 0 3 files changed, 9 insertions(+), 3 deletions(-) create mode 100644 src/run_modules/partition_check.py create mode 100644 test/test_modules/test_partition_check.py diff --git a/README.md b/README.md index a4bf6465..c161405c 100644 --- a/README.md +++ b/README.md @@ -15,10 +15,16 @@ and [Network In Network (Lin et al., 2014)](https://arxiv.org/abs/1312.4400). * c++ compiler required for cartopy installation ## HPC - JUWELS -* Clone the repo to HPC system (we recommend to place it in `/p/procects/<project name>` -* Setup venv by executing `source setup_venv.sh` +* Clone the repo to HPC system (we recommend to place it in `/p/projects/<project name>`. +* Setup venv by executing `source setup_venv.sh`. This script loads all pre-installed modules and creates a venv for +all other packages. Furthermore, it creates two slurm/batch scripts to execute code on compute nodes. <br> +You have to enter the HPC project's budget name (--account flag). +* The default external data path on JUWELS is set to `/p/project/deepacf/intelliaq/<user>/DATA/toar_<sampling>`. +<br>To choose a different location open `run.py` and add the following keyword argument to `ExperimentSetup`: +`data_path=<your>/<custom>/<path>`. +* Execute `python run.py` on a login node to download example data. The program will throw an OSerror after downloading. +* Execute `sbatch run_develgpus.bash` to verify that the setup went well. * Currently cartopy is not working, therefore PlotStations does not create any output - # Security * To use hourly data from ToarDB via JOIN interface, a private token is required. Request your personal access token and diff --git a/src/run_modules/partition_check.py b/src/run_modules/partition_check.py new file mode 100644 index 00000000..e69de29b diff --git a/test/test_modules/test_partition_check.py b/test/test_modules/test_partition_check.py new file mode 100644 index 00000000..e69de29b -- GitLab