From 3325764141f1f16161cde2ec515aa84492d43b25 Mon Sep 17 00:00:00 2001 From: gong1 <b.gong@fz-juelich.de> Date: Wed, 1 Jul 2020 12:03:40 +0200 Subject: [PATCH] add readme --- README.md | 48 ++++++++++++++++++++++++++++++++++++++++++------ 1 file changed, 42 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index bd1e12a3..b2398b72 100644 --- a/README.md +++ b/README.md @@ -19,19 +19,55 @@ git clone https://gitlab.version.fz-juelich.de/toar/ambs.git ### Set-up env on JUWELS and ZAM347 -- Set up env and install packages on JUWELS - +- Setup env and install packages ```bash cd video_prediction_savp/env_setup -source create_env.sh <dir_name> <env_name> +source create_env_zam347.sh <env_name> ``` -- Setup env and install packages on zam347 +### Run workflow on JUWELS + +- Go to HPC_scripts directory ```bash -cd video_prediction_savp/env_setup -source create_env_zam347.sh <env_name> +cd video_prediction_savp/HPC_scripts + +``` +- Data Extraction +```bash +sbatch DataExtraction.sh +``` + +- Data Preprocessing +```bash +sbatch /DataPreprocess.sh +sbatch /DataPreprocess_to_tf.sh +``` + +- Setup hyperparams +This step will setup the hyper-parameters that used for training, and create a folder named "datetime_user", where save the trained model +```bash +source hyperparam_setup.sh ``` + +- Training +```bash +sbatch train_era5.sh +``` + +- Postprocess +```bash +sbatch generate_era5.sh +``` + +- Reset all the generated path to origin state + +```bash +source reset_dirs.sh +``` + + + ### Run workflow on ZAM347 - Go to zam347_scripts directory -- GitLab