Skip to content
Snippets Groups Projects
Commit 2dc95872 authored by stadtler1's avatar stadtler1
Browse files

Changed destination directory and make use of the 2 tier pystager.

parent 5bb7c002
No related branches found
No related tags found
No related merge requests found
Pipeline #40089 passed
Stage: build
Stage: test
Stage: deploy
Show whitespace changes
Inline Side-by-side
video_prediction_savp/HPC_scripts/DataExtraction.sh
+ 2
− 2
View file @ 2dc95872
...@@ -23,8 +23,8 @@ module load h5py/2.9.0-Python-3.6.8 ...@@ -23,8 +23,8 @@ module load h5py/2.9.0-Python-3.6.8
module load mpi4py/3.0.1-Python-3.6.8 module load mpi4py/3.0.1-Python-3.6.8
module load netcdf4-python/1.5.0.1-Python-3.6.8 module load netcdf4-python/1.5.0.1-Python-3.6.8
srun python ../../workflow_parallel_frame_prediction/DataExtraction/mpi_stager_v2.py --source_dir /p/fastdata/slmet/slmet111/met_data/ecmwf/era5/nc/2014/ --destination_dir ${SAVE_DIR}/extractedData/2014 #srun python ../../workflow_parallel_frame_prediction/DataExtraction/mpi_stager_v2.py --source_dir /p/fastdata/slmet/slmet111/met_data/ecmwf/era5/nc/2014/ --destination_dir ${SAVE_DIR}/extractedData/2014
# 2tier pystager # 2tier pystager
#srun python ../../workflow_parallel_frame_prediction/DataExtraction/main_single_master.py --source_dir /p/fastdata/slmet/slmet111/met_data/ecmwf/era5/nc/2017/ --destination_dir /p/scratch/deepacf/${USER}/extractedData/2017 srun python ../../workflow_parallel_frame_prediction/DataExtraction/main_single_master.py --source_dir /p/fastdata/slmet/slmet111/met_data/ecmwf/era5/nc/2013/ --destination_dir ${SAVE_DIR}/extractedData/2013
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment