diff --git a/README.md b/README.md index 6ff27f86c6ac12b0f34b23e9afb93151bcdb527e..09cda8b264d02b4424c5f43f4bbfc920f430d26b 100644 --- a/README.md +++ b/README.md @@ -41,29 +41,33 @@ cd env_setup ## Data Extraction - -## Data Preprocessing +[Workflow project](https://gitlab.version.fz-juelich.de/gong1/workflow_parallel_frame_prediction) ```bash -cd workflow_video_prediction/DataExtraction -python mpi_stager_v2.py +cd ../workflow_video_prediction/DataExtraction +python mpi_stager_v2.py --source_dir <input_dir1> --destination_dir <output_dir1> ``` - +## Data Preprocessing ```bash -bash data/download_and_preprocess_dataset_era5.sh --data era5 --input_dir /splits --output_dir <data/era5> +cd ../workflow_video_prediction/DataPreprocess +python mpi_stager_v2_process_netCDF.py --source_dir <output_dir1> --destination_dir <output_dir2> ``` -## Training +```python +video_prediction/datasets/era5_dataset_v2.py <output_dir2/splits> <output_dir3> +``` +```python +python scripts/train_v2.py --input_dir <output_dir3> --dataset era5 --model <savp> --model_hparams_dict hparams/kth/ours_savp/model_hparams.json --output_dir <logs/era5/ours_savp> +``` ## Postprocessing -### Prediction Generator ### Model Evaluation - -## End-to-End run the entire workflow + +# End-to-End run the entire workflow ```bash cd bash @@ -71,18 +75,3 @@ cd bash ``` - - -### Download data - -- Download the ERA5 data (.hkl) from the output of DataPreprocess in the [Workflow project](https://gitlab.version.fz-juelich.de/gong1/workflow_parallel_frame_prediction) - - -### Model Training for ERA5 data -```python -python scripts/train_v2.py --input_dir data/era5 --dataset era5 --model savp --model_hparams_dict hparams/kth/ours_savp/model_hparams.json --output_dir logs/era5/ours_savp -``` - -### Model Evaluation - -