update readme

README.md

@@ -41,29 +41,33 @@ cd env_setup
 
 ## Data Extraction
 
-
-## Data Preprocessing
+[Workflow project](https://gitlab.version.fz-juelich.de/gong1/workflow_parallel_frame_prediction)
 
 ```bash
-cd workflow_video_prediction/DataExtraction
-python mpi_stager_v2.py
+cd ../workflow_video_prediction/DataExtraction 
+python mpi_stager_v2.py  --source_dir <input_dir1> --destination_dir <output_dir1>
 ```
 
-
+## Data Preprocessing
 ```bash
-bash data/download_and_preprocess_dataset_era5.sh --data era5 --input_dir /splits --output_dir  <data/era5>
+cd  ../workflow_video_prediction/DataPreprocess
+python mpi_stager_v2_process_netCDF.py --source_dir <output_dir1> --destination_dir <output_dir2> 
 ```
 
-## Training
+```python
+video_prediction/datasets/era5_dataset_v2.py <output_dir2/splits>  <output_dir3>
+```
 
+```python
+python scripts/train_v2.py --input_dir <output_dir3> --dataset era5  --model <savp> --model_hparams_dict hparams/kth/ours_savp/model_hparams.json --output_dir <logs/era5/ours_savp>
+```
 ## Postprocessing
 
-### Prediction Generator
 
 ### Model Evaluation
 
-
-## End-to-End run the entire workflow
+![Groud Truth](/results_test_samples/era5_size_64_64_3_norm_dup/ours_savp/Sample_Batch_id_0_Sample_1.mp4)
+# End-to-End run the entire workflow
 
 ```bash
 cd bash
@@ -71,18 +75,3 @@ cd bash
 ```
 
 
-
-
-### Download data
-
-- Download the ERA5 data (.hkl) from the output of DataPreprocess in the [Workflow project](https://gitlab.version.fz-juelich.de/gong1/workflow_parallel_frame_prediction)
-
-
-### Model Training for ERA5 data
-```python
-python scripts/train_v2.py --input_dir data/era5 --dataset era5  --model savp --model_hparams_dict hparams/kth/ours_savp/model_hparams.json --output_dir logs/era5/ours_savp
-```
-
-### Model Evaluation
-
-![Groud Truth](/results_test_samples/era5_size_64_64_3_norm_dup/ours_savp/Sample_Batch_id_0_Sample_1.mp4)