Skip to content
Snippets Groups Projects
Select Git revision
  • enxhi_issue460_remove_TOAR-I_access
  • michael_issue459_preprocess_german_stations
  • sh_pollutants
  • develop protected
  • master default protected
  • release_v2.4.0
  • michael_issue450_feat_load-ifs-data
  • lukas_issue457_feat_set-config-paths-as-parameter
  • lukas_issue454_feat_use-toar-statistics-api-v2
  • lukas_issue453_refac_advanced-retry-strategy
  • lukas_issue452_bug_update-proj-version
  • lukas_issue449_refac_load-era5-data-from-toar-db
  • lukas_issue451_feat_robust-apriori-estimate-for-short-timeseries
  • lukas_issue448_feat_load-model-from-path
  • lukas_issue447_feat_store-and-load-local-clim-apriori-data
  • lukas_issue445_feat_data-insight-plot-monthly-distribution
  • lukas_issue442_feat_bias-free-evaluation
  • lukas_issue444_feat_choose-interp-method-cams
  • 414-include-crps-analysis-and-other-ens-verif-methods-or-plots
  • lukas_issue384_feat_aqw-data-handler
  • v2.4.0 protected
  • v2.3.0 protected
  • v2.2.0 protected
  • v2.1.0 protected
  • Kleinert_etal_2022_initial_submission
  • v2.0.0 protected
  • v1.5.0 protected
  • v1.4.0 protected
  • v1.3.0 protected
  • v1.2.1 protected
  • v1.2.0 protected
  • v1.1.0 protected
  • IntelliO3-ts-v1.0_R1-submit
  • v1.0.0 protected
  • v0.12.2 protected
  • v0.12.1 protected
  • v0.12.0 protected
  • v0.11.0 protected
  • v0.10.0 protected
  • IntelliO3-ts-v1.0_initial-submit
40 results

setup_venv_hdfml.sh

Blame
  • setup_venv_hdfml.sh 1.05 KiB
    #!/bin/bash
    # __author__ = Felix Kleinert
    # __date__  = '2020-04-06'
    
    # This script creates a virtual env which contains all modules which are not available via slrum/easybuild (see mlt_modules_hdfml.sh)
    # enter setting dir if called externally
    
    # $1 has to be an abs path to HPC_setup. If not provided, $PWD is used
    
    if [[ $1 != '' ]]; then
      cur=$1
    else
      cur=$PWD
    fi
    
    # load existing modules
    source ${cur}mlt_modules_hdfml.sh
    
    # create venv
    python3 -m venv ${cur}../venv_hdfml
    
    source ${cur}/../venv_hdfml/bin/activate
    
    # export path for side-packages 
    export PYTHONPATH=${cur}/../venv_hdfml/lib/python3.6/site-packages:${PYTHONPATH}
    
    pip install -r ${cur}/requirements_HDFML_outcommented.txt
    pip install --ignore-installed matplotlib==3.2.0
    pip install --ignore-installed pandas==1.0.1
    pip install --ignore-installed statsmodels==0.11.1
    pip install --ignore-installed tabulate
    
    # see wiki on hdfml for information oh h5py:
    # https://gitlab.version.fz-juelich.de/haf/Wiki/-/wikis/HDF-ML%20System
    
    export CC=mpicc
    export HDF5_MPI="ON"
    pip install --no-binary=h5py h5py