Skip to content
Snippets Groups Projects
Select Git revision
  • 0866b3efeeb6f3fc7647dee3861affaf5e4a1e66
  • master default protected
  • enxhi_issue460_remove_TOAR-I_access
  • michael_issue459_preprocess_german_stations
  • sh_pollutants
  • develop protected
  • release_v2.4.0
  • michael_issue450_feat_load-ifs-data
  • lukas_issue457_feat_set-config-paths-as-parameter
  • lukas_issue454_feat_use-toar-statistics-api-v2
  • lukas_issue453_refac_advanced-retry-strategy
  • lukas_issue452_bug_update-proj-version
  • lukas_issue449_refac_load-era5-data-from-toar-db
  • lukas_issue451_feat_robust-apriori-estimate-for-short-timeseries
  • lukas_issue448_feat_load-model-from-path
  • lukas_issue447_feat_store-and-load-local-clim-apriori-data
  • lukas_issue445_feat_data-insight-plot-monthly-distribution
  • lukas_issue442_feat_bias-free-evaluation
  • lukas_issue444_feat_choose-interp-method-cams
  • 414-include-crps-analysis-and-other-ens-verif-methods-or-plots
  • lukas_issue384_feat_aqw-data-handler
  • v2.4.0 protected
  • v2.3.0 protected
  • v2.2.0 protected
  • v2.1.0 protected
  • Kleinert_etal_2022_initial_submission
  • v2.0.0 protected
  • v1.5.0 protected
  • v1.4.0 protected
  • v1.3.0 protected
  • v1.2.1 protected
  • v1.2.0 protected
  • v1.1.0 protected
  • IntelliO3-ts-v1.0_R1-submit
  • v1.0.0 protected
  • v0.12.2 protected
  • v0.12.1 protected
  • v0.12.0 protected
  • v0.11.0 protected
  • v0.10.0 protected
  • IntelliO3-ts-v1.0_initial-submit
41 results

run_devgpu.bash

Blame
  • INSTALL.md 4.62 KiB

    Prerequisites

    You will need a C compiler capable of understanding C11, as well as posix threads.

    Also, you will need autoreconf and libtool for configuring Maestro build system.

    deps/c-timestamp deps/libcyaml deps/libfabric deps/libyaml deps/mamba deps/mio deps/protobuf deps/protobuf-c

    Subtree projects and updates

    We are including a number of external dependency libraries as subtrees in our tree under ./deps/ and build these versions automatically with our make rules. Maestro uses the libraries it built from the subtrees and not the versions of the libraries on your system.

    Subtree Remote branch
    c-timestamp git@github.com:chansen/c-timestamp.git
    libcyaml git@github.com:tlsa/libcyaml.git master
    libfabric git@github.com:ofiwg/libfabric.git v1.11.x
    libyaml git@github.com:yaml/libyaml.git master
    mamba git@gitlab.com:cerl/mamba.git master
    mio git@gitlab.version.fz-juelich.de:10022/maestro/mio.git master
    protobuf git@github.com:protocolbuffers/protobuf.git 3.10.x
    protobuf-c git@github.com:protobuf-c/protobuf-c.git next
    liberl git@gitlab.com:cerl/liberl.git maestro

    To update a dependency project (e.g. mamba) subtree please do

    git subtree pull --prefix=deps/mamba --squash git@gitlab.com:cerl/mamba.git master

    If git refuses to do the subtree update insisting 'repo was never added', create a remote for the repo, e.g.,

    git remote add -f ofiwg  git@github.com:ofiwg/libfabric.git 

    and use that repo name for the subtree pull command.

    Building

    For CRAY XC systems

    Please load the following modules before configuring/building, to ensure libfabric will be built properly.

    module load rdma-credentials
    module load gni-headers

    Please note that DRC does not permit multiple drc_acquire() calls in the same job allocation. That is typically not a problem in real workflows, since the pool manager will be allocating the DRC token and other processes will only drc_access() it. HOWEVER, when you run the maestro-core tests in a single allocation, only the first one that uses DRC will succeed, and the later ones will all fail with a message like

    mstro_drc_init(drc.c:196) Failed to drc_acquire a new credential: -28

    The recommended way to run the tests is by allocating a job per test using the LOG_COMPILER variable of automake's test infrastructure:

    env LOG_COMPILER="srun -n1 --exclusive -t 0:5:0 --pty" make -j2 check

    This will start a single-node exclusive job for each individual test, and each will get a different DRC token.

    jupiter system

    Do not use one of the craype-network-ofi\* modules at this time. libfabric builds nicely with CCE 9.0.

    sage prototype

    Please load the following modules before configuring/building.

    module use $CLIENT_MOD_PATH
    module swap gnu GCC/9.3.0
    module load Autotools git binutils pkg-config libreadline

    Calling autoreconf

    autoreconf -ivf

    Configuring

    ./configure