DEEP-SEA -- DDG Teleconference 2021-10-20 ==== ## List of participants |Affiliation| Name |Here| Email |:--------- |:----------------- |:-:|:------------- | Atos | Pierre Lemarinier | ✔ | pierre.lemarinier@atos.net | BADW-LRZ | Michael Ott | x | michael.ott@lrz.de | | Jan Schulze | ✔ | jan.schulze@lrz.de | BSC | Vicenç Beltran | x | vicenc.beltran@bsc.es | | Paul Carpenter | ✔ | paul.carpenter@bsc.es | | Marc Casas | x | marc.casas@bsc.es | | Petar Radojkovic | x | petar.radojkovic@bsc.es | CEA | Julien Jaeger | ✔ | julien.jaeger@cea.fr | | Patrick Carribault| x | patrick.carribault@cea.fr | | Adrien Roussel | ✔ | adrien.roussel@cea.fr | ECMWF | Olivier Marsden | x | Olivier.Marsden@ecmwf.int | | Patrick Gillies | x | patrick.gillies@ecmwf.int | ETHZ | Timo Schneider | ✔ | timos@inf.ethz.ch | FHG | Valeria Bartsch | x | valeria.bartsch@itwm.fraunhofer.de | | Rui Machado | ✔ | rui.machado@itwm.fraunhofer.de | FORTH | Angelos Bilas | x | bilas@ics.forth.gr | | Fabian Chaix | x | chaix@ics.forth.gr | | Antony Chazapis | x | chazapis@ics.forth.gr | | Lena Kanellou | x | kanellou@ics.forth.gr | | Manolis Marazakis | ✔ | maraz@ics.forth.gr | | Manolis Ploumidis | x | ploumid@ics.forth.gr | FZJ | Jörg Benke | x | j.benke@fz-juelich.de | | Abhiraj Bishnoi | x | a.bishnoi@fz-juelich.de | | Norbert Eicker | ✔ | n.eicker@fz-juelich.de | | Wolfgang Frings | ✔ | w.frings@fz-juelich.de | | Markus Geimer | ✔ | m.geimer@fz-juelich.de | | Dominik Gottwald | x | d.gottwald@fz-juelich.de | | Max Holicki | x | m.holicki@fz-juelich.de | | Jochen Kreutz | x | j.kreutz@fz-juelich.de | | Anke Kreuzer | x | a.kreuzer@fz-juelich.de | | Jan Meinke | ✔ | j.meinke@fz-juelich.de | | Maria Petrova | x | m.petrova@fz-juelich.de | | Andreas Smolenko | x | a.smolenko@fz-juelich.de | | Estela Suarez | ✔ | e.suarez@fz-juelich.de | | Ujjwal Sinha | ✔ | u.sinha@fz-juelich.de | KTH | Niclas Jansson | x | njansson@kth.se | | Stefano Markidis | x | markidis@kth.se | | Artur Podobas | x | podobas@kth.se | KULeuven | Jorge Amaya | x | jorge.amaya@kuleuven.be | | Giovanni Lapenta | x | giovanni.lapenta@kuleuven.be | ParTec | Carsten Clauss | x | clauss@par-tec.com | | Jennifer Lopez | ✔ | lopez@par-tec.com | | Thomas Moschny | ✔ | moschny@par-tec.com | | Simon Pickartz | ✔ | pickartz@par-tec.com | TUDa | Alexander Geiß | ✔ | alexander.geiss1@tu-darmstadt.de | | Ahmad Tarraf | x | ahmad.tarraf@tu-darmstadt.de | | Felix Wolf | x | felix.wolf@tu-darmstadt.de | TUM | Isaias A. Compres | ✔ | compresu@in.tum.de | | Martin Schulz | ✔ | schulzm@in.tum.de | | Carsten Trinitis | x | carsten.trinitis@tum.de ## Agenda * Action items from last meeting * Optimization cycles and preparation of D3.1 (_Simon Pickartz_/_Norbert Eicker_) * Update of the technical work-packages by each WP leader * WP1 -- Co-design applications (_Jan Meinke_) * WP2 -- Measuring, Modelling, Mapping and Monitoring (_Alexander Geiß_) * WP3 -- Software Architecture and System Software (_Simon Pickartz_) * WP4 -- Node-level programming (_Paul Carpenter_) * WP5 -- System-level programming (_Pierre Lemarinier_) * Co-Design process to define the Software Architecture (_Jan Meinke_/_Norbert Eicker_) ## Notes ### Action items from last meeting * Invite Philippe Deniel (CEA / IO-SEA) to the next DDG meeting * Background is the inter-project (IO-SEA/RED-SEA/DEEP-SEA) interactions on the co-design applications * See agenda item below * Further work on SAB NDA process and P. Radojkovic's proposal * SAB NDA process: * https://docs.google.com/spreadsheets/d/1PI1iHOP2d61KEOAD74O_gNll-b1zY_KbCw-RVA9IFL0/edit#gid=1228950445 Tab: SAB members: Contact info * All SAB members signed the NDA in the meantime * New proposal: Evgueny Khartchenko (Intel) * No objections by Tuesday (19^th^ October) * To be discussed in the ToW call later, too * Feedback on proposed reviewers (and/or name more) * Today discussion with PO and other projects on proposals * No objections/feedback from within the project ### Optimization cycles and preparation of D3.1 * Slides are [here](https://bscw.zam.kfa-juelich.de/bscw/bscw.cgi/d3722485/211020%20D31preparation.pdf) * Next steps: * All further work in the $LaTeX$ document * Descriptions of building blocks shall be ready ASAP * Description of optimization cycles latest October 26^th^ noon * To be able to give feedback / have discussions during the all-hands meeting * Building blocks not in any optimization cycle * Create a more application developer oriented description of these single building blocks in a similar fashion as the optimization cycle * Currently only GPI/GPI-Space is affected * Might be merged in to a general malleable optimization cycle * Components in the optimization cycles but not described * DynamoRIO, (Slurm-)Scheduler ### Inter-project (IO-SEA/DEEP-SEA) interactions on the co-design applications (_Philippe Deniel_) * Three milestones for inter-project activities foreseen in the DoAs in the meantime * Idea is to organize co-operation in cross-project workshops * One-day workshops (remote?) * Use extended minutes as a report/deliverable * Common interest between DEEP-SEA and IO-SEA on scheduling * Compute- and data-nodes have to be scheduled -- most probably topology aware * IO-SEA needs hints from the applications and system software (DEEP-SEA) and the (network-)hardware (RED-SEA) for proper data-placement * Hints might be provided similar to extended attributes * Wrappers around a C interface would be required (e.g. for modern C++ or python) * [Could MPI-IO help here? It provides hints.] * Metrology is required across all projects * Collect integrated datasets and enable ML/AI frameworks to use them * Asynchronous IO and MPI-communication might lead similar strategies * Technical discussion had to be stopped due to missing time * Demonstrates that it's worth to meet in a workshop * Next step: Find a date ### WP1 -- Co-design applications * Start preparation of application traces ### WP2 -- Measuring, Modelling, Mapping and Monitoring * Working on optimization cycles * Worked with Simon on nesting optimisation cycles * Difficulties gathering data from GPU HW counters on DEEP cluster * Support is informed ### WP3 -- Software Architecture and System Software * Planning of the presentation during the DEEP-SEA seminar * Further discussion on the input to Deliverable D3.1 ### WP4 -- Node-level programming * Nothing special ### WP5 -- System-level programming * No issues to report ### Co-Design process to define the Software Architecture * This week's seminar presenting the 2^nd^ chunk of optimization cycles * Monitoring optimisation cycles [Sebastian Lührs, JSC] * MSA-related optimisation [Simon Pickartz, ParTec] * Mapping Toolchain [Alexander Geiß, TUDa] * Monitor-based Malleability [Isaías Comprés, TUM] * RMA-Analyzer optimisation cycle [Marc Sergent, Atos] * BDPO optimisation cycles [Hafid Mazouz, Atos] * DaCe optimisation cycles [Julien Jaeger, CEA] ### AoB * HiPEAC presentation * Co-dissemination workshop * Might be a side-workshop * Budapest on January 17^th^ (on premise) * Two presentations * General presentation given by Jan Schulze * Technical presentation given by N.N. * Title needed next week * Candidates for Reviewer * Shall be from EuroHPC member states * Geographically "well distributed" * Current Candidates (including IO-SEA and RED-SEA nominates) -- If you have some concerns, please inform PMT (also, if you have some candidates from other nationalities): * Marie-Christine Sawley: mcsawley@bluewin.ch; https://ch.linkedin.com/in/marie-christine-sawley-70b5534 * Maria Angeles Navarro (former reviewer of DEEP-EST and ExaNeSt): angeles@ac.uma.es https://www.ac.uma.es/~angeles/ * Anne-Claire Fouilloux (former DEEP-EST reviewer): a.c.fouilloux@geo.uio.no; https://www.mn.uio.no/geo/english/people/adm/annefou/ * Jean-François Lavignon (email: jf@ts-jfl.net) * Jean-Marc Morel (email : jmmorel84@gmail.com ) * François Bodin (http://people.irisa.fr/Francois.Bodin/) ## Actions * Work on D3.1 * PMT to find a date for the inter-project workshop (together with IO-SEA / RED-SEA project-management team) * Find title / speaker for HiPEAC presentation ## Next Meeting:   3^rd^ November 15:00--16:00 CET