Skip to content
Snippets Groups Projects
README.md 6.42 KiB
Newer Older
Jens Henrik Goebbert's avatar
Jens Henrik Goebbert committed
ECAR2023: High Performance Computing Week, Data and Architectures
================

### Document Updates:
- 08.03.23, 22:00 : initial commit
Jens Henrik Goebbert's avatar
Jens Henrik Goebbert committed
- 13.03.23, 10:00 : update minor things
Jens Henrik Goebbert's avatar
Jens Henrik Goebbert committed

### General Information:
- [ECAR 2023](http://ecar2023.hpclatam.org/en/index.html)

This is a comprehensive school of High Performance Computing (HPC), new computing architectures and big data processing. Five tracks/tracks will be held simultaneously, targeting different training and needs of undergraduate and graduate students, cluster administrators and interested people working in the industry. Specific technical courses are proposed for each audience profile and common activities that promote interaction among them. 

## Interactive high performance computing with JupyterLab
- http://ecar2023.hpclatam.org/es/class/class-8.html

Interactive exploration and analysis of large amounts of data from scientific simulations, in-situ visualization and application control are convincing scenarios for explorative sciences. Based on the open source software Jupyter or JupyterLab, a way has been available for some time now that combines interactive with reproducible computing while at the same time meeting the challenges of support for the wide range of different software workflows.

Even on supercomputers, the method enables the creation of documents that combine live code with narrative text, mathematical equations, visualizations, interactive controls, and other extensive output. However, a number of challenges must be mastered in order to make existing workflows ready for interactive high-performance computing. With so many possibilities, it’s easy to lose sight of the big picture. This course provides a detailed introduction to interactive high-performance computing.

### Main Data:
date
- 13-17 March 23
- 14:00 - 17:00 (Buenos Aires, UTC-3)
  
workshop materials
- GitLab repository: https://gitlab.jsc.fz-juelich.de/goebbert1/ecar2023_interactivehpc_jupyterlab
- Shared notes: https://gitlab.jsc.fz-juelich.de/hedgedoc/3X7lx3M-RBS8KmwbzBlliA

### Recommendation:
In order to benefit from the course contents, experience with the Python programming language is recommended.

## Agenda:
Jens Henrik Goebbert's avatar
Jens Henrik Goebbert committed
|                     | Title                                             | 
|:-------------------:|:--------------------------------------------------|
| **Monday, 13th**    | **Introduction to JupyterLab**                    |
| 14:00 - 17:00       | Welcome & Introduction                            |
|                     | Register & Login                                  |
|                     | JupyterLab UI Tour                                |
|                     | JupyterLab First Steps                            |
| **Tuesday, 14th**   | **JupyterLab for HPC**                            |
| 14:00 - 17:00       | Welcome & Login                                   |
|                     | JupyterLab Kernels                                |
|                     | JupyterLab Extensions                             |
|                     | JupyterHub - under the hood                       |
| **Wednesday, 15th** | **Parallel Programming in JupyterLab**            |
| 14:00 - 17:00       | Welcome & Login                                   |
|                     | Using HCP compute nodes interactively             |
|                     | Numba, a JIT-Compiler für Python with GPU-support |
|                     | Parallel Programming with DASK                    |
| **Tuesday, 16th**   | **Dashboards with JupyterLab**                    |
| 14:00 - 17:00       | Welcome & Login                                   |
|                     | Face Blurrer - an AI example                      |
|                     | Introduction to ipywidgets                        |
|                     | Dashboards for Science                            |
| **Friday, 17th**    | **JupyterLab for more**                           |
| 14:00 - 17:00       | Welcome & Login                                   |
|                     | Research software engineering with JupyterLab     |
|                     | Installing/Using my own JupyterLab                |
|                     | Final test                                        |
|                     | Feedback & Good Bye                               |
Jens Henrik Goebbert's avatar
Jens Henrik Goebbert committed

## Login to HPC
 - [ ] **Register** at https://judoor.fz-juelich.de - [**Video-Howto (1:10)**](https://drive.google.com/file/d/1-DfiNBP4Gta0av4lQmubkXIXzr2FW4a-/view)
    - Click on "Register"
    - Enter the email address you used to register for this event
    - Click on "Send confirmation mail..."
    - Open the confirmation email in your email program
    - Click the confirmation link
 - [ ] **Join** the training project
     - [ ] by following this link:
         - **https://judoor.fz-juelich.de/projects/join/training2304**
     - [ ] **or** by choosing this general approach - [**Video-Howto (1:06)**](https://drive.google.com/file/d/1XdQSdML_jqGqvr_2WXqzlE-G6hiuYE2_/view)
     - Login to https://judoor.fz-juelich.de
     - Scroll to section "Projects"
     - Hit the link "Join a project"
     - Enter the Project id:
         - "**training2304**" for this training course
     - Click on "Join project"
     
 - [ ] **Please be patient**
     - **This takes as long as the PI needs to respond!** 
     - The PI has to accept your join-request first
     - After acceptance
         - project will be listed in section "Projects" 
         - systems will be listed in section "Systems"
 - [ ] **Sign usage agreement** - [**Video-Howto (1:13)**](https://drive.google.com/file/d/1mEN1GmWyGFp75uMIi4d6Tpek2NC_X8eY/view)
     - Login to https://judoor.fz-juelich.de
     - Scroll to section "Systems"
     - Click on "You need to _sign the usage agreement_ to access this system"
     - Sign the usage agreement
 - [ ] **Please be patient**
     - **This may take up to 10 minutes!**
     - Your HPC accounts will now be created on the desired systems.
     - Shortly after your HPC accounts are prepared you will see 
         - "jupyter-jsc" in the section "Connected Services"
 - [ ] **Login** at https://jupyter-jsc.fz-juelich.de - [**Video-Howto (1:34)**](https://drive.google.com/file/d/1S8_DaZRjBUOv7S3xT_KO8WFf44BqlR0O/view)
     - Click on "Login"
     - Login with your new **JSC account**
     - If this is your first login
         - click on "Register"
         - agree to the terms of service
         - click the link in the confirmation mail
 - [ ] **CONGRATULATIONS - YOU ARE READY FOR THE TRAINING COURSE**

## FAQ: