Update IBG 3: JSC Supercomputer HowTo authored by Johannes Keller's avatar Johannes Keller
Welcome to the IBG-3 specific introduction for getting started with the JSC supercomputers.
This document is intended to complement the general documentation of JURECA and JUWELS by providing specific guidance tailored for IBG-3 users, helping you navigate common pitfalls and optimize your computing experience.
Feel free to correct/adapt this document!
Content:
[TOC]
Useful links:
- Introduction to Supercomputing at JSC: https://www.fz-juelich.de/en/ias/jsc/education/training-courses/training-materials/course-material-sc-introduction-may-23
- JURECA documentation: https://apps.fz-juelich.de/jsc/hps/jureca/index.html
- JUWELS documentation: https://apps.fz-juelich.de/jsc/hps/juwels/index.html
- available file systems: https://apps.fz-juelich.de/jsc/hps/juwels/environment.html#available-file-systems
- JSC User Support: https://www.fz-juelich.de/en/ias/jsc/services/user-support
**Disclaimer:** Parts of this documentation have been re-written by ChatGPT asking for clarity and conciseness.
## Joining a compute time project
Links:
- JuDoor: https://judoor.fz-juelich.de/login
- SSH-key creation: https://apps.fz-juelich.de/jsc/hps/jureca/access.html
- JSC-support: https://www.fz-juelich.de/en/ias/jsc/services/user-support
The following steps should help you get started with the JSC supercomputer
efficiently.
1. Create a JuDoor Account:
- Visit JuDoor (https://judoor.fz-juelich.de/login).
- Sign up for an account if you don’t have one.
2. Join a Project:
- On JuDoor, click “Join a project.”
- Specify the project code:
- For JURECA, use “cjicg41.”
- For JUWELS, use “cjibg36.”
- For JURECA-data-project, use “jicg41.”
- For JUWELS-data-project, use “jibg36.”
3. Generate an SSH Key:
- Simplified instructions for SSH Key Generation: https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/SSH-Keys-at-JSC-Supercomputers
- General instructions in the JURECA manual (https://apps.fz-juelich.de/jsc/hps/jureca/access.html) to generate an SSH key.
4. Add SSH Key to JuDoor:
- Instructions: https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/SSH-Keys-at-JSC-Supercomputers#uploading-the-public-key-pair-to-judoor
- Use IP-Adresses of the form `x.y.0.0/16` in the "from" clause, where the first
two numbers "x" and "y" should be copied from the ip-adress displayed in the top
of the JuDoor SSH-key-upload-page. Background: The last two numbers of the
ip-adress may vary between logins and the suffix `0.0/16` ensures that the from-clause stays valid for these variations.
5. Logging in to supercomputer:
- Detailed Instructions: https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Logging-in-to-JSC-Supercomputers
- on JURECA, enforce IPv4: https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Logging-in-to-JSC-Supercomputers#jureca-note-on-ipv6-connectivity
- Official manual, JURECA: https://apps.fz-juelich.de/jsc/hps/jureca/access.html#logging-in-to-system-name
- Official manual, JUWELS: https://apps.fz-juelich.de/jsc/hps/juwels/access.html#logging-in-to-system-name
6. Contact for Assistance:
- If you encounter login issues or have questions about using the
system, feel free to contact for assistance.
- Johannes: jo.keller@fz-juelich.de
- JSC general support contacts: https://www.fz-juelich.de/en/ias/jsc/services/user-support
## Tips for first time users
https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Tips-for-first-time-Users-of-JSC-Supercomputers
## Data handling
https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Data-Handling-on-JSC-Supercomputers
### File Systems and How to Use Them
https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Data-Handling-on-JSC-Supercomputers#file-systems-and-how-to-use-them
### Moving data to archive
https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Data-Handling-on-JSC-Supercomputers#moving-data-to-archive
### Checking memory and number of files
Welcome to the IBG-3 specific introduction for getting started with the JSC supercomputers.
This document is intended to complement the general documentation of JURECA and JUWELS by providing specific guidance tailored for IBG-3 users, helping you navigate common pitfalls and optimize your computing experience.
Feel free to correct/adapt this document!
Content:
[TOC]
Useful links:
- Introduction to Supercomputing at JSC: https://www.fz-juelich.de/en/ias/jsc/education/training-courses/training-materials/course-material-sc-introduction-may-23
- JURECA documentation: https://apps.fz-juelich.de/jsc/hps/jureca/index.html
- JUWELS documentation: https://apps.fz-juelich.de/jsc/hps/juwels/index.html
- available file systems: https://apps.fz-juelich.de/jsc/hps/juwels/environment.html#available-file-systems
- JSC User Support: https://www.fz-juelich.de/en/ias/jsc/services/user-support
**Disclaimer:** Parts of this documentation have been re-written by ChatGPT asking for clarity and conciseness.
## Joining a compute time project
Links:
- JuDoor: https://judoor.fz-juelich.de/login
- SSH-key creation: https://apps.fz-juelich.de/jsc/hps/jureca/access.html
- JSC-support: https://www.fz-juelich.de/en/ias/jsc/services/user-support
The following steps should help you get started with the JSC supercomputer
efficiently.
1. Create a JuDoor Account:
- Visit JuDoor (https://judoor.fz-juelich.de/login).
- Register for an account if you don’t have one.
- Enter your e-mail address and click on `Send confirmation mail`.
- Afterwards, you will receive an e-mail from dispatch@jsc.de with a personalized link.
- Click on the link, fill in the form with your data and submit the form.
- With this, the creation of your JSC account is completed. Now, you can log in to your JuDoor account with your username and password.
2. Join a Project:
- On JuDoor, click “Join a project.”
- Specify the project code:
- For JURECA, use “cjicg41.”
- For JUWELS, use “cjibg36.”
- For JURECA-data-project, use “jicg41.”
- For JUWELS-data-project, use “jibg36.”
3. Generate an SSH Key:
- Simplified instructions for SSH Key Generation: https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/SSH-Keys-at-JSC-Supercomputers
- General instructions in the JURECA manual (https://apps.fz-juelich.de/jsc/hps/jureca/access.html) to generate an SSH key.
4. Add SSH Key to JuDoor:
- Instructions: https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/SSH-Keys-at-JSC-Supercomputers#uploading-the-public-key-pair-to-judoor
- Use IP-Adresses of the form `x.y.0.0/16` in the "from" clause, where the first
two numbers "x" and "y" should be copied from the ip-adress displayed in the top
of the JuDoor SSH-key-upload-page. Background: The last two numbers of the
ip-adress may vary between logins and the suffix `0.0/16` ensures that the from-clause stays valid for these variations.
5. Logging in to supercomputer:
- Detailed Instructions: https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Logging-in-to-JSC-Supercomputers
- on JURECA, enforce IPv4: https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Logging-in-to-JSC-Supercomputers#jureca-note-on-ipv6-connectivity
- Official manual, JURECA: https://apps.fz-juelich.de/jsc/hps/jureca/access.html#logging-in-to-system-name
- Official manual, JUWELS: https://apps.fz-juelich.de/jsc/hps/juwels/access.html#logging-in-to-system-name
6. Contact for Assistance:
- If you encounter login issues or have questions about using the
system, feel free to contact for assistance.
- Johannes: jo.keller@fz-juelich.de
- JSC general support contacts: https://www.fz-juelich.de/en/ias/jsc/services/user-support
## Tips for first time users
https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Tips-for-first-time-Users-of-JSC-Supercomputers
## Data handling
https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Data-Handling-on-JSC-Supercomputers
### File Systems and How to Use Them
https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Data-Handling-on-JSC-Supercomputers#file-systems-and-how-to-use-them
### Moving data to archive
https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Data-Handling-on-JSC-Supercomputers#moving-data-to-archive
### Checking memory and number of files
https://gitlab.jsc.fz-juelich.de/sdlts/general-organisation/jsc-supercomputer-wiki-for-ibg-3/-/wikis/Data-Handling-on-JSC-Supercomputers#checking-memory-and-number-of-files
\ No newline at end of file