" The amount of memory for each JupyterLab is limited to 2GB. If you try to use more, your kernel will die."
" The amount of memory for each JupyterLab is limited to 4GB. If you try to use more, your kernel will die."
]
]
},
},
{
{
...
...
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
# Welcome to the Jupyter-JSC Virtual Machine JupyterLab
# Welcome to the Jupyter-JSC Virtual Machine JupyterLab
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
## Where is this JupyterLab running?
## Where is this JupyterLab running?
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
This JupyterLab instance is running on a [virtual machine](https://www.techopedia.com/definition/4805/virtual-machine-vm) on the [HDF-Cloud](https://www.fz-juelich.de/ias/jsc/EN/Expertise/SciCloudServices/HDFCloud/_node.html). It is started as a [Docker Container](https://www.docker.com/resources/what-container).
This JupyterLab instance is running on a [virtual machine](https://www.techopedia.com/definition/4805/virtual-machine-vm) on the [HDF-Cloud](https://www.fz-juelich.de/ias/jsc/EN/Expertise/SciCloudServices/HDFCloud/_node.html). It is started as a [Docker Container](https://www.docker.com/resources/what-container).
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
## How do I stop this JupyterLab?
## How do I stop this JupyterLab?
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
You can stop this JupyterLab in the Control Panel of Jupyter-JSC.
You can stop this JupyterLab in the Control Panel of Jupyter-JSC.
You can reach the Control Panel [here](https://jupyter-jsc.fz-juelich.de/hub/start) or in the menu File -> Hub Control Panel.
You can reach the Control Panel [here](https://jupyter-jsc.fz-juelich.de/hub/start) or in the menu File -> Hub Control Panel.
The JupyterLabs will be terminated after 30 days, so make sure your data is backed up.
The JupyterLabs will be terminated after 30 days, so make sure your data is backed up.
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
## How can I upload files to JupyterLab?
## How can I upload files to JupyterLab?
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
You can use git or you upload files with this button in the top left corner:
You can use git or you upload files with this button in the top left corner:
Just right click on a file and click "Download".
Just right click on a file and click "Download".
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
## What kind of Docker Images do we support?
## What kind of Docker Images do we support?
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
You can select between [these eight](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-base-notebook) Images.
You can select between [these eight](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-base-notebook) Images.
We installed additionally a few JupyterLab extensions.
We installed additionally a few JupyterLab extensions.
If you want to add your own Docker Image to Jupyter-JSC please contact the <a href="mailto:ds-support@fz-juelich.de?subject=Jupyter-JSC Support&body=Please describe your problem here. (english or german)">Jupyter-JSC support</a>.
If you want to add your own Docker Image to Jupyter-JSC please contact the <a href="mailto:ds-support@fz-juelich.de?subject=Jupyter-JSC Support&body=Please describe your problem here. (english or german)">Jupyter-JSC support</a>.
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
## How much memory do I have?
## How much memory do I have?
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
The amount of memory for each JupyterLab is limited to 2GB. If you try to use more, your kernel will die.
The amount of memory for each JupyterLab is limited to 4GB. If you try to use more, your kernel will die.
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
## How much disk space do I have?
## How much disk space do I have?
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
You can store 10 GB of data in /home/jovyan/work.
You can store 10 GB of data in /home/jovyan/work.
<fontcolor='red'>All files in the ~/work directory will be stored persistently.</font>
<fontcolor='red'>All files in the ~/work directory will be stored persistently.</font>
<fontcolor='red'>All files in the ~/work directory will be accessible in all of your HDF-Cloud JupyterLabs.</font>
<fontcolor='red'>All files in the ~/work directory will be accessible in all of your HDF-Cloud JupyterLabs.</font>
<fontcolor='red'>Any other files or directories will be deleted if you stop this JupyterLab.</font>
<fontcolor='red'>Any other files or directories will be deleted if you stop this JupyterLab.</font>
Under no circumstances are we liable for any lost data.
Under no circumstances are we liable for any lost data.
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
# Collaborative work
# Collaborative work
We offer four different solutions to share your work with your colleagues.
We offer four different solutions to share your work with your colleagues.
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
### GIT
### GIT
You can use the git command in a terminal to work on any git repositories.
You can use the git command in a terminal to work on any git repositories.
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
### Projects
### Projects
Projects are the best way, if you just want to share a few files (or notebooks) with your colleague, that is also using Jupyter-JSC.
Projects are the best way, if you just want to share a few files (or notebooks) with your colleague, that is also using Jupyter-JSC.
Projects are directories, that are generated on the [virtual machine](https://www.techopedia.com/definition/4805/virtual-machine-vm) where your JupyterLab is running.
Projects are directories, that are generated on the [virtual machine](https://www.techopedia.com/definition/4805/virtual-machine-vm) where your JupyterLab is running.
If you add another user to your project this directory will be mounted into their [Docker Container](https://www.docker.com/resources/what-container) .
If you add another user to your project this directory will be mounted into their [Docker Container](https://www.docker.com/resources/what-container) .
You can manage your projects with the following command:
You can manage your projects with the following command:
```
```
$ bash /home/jovyan/manage_projects.sh
$ bash /home/jovyan/manage_projects.sh
```
```
You can store up to 10 GB of data on all your projects combined.
You can store up to 10 GB of data on all your projects combined.
If you want to add users to your project you need their email address. It must be the same email address, that is connected to their [JSC webservice credentials](https://judoor.fz-juelich.de/login) .
If you want to add users to your project you need their email address. It must be the same email address, that is connected to their [JSC webservice credentials](https://judoor.fz-juelich.de/login) .
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
### B2DROP
### B2DROP
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
You can easily mount your [B2DROP](https://b2drop.eudat.eu) files into this JupyterLab.
You can easily mount your [B2DROP](https://b2drop.eudat.eu) files into this JupyterLab.
Just run the command `mount B2DROP` in a terminal and insert your [application credentials](https://eudat.eu/services/userdoc/b2drop#UserDocumentation-B2DROPUsage-WebDavclient)\.
Just run the command `mount B2DROP` in a terminal and insert your [application credentials](https://eudat.eu/services/userdoc/b2drop#UserDocumentation-B2DROPUsage-WebDavclient)\.
If you want to store your [application credentials](https://eudat.eu/services/userdoc/b2drop#UserDocumentation-B2DROPUsage-WebDavclient) add the following line to /home/jovyan/work/.davfs2/secrets:
If you want to store your [application credentials](https://eudat.eu/services/userdoc/b2drop#UserDocumentation-B2DROPUsage-WebDavclient) add the following line to /home/jovyan/work/.davfs2/secrets:
To unmount it run `umount B2DROP`
To unmount it run `umount B2DROP`
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
### HPCMOUNT
### HPCMOUNT
%% Cell type:markdown id: tags:
%% Cell type:markdown id: tags:
You can mount your files on the HPC system with [sshfs](https://en.wikipedia.org/wiki/SSHFS) .
You can mount your files on the HPC system with [sshfs](https://en.wikipedia.org/wiki/SSHFS) .
For this we created the script at /home/jovyan/mount_hpc.sh .
For this we created the script at /home/jovyan/mount_hpc.sh .
To mount your HPC files just execute
To mount your HPC files just execute
```
```
$ bash /home/jovyan/mount_hpc.sh
$ bash /home/jovyan/mount_hpc.sh
```
```
### What will the script do?
### What will the script do?
If you run it for the first time, it will create a private/public key pair for you. For your safety, a passphrase is required for this key.
If you run it for the first time, it will create a private/public key pair for you. For your safety, a passphrase is required for this key.
Afterward, it will upload the public key to your [JUDAC](https://www.fz-juelich.de/ias/jsc/EN/Expertise/Datamanagement/JUDAC/JUDAC_node.html) ~/.ssh/authorized_keys file. This will be done with [UNICORE](https://www.unicore.eu) and the [credentials](https://judoor.fz-juelich.de/login) you used to log in to Jupyter-JSC.
Afterward, it will upload the public key to your [JUDAC](https://www.fz-juelich.de/ias/jsc/EN/Expertise/Datamanagement/JUDAC/JUDAC_node.html) ~/.ssh/authorized_keys file. This will be done with [UNICORE](https://www.unicore.eu) and the [credentials](https://judoor.fz-juelich.de/login) you used to log in to Jupyter-JSC.
If your key is uploaded (or you have already used this script before) it will run the sshfs command to mount your HPC files.
If your key is uploaded (or you have already used this script before) it will run the sshfs command to mount your HPC files.
You have to enter your passphrase, that you chose in the first run, to use your generated private key.
You have to enter your passphrase, that you chose in the first run, to use your generated private key.
### How can I unmount it?
### How can I unmount it?
Just run the command
Just run the command
The folder will be automatically unmounted if you stop this JupyterLab.
The folder will be automatically unmounted if you stop this JupyterLab.
### Where is my private key stored?
### Where is my private key stored?
The private key will be stored, like your other files, in the /home/jovyan/work directory, on a [virtual machine](https://www.techopedia.com/definition/4805/virtual-machine-vm) on the [HDF-Cloud](https://www.fz-juelich.de/ias/jsc/EN/Expertise/SciCloudServices/HDFCloud/_node.html) .
The private key will be stored, like your other files, in the /home/jovyan/work directory, on a [virtual machine](https://www.techopedia.com/definition/4805/virtual-machine-vm) on the [HDF-Cloud](https://www.fz-juelich.de/ias/jsc/EN/Expertise/SciCloudServices/HDFCloud/_node.html) .
The access to this virtual machine is limited to the administrators of Jupyter-JSC.
The access to this virtual machine is limited to the administrators of Jupyter-JSC.
Since your private key is encrypted with a passphrase, even an administrator is not able to use your private key to connect to any HPC system.
Since your private key is encrypted with a passphrase, even an administrator is not able to use your private key to connect to any HPC system.
### I want to mount another account
### I want to mount another account
If you have multiple accounts (connected to your [JSC webservice credentials](https://judoor.fz-juelich.de/login)) you can tell the script which one it should use.
If you have multiple accounts (connected to your [JSC webservice credentials](https://judoor.fz-juelich.de/login)) you can tell the script which one it should use.
\<SYSTEM> is the HPC system that is used to upload your public key. Please use one of these: JURECA, JUWELS, JURON. Your account must have an active project on the chosen system.
\<SYSTEM> is the HPC system that is used to upload your public key. Please use one of these: JURECA, JUWELS, JURON. Your account must have an active project on the chosen system.
\<ACCOUNT> is your HPC account on this system ( and on [JUDAC](https://www.fz-juelich.de/ias/jsc/EN/Expertise/Datamanagement/JUDAC/JUDAC_node.html)) .
\<ACCOUNT> is your HPC account on this system ( and on [JUDAC](https://www.fz-juelich.de/ias/jsc/EN/Expertise/Datamanagement/JUDAC/JUDAC_node.html)) .
### I want to delete the public key from my HPC account
### I want to delete the public key from my HPC account
Jupyter-JSC does not delete anything from your authorized_keys file. So if you want to remove the public key you have to log in to JUDAC and remove it manually.
Jupyter-JSC does not delete anything from your authorized_keys file. So if you want to remove the public key you have to log in to JUDAC and remove it manually.