Update IBG 3: JSC Supercomputer HowTo authored by Johannes Keller's avatar Johannes Keller
......@@ -197,7 +197,6 @@ We add some more specific information for the file systems used in our projects.
- Archive files using "tar-ball" compression before moving here.
- Ideal for archiving significant simulations or those related to publications.
### Moving data to archive
**Remark:** The same procedure applies with `jibg36` for JUWELS users instead of `jicg41`.
......@@ -215,12 +214,12 @@ We add some more specific information for the file systems used in our projects.
```
- Create tar-balls for the files (no compression):
```
```shell
tar -cvf NAME.tar PATH/TO/DIR/FILES
```
- Optionally, compress tar-balls (e.g., gzip):
```
```shell
tar -czvf NAME.tar.gz PATH/TO/DIR/FILES
```
......@@ -228,3 +227,28 @@ We add some more specific information for the file systems used in our projects.
```shell
mv NAME.tar $ARCHIVE_jicg41/$USER
```
### Checking memory and number of files
JSC's `jutil` command gives an overview of the memory and file usage on each partition. Oftentimes more fine-grained, directory-specific information is useful. The following two commands (`find`, `du`) can do this.
#### find: Check number of files
Check the number of files in the current directory:
```shell
find . -name "*" -type f | wc -l
```
Check the number of files in all subdirectories of the current directory
```shell
for d in ./*/ ; do (find $d -type f | wc -l); done
```
#### du: Check memory
Check the memory in the current directory and subdirectories of level 1:
```shell
du -ha -d1 .
```
\ No newline at end of file