From f152a5eec5404b68b61c8aef7a6a32a40fe8d5d9 Mon Sep 17 00:00:00 2001 From: Stefan Kesselheim <s.kesselheim@fz-juelich.de> Date: Thu, 12 Jan 2023 18:26:31 +0100 Subject: [PATCH] Update README.md --- README.md | 8 +++----- 1 file changed, 3 insertions(+), 5 deletions(-) diff --git a/README.md b/README.md index 96389f1..d3aae77 100644 --- a/README.md +++ b/README.md @@ -58,14 +58,12 @@ To connect to the master and workers with a browser, you need a command of the f ```bash ssh -L 18080:localhost:18080 -L 8080:localhost:8080 kesselheim1@jwb0129i.juwels -J kesselheim1@juwels-booster.fz-juelich.de ``` -Then you can navigate to (http://localhost:8080) to the the output. +Then you can navigate to (http://localhost:8080) to the the output. This requires to enable your ssh key to be available not only from your network connection but also for connections within the supercomputer. Use the from-clause `from=10.0.0.0/8 ...` for that. -Open Questions +### Open Questions - In the Scala Example, is uses all worker instances as expected. The Python Example uses only 2. Why? -ToDos: -- Include a Python Virtual Environment -- Create a Notebook that illustrates how to run the Pi example in Juypter +### ToDos - The history server does not work yet. It crashed with this error message: ``` Exception in thread "main" java.io.FileNotFoundException: Log directory specified does not exist: file:/tmp/spark-events Did you configure the correct one through spark.history.fs.logDirectory? -- GitLab