Then you can navigate to (http://localhost:8080) to the the output.
Open Questions
Open Questions
- In the Scala Example, is uses all worker instances as expected. The Python Example uses only 2. Why?
- In the Scala Example, is uses all worker instances as expected. The Python Example uses only 2. Why?
...
@@ -32,6 +37,11 @@ Open Questions
...
@@ -32,6 +37,11 @@ Open Questions
ToDos:
ToDos:
- Include a Python Virtual Environment
- Include a Python Virtual Environment
- Create a Notebook that illustrates how to run the Pi example in Juypter
- Create a Notebook that illustrates how to run the Pi example in Juypter
- The history server does not work yet. It crashed with this error message:
```
Exception in thread "main" java.io.FileNotFoundException: Log directory specified does not exist: file:/tmp/spark-events Did you configure the correct one through spark.history.fs.logDirectory?
```
The logdir config is not configured in the right way.
## References
## References
- Pi Estimate (Python + Scala): [](https://spark.apache.org/examples.html)
- Pi Estimate (Python + Scala): [](https://spark.apache.org/examples.html)