diff --git a/day3/3-dask/1-Introduction-to-Dask.ipynb b/day3/3-dask/1-Introduction-to-Dask.ipynb new file mode 100644 index 0000000000000000000000000000000000000000..29779eee1b127c0bbd39ee23f4ec4c5ca65cbbf9 --- /dev/null +++ b/day3/3-dask/1-Introduction-to-Dask.ipynb @@ -0,0 +1,78 @@ +{ + "cells": [ + { + "cell_type": "markdown", + "id": "linear-bangkok", + "metadata": {}, + "source": [ + "### HIGH THROUGHPUT COMPUTING WITH DASK\n", + "\n", + "**Organisers:** Alan O’Cais, David Swenson \n", + "**Website:** https://www.cecam.org/workshop-details/1022\n", + "\n", + "**Synopsis:**\n", + "High-throughput (task-based) computing is a flexible approach to parallelisation. It involves splitting a problem into loosely-coupled tasks. A scheduler then orchestrates the parallel execution of those tasks, allowing programs to adaptively scale their resource usage. E-CAM has extended the data-analytics framework Dask with a capable and efficient library to handle such workloads. This workshop will be held as a series of virtual seminars/tutorials on tools in the Dask HPC ecosystem.\n", + "\n", + "**Programme:**\n", + "- 21 January 2021, 3pm CET (2pm UTC): Dask - a flexible library for parallel computing in Python\n", + " - YouTube link: https://youtu.be/Tl8rO-baKuY\n", + " - GitHub Repo: https://github.com/jacobtomlinson/dask-video-tutorial-2020\n", + "\n", + "- 4 February 2021, 3pm CET (2pm UTC): Dask-Jobqueue - a library that integrates Dask with standard HPC queuing systems, such as SLURM or PBS\n", + " - YouTube link: https://youtu.be/iNxhHXzmJ1w\n", + " - GitHub Repo: https://github.com/ExaESM-WP4/workshop-Dask-Jobqueue-cecam-2021-02\n", + "\n", + "- 11 February 2021, 3pm CET (2pm UTC) : Jobqueue-Features - a library that enables functionality aimed at enhancing scalability\n", + " - YouTube link: https://youtu.be/FpMua8iJeTk\n", + " - GitHub Repo: https://github.com/E-CAM/jobqueue_features_workshop_materials" + ] + }, + { + "cell_type": "markdown", + "id": "precious-roommate", + "metadata": {}, + "source": [ + "Please clone: \n", + " https://github.com/ExaESM-WP4/workshop-Dask-Jobqueue-cecam-2021-02" + ] + }, + { + "cell_type": "markdown", + "id": "latter-specialist", + "metadata": {}, + "source": [ + "and open \n", + "`11_Dask_LocalCluster_Example.ipynb`" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "id": "comparable-amber", + "metadata": {}, + "outputs": [], + "source": [] + } + ], + "metadata": { + "kernelspec": { + "display_name": "Python 3", + "language": "python", + "name": "python3" + }, + "language_info": { + "codemirror_mode": { + "name": "ipython", + "version": 3 + }, + "file_extension": ".py", + "mimetype": "text/x-python", + "name": "python", + "nbconvert_exporter": "python", + "pygments_lexer": "ipython3", + "version": "3.8.5" + } + }, + "nbformat": 4, + "nbformat_minor": 5 +}