diff --git a/index.md b/index.md index c8c02875da132da25bd8eeeda6ff88854d9669d9..c94a30eda75cb1442ff5177799741e3884e6d9e8 100644 --- a/index.md +++ b/index.md @@ -2,12 +2,12 @@ author: Alexandre Strube title: Helmholtz BLABLADOR { width=550px } subtitle: An experimental Large Language Model server -date: April 11, 2024 +date: June 12, 2024 --- # Take the slides with you -{ width=500px } +{ width=500px } --- @@ -61,10 +61,8 @@ Andrew Ng, 28.02.2024 ## Some facts -- We have no models of our own (yet) deployed -- Can host one model with 8 gpus, and multiple with smaller size (Haicluster is 16 gpus) -- Mixtral-8x7b: takes 7 gpus -- ***No data collection at all. I don't keep ANY data whatsoever*** +- ***I CAN HOST YOUR MODEL*** +- No data collection at all. I don't keep ***ANY*** data whatsoever! - You can use it AND keep your data private - No records? Privacy (and GDPR is happy) @@ -72,7 +70,7 @@ Andrew Ng, 28.02.2024 ## Deployment as a service -- Scientists from (currently just FZJ) can deploy their models on their hardware and point to blablador +- Scientists from (currently just FZJ) can deploy their models on their _own_ hardware and point to blablador - This solves a bunch of headaches for researchers: - Authentication - Web server @@ -306,15 +304,12 @@ curl --header "Authorization: Bearer MY_TOKEN_GOES_HERE" https://helmholtz-bla --- -## Link to these Slides -{ width=500px } - +## Like the slides? Want to use them? ---- +Gitlab link to source code of the slides (needs JUDOOR account) -## Like the slides? Want to use them? +[https://gitlab.jsc.fz-juelich.de/strube1/2024-06-talk-haiconf](https://gitlab.jsc.fz-juelich.de/strube1/2024-06-talk-haiconf) -[Gitlab link to source code of the slides (need JUDOOR account)](https://gitlab.jsc.fz-juelich.de/strube1/2024-04-talk-it-forum-blablador) --- diff --git a/public/images/talk-haiconf.png b/public/images/talk-haiconf.png new file mode 100644 index 0000000000000000000000000000000000000000..2541807cd6ab97e3ac43ab16241b6541ef1cf4f1 Binary files /dev/null and b/public/images/talk-haiconf.png differ diff --git a/public/images/talk-it-forum.png b/public/images/talk-it-forum.png deleted file mode 100644 index daf6bb56ba64d311143dde7a96381f213e2ffc46..0000000000000000000000000000000000000000 Binary files a/public/images/talk-it-forum.png and /dev/null differ diff --git a/public/index.html b/public/index.html index 5ce8676c5d5ce9dbd33edc99e21b0ee754022f10..7943d13115bca679c163421b69c663651c41b05b 100644 --- a/public/index.html +++ b/public/index.html @@ -4,7 +4,7 @@ <meta charset="utf-8"> <meta name="generator" content="pandoc"> <meta name="author" content="Alexandre Strube"> - <meta name="dcterms.date" content="2024-04-11"> + <meta name="dcterms.date" content="2024-06-12"> <title>Helmholtz BLABLADOR </title> <meta name="apple-mobile-web-app-capable" content="yes"> <meta name="apple-mobile-web-app-status-bar-style" content="black-translucent"> @@ -229,16 +229,16 @@ data-src="images/blablador.png" width="550" /></h1> <p class="subtitle">An experimental Large Language Model server</p> <p class="author">Alexandre Strube</p> - <p class="date">April 11, 2024</p> + <p class="date">June 12, 2024</p> </section> <section id="take-the-slides-with-you" class="slide level1"> <h1>Take the slides with you</h1> <figure> -<img data-src="images/talk-it-forum.png" width="500" -alt="https://go.fzj.de/it-forum-talk-blablador" /> +<img data-src="images/talk-haiconf.png" width="500" +alt="https://go.fzj.de/2024-06-haiconf" /> <figcaption -aria-hidden="true">https://go.fzj.de/it-forum-talk-blablador</figcaption> +aria-hidden="true">https://go.fzj.de/2024-06-haiconf</figcaption> </figure> </section> <section class="slide level1"> @@ -317,12 +317,10 @@ comes</li> <h2 id="some-facts">Some facts</h2> <ul> -<li class="fragment">We have no models of our own (yet) deployed</li> -<li class="fragment">Can host one model with 8 gpus, and multiple with -smaller size (Haicluster is 16 gpus)</li> -<li class="fragment">Mixtral-8x7b: takes 7 gpus</li> -<li class="fragment"><strong><em>No data collection at all. I don’t keep -ANY data whatsoever</em></strong> +<li class="fragment"><strong><em>I CAN HOST YOUR +MODEL</em></strong></li> +<li class="fragment">No data collection at all. I don’t keep +<strong><em>ANY</em></strong> data whatsoever! <ul> <li class="fragment">You can use it AND keep your data private</li> <li class="fragment">No records? Privacy (and GDPR is happy)</li> @@ -334,7 +332,7 @@ ANY data whatsoever</em></strong> <h2 id="deployment-as-a-service">Deployment as a service</h2> <ul> <li class="fragment">Scientists from (currently just FZJ) can deploy -their models on their hardware and point to blablador</li> +their models on their <em>own</em> hardware and point to blablador</li> <li class="fragment">This solves a bunch of headaches for researchers: <ul> <li class="fragment">Authentication</li> @@ -632,21 +630,11 @@ database in browser’s ram</li> </section> <section class="slide level1"> -<h2 id="link-to-these-slides">Link to these Slides</h2> -<figure> -<img data-src="images/talk-it-forum.png" width="500" -alt="https://go.fzj.de/it-forum-talk-blablador" /> -<figcaption -aria-hidden="true">https://go.fzj.de/it-forum-talk-blablador</figcaption> -</figure> -</section> -<section class="slide level1"> - <h2 id="like-the-slides-want-to-use-them">Like the slides? Want to use them?</h2> +<p>Gitlab link to source code of the slides (needs JUDOOR account)</p> <p><a -href="https://gitlab.jsc.fz-juelich.de/strube1/2024-04-talk-it-forum-blablador">Gitlab -link to source code of the slides (need JUDOOR account)</a></p> +href="https://gitlab.jsc.fz-juelich.de/strube1/2024-06-talk-haiconf">https://gitlab.jsc.fz-juelich.de/strube1/2024-06-talk-haiconf</a></p> </section> <section class="slide level1">