diff --git a/index.md b/index.md index e8950a8dd3e0de57856a215730e2644365203644..a301dd09d8a7c18d20c356e38797e5260aa856ee 100644 --- a/index.md +++ b/index.md @@ -22,6 +22,12 @@ date: December 4th, 2024 --- +# Blablador + + + +--- + # Why? - AI is becoming basic infrastructure @@ -147,34 +153,13 @@ date: December 4th, 2024 # EU AI Act -- TrustLLM will have to comply +- TrustLLM and OpenGPT-X will have to comply - To be used commercially - Research-only models are exempt -- Bureaucratic P.I.T.A. 💩 - ---- - -# Blablador - - +- Bureaucratic shot in the foot: the EU AI Act will make it harder for EU models to compete with US ones --- - -> "I think the complexity of Python package management holds down AI application development more than is widely appreciated. AI faces multiple bottlenecks — we need more GPUs, better algorithms, cleaner data in large quantities. But when I look at the day-to-day work of application builders, there’s one additional bottleneck that I think is underappreciated: The time spent wrestling with version management is an inefficiency I hope we can reduce. " - -Andrew Ng, 28.02.2024 - ---- - -> "Building on top of open source can mean hours wrestling with package dependencies, or sometimes even juggling multiple virtual environments or using multiple versions of Python in one application. This is annoying but manageable for experienced developers, but creates a lot of friction for new AI developers entering our field without a background in computer science or software engineering." - -Andrew Ng, 28.02.2024 - - ---- - - # Juelich Supercomputing Centre  @@ -202,7 +187,7 @@ Andrew Ng, 28.02.2024 # User demand is growing, we get more hardware -- Currently around 300 unique users/day on the website +- Currently around 1000+ unique users/day on the website - API usage is higher, growing and heavier --- @@ -219,198 +204,225 @@ Andrew Ng, 28.02.2024 --- -## API Access +## It's being used in the wild! -- Create a token in the [helmholtz codebase settings - (https://codebase.helmholtz.cloud)](https://codebase.helmholtz.cloud/-/user_settings/personal_access_tokens) with the api scope -- Copy the token -- Go to [https://helmholtz-blablador.fz-juelich.de:8000/docs](https://helmholtz-blablador.fz-juelich.de:8000/docs) -- Click on Authorize, and paste the token + --- -## Demo: API + - +--- + + --- -## Demo: API + - +--- + + --- -## Demo: API +## It's being used in the wild! -- Go to /v1/models -- Click on Try it out -- Click on Execute +- Someone reverse-engineered the API and created a python package --- -## Demo: API +## It's being used in the wild! - +](images/python-bindings.png) --- -## Demo: cURL +## It's being used in the wild! -- ```bash -curl --header "Authorization: Bearer MY_TOKEN_GOES_HERE" https://helmholtz-blablador.fz-juelich.de:8000/v1/models -``` +- [GEOMAR](https://geomar.de) created a chatbot for their website +- Scanned their material and created embeddings (RAG) +- Calls Blablador's API with embeddings and gets answers +- Product of the _NFDI hackathon DataXplorers // and beyond_ +- It's called TL;DR (Too Long; Didn't Read) - [Source code](https://git.geomar.de/marcus-krueger/tldr) --- -## Demo: VScode + Continue.dev - -- Yes. It DOES run with Emacs too. Ask your favorite Emacs expert. -- Yes, vim too! -- Add [continue.dev](https://marketplace.visualstudio.com/items?itemName=Continue.continue) extension to VSCode -- On Continue, choose to add model, choose Other OpenAI-compatible API -- Click in Open Config.json at the end +## It's being used in the wild! +](images/geomar-blablador-slide.png) --- -## Demo: VScode + Continue.dev +## It's being used in the wild! -{height=600px} + --- -## Demo: VScode + Continue.dev +## It's being used in the wild! -- Inside config.json, add at the `"models"` section: +- [EUDAT](https://eudat.eu) is a collection of data management services +- Has an instance of NextCloud (File Share, Office, Calendar etc) +- It's integrating AI deeply into its services, backed by Blablador! +- {width=400px} -- ```json - { - "model": "AUTODETECT", - "title": "Blablador", - "apiKey": "glpat-YOURKEYHERE", - "apiBase": "https://helmholtz-blablador.fz-juelich.de:8000/v1", - "provider": "openai" - } -``` +--- -- Try with the other models you got from the API! +## It's being used in the wild! + +- Blassistant, a Blablador Nextcloud Assistant: [https://github.com/EUDAT-B2DROP/assistant](https://github.com/EUDAT-B2DROP/assistant) --- -## Demo: VScode + Continue.dev +## It's being used in the wild! -- Select some code in a python file -- Type Control-I (cmd-I on Mac) to edit the code, or Control-L to "talk" to blablador about this code -- Ask Blablador to explain this code! -- Can also fix, add tests, etc + --- -## Demo: VScode + Continue.dev +## It's being used in the wild! - +- FZJ's IEK7 (Stratosphere) is also using Blablador on their IEK7Cloud ---- +--- -# What can _*you*_ do with it? - +## It's being used in the wild! + + + +[https://github.com/haesleinhuepf/bia-bob](https://github.com/haesleinhuepf/bia-bob/blob/main/README.md) --- -## It's being used in the wild! - +## Todo + +- Multi-modal models (text+image, text+audio, etc) +- Auto-RAG with privacy: + - Easy to do badly. Hard to do securely. --- - +## Questions? + + --- - +## Extra slides --- -## It's being used in the wild! +> "I think the complexity of Python package management holds down AI application development more than is widely appreciated. AI faces multiple bottlenecks — we need more GPUs, better algorithms, cleaner data in large quantities. But when I look at the day-to-day work of application builders, there’s one additional bottleneck that I think is underappreciated: The time spent wrestling with version management is an inefficiency I hope we can reduce. " -- Someone reverse-engineered the API and created a python package +Andrew Ng, 28.02.2024 ---- +--- -## It's being used in the wild! +> "Building on top of open source can mean hours wrestling with package dependencies, or sometimes even juggling multiple virtual environments or using multiple versions of Python in one application. This is annoying but manageable for experienced developers, but creates a lot of friction for new AI developers entering our field without a background in computer science or software engineering." -](images/python-bindings.png) +Andrew Ng, 28.02.2024 + + +--- + + +## API Access + +- Create a token in the [helmholtz codebase settings - (https://codebase.helmholtz.cloud)](https://codebase.helmholtz.cloud/-/user_settings/personal_access_tokens) with the api scope +- Copy the token +- Go to [https://api.helmholtz-blablador.fz-juelich.de/docs](https://api.helmholtz-blablador.fz-juelich.de/docs) +- Click on Authorize, and paste the token --- -## It's being used in the wild! +## Demo: API -- [GEOMAR](https://geomar.de) created a chatbot for their website -- Scanned their material and created embeddings (RAG) -- Calls Blablador's API with embeddings and gets answers -- Product of the _NFDI hackathon DataXplorers // and beyond_ -- It's called TL;DR (Too Long; Didn't Read) - [Source code](https://git.geomar.de/marcus-krueger/tldr) + --- -## It's being used in the wild! +## Demo: API -](images/geomar-blablador-slide.png) + --- -## It's being used in the wild! +## Demo: API - +- Go to /v1/models +- Click on Try it out +- Click on Execute --- -## It's being used in the wild! +## Demo: API -- [EUDAT](https://eudat.eu) is a collection of data management services -- Has an instance of NextCloud (File Share, Office, Calendar etc) -- It's integrating AI deeply into its services, backed by Blablador! -- {width=400px} + --- -## It's being used in the wild! +## Demo: cURL -- Blassistant, a Blablador Nextcloud Assistant: [https://github.com/EUDAT-B2DROP/assistant](https://github.com/EUDAT-B2DROP/assistant) +- ```bash +curl --header "Authorization: Bearer MY_TOKEN_GOES_HERE" https://api.helmholtz-blablador.fz-juelich.de/v1/models +``` --- -## It's being used in the wild! +## Demo: VScode + Continue.dev + +- Yes. It DOES run with Emacs too. Ask your favorite Emacs expert. +- Yes, vim too! +- Add [continue.dev](https://marketplace.visualstudio.com/items?itemName=Continue.continue) extension to VSCode +- On Continue, choose to add model, choose Other OpenAI-compatible API +- Click in Open Config.json at the end - --- -## It's being used in the wild! +## Demo: VScode + Continue.dev -- FZJ's IEK7 (Stratosphere) is also using Blablador on their IEK7Cloud +{height=600px} --- -## It's being used in the wild! +## Demo: VScode + Continue.dev - +- Inside config.json, add at the `"models"` section: -[https://github.com/haesleinhuepf/bia-bob](https://github.com/haesleinhuepf/bia-bob/blob/main/README.md) +- ```json + { + "model": "AUTODETECT", + "title": "Blablador", + "apiKey": "glpat-YOURKEYHERE", + "apiBase": "https://helmholtz-blablador.fz-juelich.de:8000/v1", + "provider": "openai" + } +``` + +- Try with the other models you got from the API! --- -## Todo +## Demo: VScode + Continue.dev -- Multi-modal models (text+image, text+audio, etc) -- Auto-RAG with privacy: don't upload pdf, vector database in browser's ram - - Easy to do badly. Hard to do securely. +- Select some code in a python file +- Type Control-I (cmd-I on Mac) to edit the code, or Control-L to "talk" to blablador about this code +- Ask Blablador to explain this code! +- Can also fix, add tests, etc --- -## Questions? +## Demo: VScode + Continue.dev - + + +--- + +# What can _*you*_ do with it? + --- @@ -418,7 +430,7 @@ curl --header "Authorization: Bearer MY_TOKEN_GOES_HERE" https://helmholtz-bla Gitlab link to source code of the slides (needs JUDOOR account) -[https://gitlab.jsc.fz-juelich.de/strube1/2024-08-talk-euro-scipy](https://gitlab.jsc.fz-juelich.de/strube1/2024-08-talk-euro-scipy) +[https://gitlab.jsc.fz-juelich.de/strube1/2024-12-talk-jsc-colloquium](https://gitlab.jsc.fz-juelich.de/strube1/2024-12-talk-jsc-colloquium) --- diff --git a/public/images/kostunin-adass2024-2.png b/public/images/kostunin-adass2024-2.png new file mode 100644 index 0000000000000000000000000000000000000000..0ec0b6b0d3d7de0d608302f6eca66038de31720b Binary files /dev/null and b/public/images/kostunin-adass2024-2.png differ diff --git a/public/images/kostunin-adass2024.png b/public/images/kostunin-adass2024.png new file mode 100644 index 0000000000000000000000000000000000000000..0d77ccb4fd4e94a0f15bf3b0a58b527ff4b7de37 Binary files /dev/null and b/public/images/kostunin-adass2024.png differ diff --git a/public/index.html b/public/index.html index 230033cfa06a9c9482b2c2a83939ed12863a500c..6651803d43c7e593373cf4c0d67e784d2e8aab35 100644 --- a/public/index.html +++ b/public/index.html @@ -255,6 +255,10 @@ rank, some good, some awful)</li> and training code.</li> </ul> </section> +<section id="blablador-1" class="slide level1"> +<h1>Blablador</h1> +<p><img data-src="images/blablador-screenshot.png" /></p> +</section> <section id="why" class="slide level1"> <h1>Why?</h1> <ul> @@ -422,43 +426,15 @@ turing-complete (probably not)</li> <section id="eu-ai-act" class="slide level1"> <h1>EU AI Act</h1> <ul> -<li class="fragment">TrustLLM will have to comply +<li class="fragment">TrustLLM and OpenGPT-X will have to comply <ul> <li class="fragment">To be used commercially</li> </ul></li> <li class="fragment">Research-only models are exempt</li> -<li class="fragment">Bureaucratic P.I.T.A. 💩</li> +<li class="fragment">Bureaucratic shot in the foot: the EU AI Act will +make it harder for EU models to compete with US ones</li> </ul> </section> -<section id="blablador-1" class="slide level1"> -<h1>Blablador</h1> -<p><img data-src="images/blablador-screenshot.png" /></p> -</section> -<section class="slide level1"> - -<blockquote> -<p>“I think the complexity of Python package management holds down AI -application development more than is widely appreciated. AI faces -multiple bottlenecks — we need more GPUs, better algorithms, cleaner -data in large quantities. But when I look at the day-to-day work of -application builders, there’s one additional bottleneck that I think is -underappreciated: The time spent wrestling with version management is an -inefficiency I hope we can reduce.”</p> -</blockquote> -<p>Andrew Ng, 28.02.2024</p> -</section> -<section class="slide level1"> - -<blockquote> -<p>“Building on top of open source can mean hours wrestling with package -dependencies, or sometimes even juggling multiple virtual environments -or using multiple versions of Python in one application. This is -annoying but manageable for experienced developers, but creates a lot of -friction for new AI developers entering our field without a background -in computer science or software engineering.”</p> -</blockquote> -<p>Andrew Ng, 28.02.2024</p> -</section> <section id="juelich-supercomputing-centre" class="slide level1"> <h1>Juelich Supercomputing Centre</h1> <figure> @@ -498,7 +474,7 @@ in computer science or software engineering.”</p> class="slide level1"> <h1>User demand is growing, we get more hardware</h1> <ul> -<li class="fragment">Currently around 300 unique users/day on the +<li class="fragment">Currently around 1000+ unique users/day on the website</li> <li class="fragment">API usage is higher, growing and heavier</li> </ul> @@ -525,110 +501,6 @@ aria-hidden="true">https://helmholtz-blablador.fz-juelich.de</figcaption> </section> <section class="slide level1"> -<h2 id="api-access">API Access</h2> -<ul> -<li class="fragment">Create a token in the <a -href="https://codebase.helmholtz.cloud/-/user_settings/personal_access_tokens">helmholtz -codebase settings - (https://codebase.helmholtz.cloud)</a> with the api -scope</li> -<li class="fragment">Copy the token</li> -<li class="fragment">Go to <a -href="https://helmholtz-blablador.fz-juelich.de:8000/docs">https://helmholtz-blablador.fz-juelich.de:8000/docs</a></li> -<li class="fragment">Click on Authorize, and paste the token</li> -</ul> -</section> -<section class="slide level1"> - -<h2 id="demo-api">Demo: API</h2> -<p><img data-src="images/fastapi-main.png" /></p> -</section> -<section class="slide level1"> - -<h2 id="demo-api-1">Demo: API</h2> -<p><img data-src="images/fastapi-authorize.png" /></p> -</section> -<section class="slide level1"> - -<h2 id="demo-api-2">Demo: API</h2> -<ul> -<li class="fragment">Go to /v1/models</li> -<li class="fragment">Click on Try it out</li> -<li class="fragment">Click on Execute</li> -</ul> -</section> -<section class="slide level1"> - -<h2 id="demo-api-3">Demo: API</h2> -<p><img data-src="images/fastapi-models.png" /></p> -</section> -<section class="slide level1"> - -<h2 id="demo-curl">Demo: cURL</h2> -<ul> -<li class="fragment"><div class="sourceCode" id="cb1"><pre -class="sourceCode bash"><code class="sourceCode bash"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a><span class="ex">curl</span> <span class="at">--header</span> <span class="st">"Authorization: Bearer MY_TOKEN_GOES_HERE"</span> https://helmholtz-blablador.fz-juelich.de:8000/v1/models</span></code></pre></div></li> -</ul> -</section> -<section class="slide level1"> - -<h2 id="demo-vscode-continue.dev">Demo: VScode + Continue.dev</h2> -<ul> -<li class="fragment">Yes. It DOES run with Emacs too. Ask your favorite -Emacs expert.</li> -<li class="fragment">Yes, vim too!</li> -<li class="fragment">Add <a -href="https://marketplace.visualstudio.com/items?itemName=Continue.continue">continue.dev</a> -extension to VSCode</li> -<li class="fragment">On Continue, choose to add model, choose Other -OpenAI-compatible API</li> -<li class="fragment">Click in Open Config.json at the end</li> -</ul> -</section> -<section class="slide level1"> - -<h2 id="demo-vscode-continue.dev-1">Demo: VScode + Continue.dev</h2> -<p><img data-src="images/continue-add-model.png" height="600" /></p> -</section> -<section class="slide level1"> - -<h2 id="demo-vscode-continue.dev-2">Demo: VScode + Continue.dev</h2> -<ul> -<li class="fragment"><p>Inside config.json, add at the -<code>"models"</code> section:</p></li> -<li class="fragment"><div class="sourceCode" id="cb2"><pre -class="sourceCode json"><code class="sourceCode json"><span id="cb2-1"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a> <span class="fu">{</span></span> -<span id="cb2-2"><a href="#cb2-2" aria-hidden="true" tabindex="-1"></a> <span class="dt">"model"</span><span class="fu">:</span> <span class="st">"AUTODETECT"</span><span class="fu">,</span></span> -<span id="cb2-3"><a href="#cb2-3" aria-hidden="true" tabindex="-1"></a> <span class="dt">"title"</span><span class="fu">:</span> <span class="st">"Blablador"</span><span class="fu">,</span></span> -<span id="cb2-4"><a href="#cb2-4" aria-hidden="true" tabindex="-1"></a> <span class="dt">"apiKey"</span><span class="fu">:</span> <span class="st">"glpat-YOURKEYHERE"</span><span class="fu">,</span></span> -<span id="cb2-5"><a href="#cb2-5" aria-hidden="true" tabindex="-1"></a> <span class="dt">"apiBase"</span><span class="fu">:</span> <span class="st">"https://helmholtz-blablador.fz-juelich.de:8000/v1"</span><span class="fu">,</span></span> -<span id="cb2-6"><a href="#cb2-6" aria-hidden="true" tabindex="-1"></a> <span class="dt">"provider"</span><span class="fu">:</span> <span class="st">"openai"</span></span> -<span id="cb2-7"><a href="#cb2-7" aria-hidden="true" tabindex="-1"></a> <span class="fu">}</span></span></code></pre></div></li> -<li class="fragment"><p>Try with the other models you got from the -API!</p></li> -</ul> -</section> -<section class="slide level1"> - -<h2 id="demo-vscode-continue.dev-3">Demo: VScode + Continue.dev</h2> -<ul> -<li class="fragment">Select some code in a python file</li> -<li class="fragment">Type Control-I (cmd-I on Mac) to edit the code, or -Control-L to “talk” to blablador about this code</li> -<li class="fragment">Ask Blablador to explain this code!</li> -<li class="fragment">Can also fix, add tests, etc</li> -</ul> -</section> -<section class="slide level1"> - -<h2 id="demo-vscode-continue.dev-4">Demo: VScode + Continue.dev</h2> -<p><img data-src="images/continue-ask-code.png" /></p> -</section> -<section id="what-can-you-do-with-it" class="slide level1"> -<h1>What can <em><em>you</em></em> do with it?</h1> -<p><img data-src="images/blablador-uncle-sam.png" /></p> -</section> -<section class="slide level1"> - <h2 id="its-being-used-in-the-wild">It’s being used in the wild!</h2> <figure> <img data-src="images/peter-steinbach-blablador-talk-lips-2024.png" @@ -641,18 +513,36 @@ aria-hidden="true">https://indico.desy.de/event/38849/contributions/162118/</fig <figure> <img data-src="images/kostunin-lips2024.png" -alt="Dmitriy Kostunin’s talk earlier today at LIPS24" /> -<figcaption aria-hidden="true">Dmitriy Kostunin’s talk earlier today at +alt="Dmitriy Kostunin’s talk at LIPS24" /> +<figcaption aria-hidden="true">Dmitriy Kostunin’s talk at LIPS24</figcaption> </figure> </section> <section class="slide level1"> +<figure> +<img data-src="images/kostunin-adass2024.png" +alt="Controlling a radiotelescope with AI agents" /> +<figcaption aria-hidden="true">Controlling a radiotelescope with AI +agents</figcaption> +</figure> +</section> +<section class="slide level1"> + +<figure> +<img data-src="images/kostunin-adass2024-2.png" +alt="Controlling a radiotelescope with AI agents" /> +<figcaption aria-hidden="true">Controlling a radiotelescope with AI +agents</figcaption> +</figure> +</section> +<section class="slide level1"> + <figure> <img data-src="images/cosmosage.png" -alt="cosmosage is deployed on Blablador as of today!" /> -<figcaption aria-hidden="true">cosmosage is deployed on Blablador as of -today!</figcaption> +alt="cosmosage is deployed on Blablador!" /> +<figcaption aria-hidden="true">cosmosage is deployed on +Blablador!</figcaption> </figure> </section> <section class="slide level1"> @@ -752,8 +642,7 @@ href="https://github.com/haesleinhuepf/bia-bob/blob/main/README.md">https://gith <ul> <li class="fragment">Multi-modal models (text+image, text+audio, etc)</li> -<li class="fragment">Auto-RAG with privacy: don’t upload pdf, vector -database in browser’s ram +<li class="fragment">Auto-RAG with privacy: <ul> <li class="fragment">Easy to do badly. Hard to do securely.</li> </ul></li> @@ -766,11 +655,144 @@ database in browser’s ram </section> <section class="slide level1"> +<h2 id="extra-slides">Extra slides</h2> +</section> +<section class="slide level1"> + +<blockquote> +<p>“I think the complexity of Python package management holds down AI +application development more than is widely appreciated. AI faces +multiple bottlenecks — we need more GPUs, better algorithms, cleaner +data in large quantities. But when I look at the day-to-day work of +application builders, there’s one additional bottleneck that I think is +underappreciated: The time spent wrestling with version management is an +inefficiency I hope we can reduce.”</p> +</blockquote> +<p>Andrew Ng, 28.02.2024</p> +</section> +<section class="slide level1"> + +<blockquote> +<p>“Building on top of open source can mean hours wrestling with package +dependencies, or sometimes even juggling multiple virtual environments +or using multiple versions of Python in one application. This is +annoying but manageable for experienced developers, but creates a lot of +friction for new AI developers entering our field without a background +in computer science or software engineering.”</p> +</blockquote> +<p>Andrew Ng, 28.02.2024</p> +</section> +<section class="slide level1"> + +<h2 id="api-access">API Access</h2> +<ul> +<li class="fragment">Create a token in the <a +href="https://codebase.helmholtz.cloud/-/user_settings/personal_access_tokens">helmholtz +codebase settings - (https://codebase.helmholtz.cloud)</a> with the api +scope</li> +<li class="fragment">Copy the token</li> +<li class="fragment">Go to <a +href="https://api.helmholtz-blablador.fz-juelich.de/docs">https://api.helmholtz-blablador.fz-juelich.de/docs</a></li> +<li class="fragment">Click on Authorize, and paste the token</li> +</ul> +</section> +<section class="slide level1"> + +<h2 id="demo-api">Demo: API</h2> +<p><img data-src="images/fastapi-main.png" /></p> +</section> +<section class="slide level1"> + +<h2 id="demo-api-1">Demo: API</h2> +<p><img data-src="images/fastapi-authorize.png" /></p> +</section> +<section class="slide level1"> + +<h2 id="demo-api-2">Demo: API</h2> +<ul> +<li class="fragment">Go to /v1/models</li> +<li class="fragment">Click on Try it out</li> +<li class="fragment">Click on Execute</li> +</ul> +</section> +<section class="slide level1"> + +<h2 id="demo-api-3">Demo: API</h2> +<p><img data-src="images/fastapi-models.png" /></p> +</section> +<section class="slide level1"> + +<h2 id="demo-curl">Demo: cURL</h2> +<ul> +<li class="fragment"><div class="sourceCode" id="cb1"><pre +class="sourceCode bash"><code class="sourceCode bash"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a><span class="ex">curl</span> <span class="at">--header</span> <span class="st">"Authorization: Bearer MY_TOKEN_GOES_HERE"</span> https://api.helmholtz-blablador.fz-juelich.de/v1/models</span></code></pre></div></li> +</ul> +</section> +<section class="slide level1"> + +<h2 id="demo-vscode-continue.dev">Demo: VScode + Continue.dev</h2> +<ul> +<li class="fragment">Yes. It DOES run with Emacs too. Ask your favorite +Emacs expert.</li> +<li class="fragment">Yes, vim too!</li> +<li class="fragment">Add <a +href="https://marketplace.visualstudio.com/items?itemName=Continue.continue">continue.dev</a> +extension to VSCode</li> +<li class="fragment">On Continue, choose to add model, choose Other +OpenAI-compatible API</li> +<li class="fragment">Click in Open Config.json at the end</li> +</ul> +</section> +<section class="slide level1"> + +<h2 id="demo-vscode-continue.dev-1">Demo: VScode + Continue.dev</h2> +<p><img data-src="images/continue-add-model.png" height="600" /></p> +</section> +<section class="slide level1"> + +<h2 id="demo-vscode-continue.dev-2">Demo: VScode + Continue.dev</h2> +<ul> +<li class="fragment"><p>Inside config.json, add at the +<code>"models"</code> section:</p></li> +<li class="fragment"><div class="sourceCode" id="cb2"><pre +class="sourceCode json"><code class="sourceCode json"><span id="cb2-1"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a> <span class="fu">{</span></span> +<span id="cb2-2"><a href="#cb2-2" aria-hidden="true" tabindex="-1"></a> <span class="dt">"model"</span><span class="fu">:</span> <span class="st">"AUTODETECT"</span><span class="fu">,</span></span> +<span id="cb2-3"><a href="#cb2-3" aria-hidden="true" tabindex="-1"></a> <span class="dt">"title"</span><span class="fu">:</span> <span class="st">"Blablador"</span><span class="fu">,</span></span> +<span id="cb2-4"><a href="#cb2-4" aria-hidden="true" tabindex="-1"></a> <span class="dt">"apiKey"</span><span class="fu">:</span> <span class="st">"glpat-YOURKEYHERE"</span><span class="fu">,</span></span> +<span id="cb2-5"><a href="#cb2-5" aria-hidden="true" tabindex="-1"></a> <span class="dt">"apiBase"</span><span class="fu">:</span> <span class="st">"https://helmholtz-blablador.fz-juelich.de:8000/v1"</span><span class="fu">,</span></span> +<span id="cb2-6"><a href="#cb2-6" aria-hidden="true" tabindex="-1"></a> <span class="dt">"provider"</span><span class="fu">:</span> <span class="st">"openai"</span></span> +<span id="cb2-7"><a href="#cb2-7" aria-hidden="true" tabindex="-1"></a> <span class="fu">}</span></span></code></pre></div></li> +<li class="fragment"><p>Try with the other models you got from the +API!</p></li> +</ul> +</section> +<section class="slide level1"> + +<h2 id="demo-vscode-continue.dev-3">Demo: VScode + Continue.dev</h2> +<ul> +<li class="fragment">Select some code in a python file</li> +<li class="fragment">Type Control-I (cmd-I on Mac) to edit the code, or +Control-L to “talk” to blablador about this code</li> +<li class="fragment">Ask Blablador to explain this code!</li> +<li class="fragment">Can also fix, add tests, etc</li> +</ul> +</section> +<section class="slide level1"> + +<h2 id="demo-vscode-continue.dev-4">Demo: VScode + Continue.dev</h2> +<p><img data-src="images/continue-ask-code.png" /></p> +</section> +<section id="what-can-you-do-with-it" class="slide level1"> +<h1>What can <em><em>you</em></em> do with it?</h1> +<p><img data-src="images/blablador-uncle-sam.png" /></p> +</section> +<section class="slide level1"> + <h2 id="like-the-slides-want-to-use-them">Like the slides? Want to use them?</h2> <p>Gitlab link to source code of the slides (needs JUDOOR account)</p> <p><a -href="https://gitlab.jsc.fz-juelich.de/strube1/2024-08-talk-euro-scipy">https://gitlab.jsc.fz-juelich.de/strube1/2024-08-talk-euro-scipy</a></p> +href="https://gitlab.jsc.fz-juelich.de/strube1/2024-12-talk-jsc-colloquium">https://gitlab.jsc.fz-juelich.de/strube1/2024-12-talk-jsc-colloquium</a></p> </section> <section class="slide level1">