Skip to content
Snippets Groups Projects
Commit fb5ac198 authored by Alexandre Strube's avatar Alexandre Strube
Browse files

Revise Blablador section in index.md to improve structure and update usage examples

parent 9666e7db
No related branches found
No related tags found
No related merge requests found
Show whitespace changes
Inline Side-by-side
index.md
+ 126
− 114
View file @ fb5ac198
......@@ -22,6 +22,12 @@ date: December 4th, 2024
---
# Blablador
![](images/blablador-screenshot.png)
---
# Why?
- AI is becoming basic infrastructure
......@@ -147,34 +153,13 @@ date: December 4th, 2024
# EU AI Act
- TrustLLM will have to comply
- TrustLLM and OpenGPT-X will have to comply
- To be used commercially
- Research-only models are exempt
- Bureaucratic P.I.T.A. 💩
---
# Blablador
![](images/blablador-screenshot.png)
- Bureaucratic shot in the foot: the EU AI Act will make it harder for EU models to compete with US ones
---
> "I think the complexity of Python package management holds down AI application development more than is widely appreciated. AI faces multiple bottlenecks — we need more GPUs, better algorithms, cleaner data in large quantities. But when I look at the day-to-day work of application builders, there’s one additional bottleneck that I think is underappreciated: The time spent wrestling with version management is an inefficiency I hope we can reduce. "
Andrew Ng, 28.02.2024
---
> "Building on top of open source can mean hours wrestling with package dependencies, or sometimes even juggling multiple virtual environments or using multiple versions of Python in one application. This is annoying but manageable for experienced developers, but creates a lot of friction for new AI developers entering our field without a background in computer science or software engineering."
Andrew Ng, 28.02.2024
---
# Juelich Supercomputing Centre
![Juwels BOOSTER](images/juwels-booster.jpg)
......@@ -202,7 +187,7 @@ Andrew Ng, 28.02.2024
# User demand is growing, we get more hardware
- Currently around 300 unique users/day on the website
- Currently around 1000+ unique users/day on the website
- API usage is higher, growing and heavier
---
......@@ -219,198 +204,225 @@ Andrew Ng, 28.02.2024
---
## API Access
## It's being used in the wild!
- Create a token in the [helmholtz codebase settings - (https://codebase.helmholtz.cloud)](https://codebase.helmholtz.cloud/-/user_settings/personal_access_tokens) with the api scope
- Copy the token
- Go to [https://helmholtz-blablador.fz-juelich.de:8000/docs](https://helmholtz-blablador.fz-juelich.de:8000/docs)
- Click on Authorize, and paste the token
![https://indico.desy.de/event/38849/contributions/162118/](images/peter-steinbach-blablador-talk-lips-2024.png)
---
## Demo: API
![Dmitriy Kostunin's talk at LIPS24](images/kostunin-lips2024.png)
![](images/fastapi-main.png)
---
![Controlling a radiotelescope with AI agents](images/kostunin-adass2024.png)
---
## Demo: API
![Controlling a radiotelescope with AI agents](images/kostunin-adass2024-2.png)
![](images/fastapi-authorize.png)
---
![cosmosage is deployed on Blablador!](images/cosmosage.png)
---
## Demo: API
## It's being used in the wild!
- Go to /v1/models
- Click on Try it out
- Click on Execute
- Someone reverse-engineered the API and created a python package
---
## Demo: API
## It's being used in the wild!
![](images/fastapi-models.png)
![[https://git.geomar.de/everardo-gonzalez/blablador-python-bindings](https://git.geomar.de/everardo-gonzalez/blablador-python-bindings)](images/python-bindings.png)
---
## Demo: cURL
## It's being used in the wild!
- ```bash
curl --header "Authorization: Bearer MY_TOKEN_GOES_HERE" https://helmholtz-blablador.fz-juelich.de:8000/v1/models
```
- [GEOMAR](https://geomar.de) created a chatbot for their website
- Scanned their material and created embeddings (RAG)
- Calls Blablador's API with embeddings and gets answers
- Product of the _NFDI hackathon DataXplorers // and beyond_
- It's called TL;DR (Too Long; Didn't Read) - [Source code](https://git.geomar.de/marcus-krueger/tldr)
---
## Demo: VScode + Continue.dev
## It's being used in the wild!
- Yes. It DOES run with Emacs too. Ask your favorite Emacs expert.
- Yes, vim too!
- Add [continue.dev](https://marketplace.visualstudio.com/items?itemName=Continue.continue) extension to VSCode
- On Continue, choose to add model, choose Other OpenAI-compatible API
- Click in Open Config.json at the end
![[https://zenodo.org/records/10376144](https://zenodo.org/records/10376144)](images/geomar-blablador-slide.png)
---
## It's being used in the wild!
![](images/conmar.png)
---
## Demo: VScode + Continue.dev
## It's being used in the wild!
![](images/continue-add-model.png){height=600px}
- [EUDAT](https://eudat.eu) is a collection of data management services
- Has an instance of NextCloud (File Share, Office, Calendar etc)
- It's integrating AI deeply into its services, backed by Blablador!
- ![](images/eudat.png){width=400px}
---
## Demo: VScode + Continue.dev
## It's being used in the wild!
- Inside config.json, add at the `"models"` section:
- Blassistant, a Blablador Nextcloud Assistant: [https://github.com/EUDAT-B2DROP/assistant](https://github.com/EUDAT-B2DROP/assistant)
- ```json
{
"model": "AUTODETECT",
"title": "Blablador",
"apiKey": "glpat-YOURKEYHERE",
"apiBase": "https://helmholtz-blablador.fz-juelich.de:8000/v1",
"provider": "openai"
}
```
---
- Try with the other models you got from the API!
## It's being used in the wild!
![](images/nextcloud-blablador-theme.png)
---
## Demo: VScode + Continue.dev
## It's being used in the wild!
- Select some code in a python file
- Type Control-I (cmd-I on Mac) to edit the code, or Control-L to "talk" to blablador about this code
- Ask Blablador to explain this code!
- Can also fix, add tests, etc
- FZJ's IEK7 (Stratosphere) is also using Blablador on their IEK7Cloud
---
## Demo: VScode + Continue.dev
## It's being used in the wild!
![](images/continue-ask-code.png)
![](images/bia-bob.gif)
[https://github.com/haesleinhuepf/bia-bob](https://github.com/haesleinhuepf/bia-bob/blob/main/README.md)
---
# What can _*you*_ do with it?
![](images/blablador-uncle-sam.png)
## Todo
- Multi-modal models (text+image, text+audio, etc)
- Auto-RAG with privacy:
- Easy to do badly. Hard to do securely.
---
## It's being used in the wild!
## Questions?
![https://indico.desy.de/event/38849/contributions/162118/](images/peter-steinbach-blablador-talk-lips-2024.png)
![](images/blablador-questions.jpg)
---
![Dmitriy Kostunin's talk earlier today at LIPS24](images/kostunin-lips2024.png)
## Extra slides
---
![cosmosage is deployed on Blablador as of today!](images/cosmosage.png)
> "I think the complexity of Python package management holds down AI application development more than is widely appreciated. AI faces multiple bottlenecks — we need more GPUs, better algorithms, cleaner data in large quantities. But when I look at the day-to-day work of application builders, there’s one additional bottleneck that I think is underappreciated: The time spent wrestling with version management is an inefficiency I hope we can reduce. "
Andrew Ng, 28.02.2024
---
## It's being used in the wild!
> "Building on top of open source can mean hours wrestling with package dependencies, or sometimes even juggling multiple virtual environments or using multiple versions of Python in one application. This is annoying but manageable for experienced developers, but creates a lot of friction for new AI developers entering our field without a background in computer science or software engineering."
Andrew Ng, 28.02.2024
- Someone reverse-engineered the API and created a python package
---
## It's being used in the wild!
![[https://git.geomar.de/everardo-gonzalez/blablador-python-bindings](https://git.geomar.de/everardo-gonzalez/blablador-python-bindings)](images/python-bindings.png)
## API Access
- Create a token in the [helmholtz codebase settings - (https://codebase.helmholtz.cloud)](https://codebase.helmholtz.cloud/-/user_settings/personal_access_tokens) with the api scope
- Copy the token
- Go to [https://api.helmholtz-blablador.fz-juelich.de/docs](https://api.helmholtz-blablador.fz-juelich.de/docs)
- Click on Authorize, and paste the token
---
## It's being used in the wild!
## Demo: API
- [GEOMAR](https://geomar.de) created a chatbot for their website
- Scanned their material and created embeddings (RAG)
- Calls Blablador's API with embeddings and gets answers
- Product of the _NFDI hackathon DataXplorers // and beyond_
- It's called TL;DR (Too Long; Didn't Read) - [Source code](https://git.geomar.de/marcus-krueger/tldr)
![](images/fastapi-main.png)
---
## It's being used in the wild!
## Demo: API
![[https://zenodo.org/records/10376144](https://zenodo.org/records/10376144)](images/geomar-blablador-slide.png)
![](images/fastapi-authorize.png)
---
## It's being used in the wild!
## Demo: API
![](images/conmar.png)
- Go to /v1/models
- Click on Try it out
- Click on Execute
---
## It's being used in the wild!
## Demo: API
- [EUDAT](https://eudat.eu) is a collection of data management services
- Has an instance of NextCloud (File Share, Office, Calendar etc)
- It's integrating AI deeply into its services, backed by Blablador!
- ![](images/eudat.png){width=400px}
![](images/fastapi-models.png)
---
## It's being used in the wild!
## Demo: cURL
- Blassistant, a Blablador Nextcloud Assistant: [https://github.com/EUDAT-B2DROP/assistant](https://github.com/EUDAT-B2DROP/assistant)
- ```bash
curl --header "Authorization: Bearer MY_TOKEN_GOES_HERE" https://api.helmholtz-blablador.fz-juelich.de/v1/models
```
---
## It's being used in the wild!
## Demo: VScode + Continue.dev
- Yes. It DOES run with Emacs too. Ask your favorite Emacs expert.
- Yes, vim too!
- Add [continue.dev](https://marketplace.visualstudio.com/items?itemName=Continue.continue) extension to VSCode
- On Continue, choose to add model, choose Other OpenAI-compatible API
- Click in Open Config.json at the end
![](images/nextcloud-blablador-theme.png)
---
## It's being used in the wild!
## Demo: VScode + Continue.dev
- FZJ's IEK7 (Stratosphere) is also using Blablador on their IEK7Cloud
![](images/continue-add-model.png){height=600px}
---
## It's being used in the wild!
## Demo: VScode + Continue.dev
![](images/bia-bob.gif)
- Inside config.json, add at the `"models"` section:
[https://github.com/haesleinhuepf/bia-bob](https://github.com/haesleinhuepf/bia-bob/blob/main/README.md)
- ```json
{
"model": "AUTODETECT",
"title": "Blablador",
"apiKey": "glpat-YOURKEYHERE",
"apiBase": "https://helmholtz-blablador.fz-juelich.de:8000/v1",
"provider": "openai"
}
```
- Try with the other models you got from the API!
---
## Todo
## Demo: VScode + Continue.dev
- Multi-modal models (text+image, text+audio, etc)
- Auto-RAG with privacy: don't upload pdf, vector database in browser's ram
- Easy to do badly. Hard to do securely.
- Select some code in a python file
- Type Control-I (cmd-I on Mac) to edit the code, or Control-L to "talk" to blablador about this code
- Ask Blablador to explain this code!
- Can also fix, add tests, etc
---
## Questions?
## Demo: VScode + Continue.dev
![](images/blablador-questions.jpg)
![](images/continue-ask-code.png)
---
# What can _*you*_ do with it?
![](images/blablador-uncle-sam.png)
---
......@@ -418,7 +430,7 @@ curl --header "Authorization: Bearer MY_TOKEN_GOES_HERE" https://helmholtz-bla
Gitlab link to source code of the slides (needs JUDOOR account)
[https://gitlab.jsc.fz-juelich.de/strube1/2024-08-talk-euro-scipy](https://gitlab.jsc.fz-juelich.de/strube1/2024-08-talk-euro-scipy)
[https://gitlab.jsc.fz-juelich.de/strube1/2024-12-talk-jsc-colloquium](https://gitlab.jsc.fz-juelich.de/strube1/2024-12-talk-jsc-colloquium)
---
......
public/images/kostunin-adass2024-2.png 0 → 100644
+ 0
− 0
View file @ fb5ac198
public/images/kostunin-adass2024-2.png

78.7 KiB

public/images/kostunin-adass2024.png 0 → 100644
+ 0
− 0
View file @ fb5ac198
public/images/kostunin-adass2024.png

125 KiB

public/index.html
+ 166
− 144
View file @ fb5ac198
......@@ -255,6 +255,10 @@ rank, some good, some awful)</li>
and training code.</li>
</ul>
</section>
<section id="blablador-1" class="slide level1">
<h1>Blablador</h1>
<p><img data-src="images/blablador-screenshot.png" /></p>
</section>
<section id="why" class="slide level1">
<h1>Why?</h1>
<ul>
......@@ -422,43 +426,15 @@ turing-complete (probably not)</li>
<section id="eu-ai-act" class="slide level1">
<h1>EU AI Act</h1>
<ul>
<li class="fragment">TrustLLM will have to comply
<li class="fragment">TrustLLM and OpenGPT-X will have to comply
<ul>
<li class="fragment">To be used commercially</li>
</ul></li>
<li class="fragment">Research-only models are exempt</li>
<li class="fragment">Bureaucratic P.I.T.A. 💩</li>
<li class="fragment">Bureaucratic shot in the foot: the EU AI Act will
make it harder for EU models to compete with US ones</li>
</ul>
</section>
<section id="blablador-1" class="slide level1">
<h1>Blablador</h1>
<p><img data-src="images/blablador-screenshot.png" /></p>
</section>
<section class="slide level1">
<blockquote>
<p>“I think the complexity of Python package management holds down AI
application development more than is widely appreciated. AI faces
multiple bottlenecks — we need more GPUs, better algorithms, cleaner
data in large quantities. But when I look at the day-to-day work of
application builders, there’s one additional bottleneck that I think is
underappreciated: The time spent wrestling with version management is an
inefficiency I hope we can reduce.”</p>
</blockquote>
<p>Andrew Ng, 28.02.2024</p>
</section>
<section class="slide level1">
<blockquote>
<p>“Building on top of open source can mean hours wrestling with package
dependencies, or sometimes even juggling multiple virtual environments
or using multiple versions of Python in one application. This is
annoying but manageable for experienced developers, but creates a lot of
friction for new AI developers entering our field without a background
in computer science or software engineering.”</p>
</blockquote>
<p>Andrew Ng, 28.02.2024</p>
</section>
<section id="juelich-supercomputing-centre" class="slide level1">
<h1>Juelich Supercomputing Centre</h1>
<figure>
......@@ -498,7 +474,7 @@ in computer science or software engineering.”</p>
class="slide level1">
<h1>User demand is growing, we get more hardware</h1>
<ul>
<li class="fragment">Currently around 300 unique users/day on the
<li class="fragment">Currently around 1000+ unique users/day on the
website</li>
<li class="fragment">API usage is higher, growing and heavier</li>
</ul>
......@@ -525,110 +501,6 @@ aria-hidden="true">https://helmholtz-blablador.fz-juelich.de</figcaption>
</section>
<section class="slide level1">
<h2 id="api-access">API Access</h2>
<ul>
<li class="fragment">Create a token in the <a
href="https://codebase.helmholtz.cloud/-/user_settings/personal_access_tokens">helmholtz
codebase settings - (https://codebase.helmholtz.cloud)</a> with the api
scope</li>
<li class="fragment">Copy the token</li>
<li class="fragment">Go to <a
href="https://helmholtz-blablador.fz-juelich.de:8000/docs">https://helmholtz-blablador.fz-juelich.de:8000/docs</a></li>
<li class="fragment">Click on Authorize, and paste the token</li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-api">Demo: API</h2>
<p><img data-src="images/fastapi-main.png" /></p>
</section>
<section class="slide level1">
<h2 id="demo-api-1">Demo: API</h2>
<p><img data-src="images/fastapi-authorize.png" /></p>
</section>
<section class="slide level1">
<h2 id="demo-api-2">Demo: API</h2>
<ul>
<li class="fragment">Go to /v1/models</li>
<li class="fragment">Click on Try it out</li>
<li class="fragment">Click on Execute</li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-api-3">Demo: API</h2>
<p><img data-src="images/fastapi-models.png" /></p>
</section>
<section class="slide level1">
<h2 id="demo-curl">Demo: cURL</h2>
<ul>
<li class="fragment"><div class="sourceCode" id="cb1"><pre
class="sourceCode bash"><code class="sourceCode bash"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a><span class="ex">curl</span> <span class="at">--header</span> <span class="st">&quot;Authorization: Bearer MY_TOKEN_GOES_HERE&quot;</span> https://helmholtz-blablador.fz-juelich.de:8000/v1/models</span></code></pre></div></li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-vscode-continue.dev">Demo: VScode + Continue.dev</h2>
<ul>
<li class="fragment">Yes. It DOES run with Emacs too. Ask your favorite
Emacs expert.</li>
<li class="fragment">Yes, vim too!</li>
<li class="fragment">Add <a
href="https://marketplace.visualstudio.com/items?itemName=Continue.continue">continue.dev</a>
extension to VSCode</li>
<li class="fragment">On Continue, choose to add model, choose Other
OpenAI-compatible API</li>
<li class="fragment">Click in Open Config.json at the end</li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-vscode-continue.dev-1">Demo: VScode + Continue.dev</h2>
<p><img data-src="images/continue-add-model.png" height="600" /></p>
</section>
<section class="slide level1">
<h2 id="demo-vscode-continue.dev-2">Demo: VScode + Continue.dev</h2>
<ul>
<li class="fragment"><p>Inside config.json, add at the
<code>"models"</code> section:</p></li>
<li class="fragment"><div class="sourceCode" id="cb2"><pre
class="sourceCode json"><code class="sourceCode json"><span id="cb2-1"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a> <span class="fu">{</span></span>
<span id="cb2-2"><a href="#cb2-2" aria-hidden="true" tabindex="-1"></a> <span class="dt">&quot;model&quot;</span><span class="fu">:</span> <span class="st">&quot;AUTODETECT&quot;</span><span class="fu">,</span></span>
<span id="cb2-3"><a href="#cb2-3" aria-hidden="true" tabindex="-1"></a> <span class="dt">&quot;title&quot;</span><span class="fu">:</span> <span class="st">&quot;Blablador&quot;</span><span class="fu">,</span></span>
<span id="cb2-4"><a href="#cb2-4" aria-hidden="true" tabindex="-1"></a> <span class="dt">&quot;apiKey&quot;</span><span class="fu">:</span> <span class="st">&quot;glpat-YOURKEYHERE&quot;</span><span class="fu">,</span></span>
<span id="cb2-5"><a href="#cb2-5" aria-hidden="true" tabindex="-1"></a> <span class="dt">&quot;apiBase&quot;</span><span class="fu">:</span> <span class="st">&quot;https://helmholtz-blablador.fz-juelich.de:8000/v1&quot;</span><span class="fu">,</span></span>
<span id="cb2-6"><a href="#cb2-6" aria-hidden="true" tabindex="-1"></a> <span class="dt">&quot;provider&quot;</span><span class="fu">:</span> <span class="st">&quot;openai&quot;</span></span>
<span id="cb2-7"><a href="#cb2-7" aria-hidden="true" tabindex="-1"></a> <span class="fu">}</span></span></code></pre></div></li>
<li class="fragment"><p>Try with the other models you got from the
API!</p></li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-vscode-continue.dev-3">Demo: VScode + Continue.dev</h2>
<ul>
<li class="fragment">Select some code in a python file</li>
<li class="fragment">Type Control-I (cmd-I on Mac) to edit the code, or
Control-L to “talk” to blablador about this code</li>
<li class="fragment">Ask Blablador to explain this code!</li>
<li class="fragment">Can also fix, add tests, etc</li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-vscode-continue.dev-4">Demo: VScode + Continue.dev</h2>
<p><img data-src="images/continue-ask-code.png" /></p>
</section>
<section id="what-can-you-do-with-it" class="slide level1">
<h1>What can <em><em>you</em></em> do with it?</h1>
<p><img data-src="images/blablador-uncle-sam.png" /></p>
</section>
<section class="slide level1">
<h2 id="its-being-used-in-the-wild">It’s being used in the wild!</h2>
<figure>
<img data-src="images/peter-steinbach-blablador-talk-lips-2024.png"
......@@ -641,18 +513,36 @@ aria-hidden="true">https://indico.desy.de/event/38849/contributions/162118/</fig
<figure>
<img data-src="images/kostunin-lips2024.png"
alt="Dmitriy Kostunin’s talk earlier today at LIPS24" />
<figcaption aria-hidden="true">Dmitriy Kostunin’s talk earlier today at
alt="Dmitriy Kostunin’s talk at LIPS24" />
<figcaption aria-hidden="true">Dmitriy Kostunin’s talk at
LIPS24</figcaption>
</figure>
</section>
<section class="slide level1">
<figure>
<img data-src="images/kostunin-adass2024.png"
alt="Controlling a radiotelescope with AI agents" />
<figcaption aria-hidden="true">Controlling a radiotelescope with AI
agents</figcaption>
</figure>
</section>
<section class="slide level1">
<figure>
<img data-src="images/kostunin-adass2024-2.png"
alt="Controlling a radiotelescope with AI agents" />
<figcaption aria-hidden="true">Controlling a radiotelescope with AI
agents</figcaption>
</figure>
</section>
<section class="slide level1">
<figure>
<img data-src="images/cosmosage.png"
alt="cosmosage is deployed on Blablador as of today!" />
<figcaption aria-hidden="true">cosmosage is deployed on Blablador as of
today!</figcaption>
alt="cosmosage is deployed on Blablador!" />
<figcaption aria-hidden="true">cosmosage is deployed on
Blablador!</figcaption>
</figure>
</section>
<section class="slide level1">
......@@ -752,8 +642,7 @@ href="https://github.com/haesleinhuepf/bia-bob/blob/main/README.md">https://gith
<ul>
<li class="fragment">Multi-modal models (text+image, text+audio,
etc)</li>
<li class="fragment">Auto-RAG with privacy: don’t upload pdf, vector
database in browser’s ram
<li class="fragment">Auto-RAG with privacy:
<ul>
<li class="fragment">Easy to do badly. Hard to do securely.</li>
</ul></li>
......@@ -766,11 +655,144 @@ database in browser’s ram
</section>
<section class="slide level1">
<h2 id="extra-slides">Extra slides</h2>
</section>
<section class="slide level1">
<blockquote>
<p>“I think the complexity of Python package management holds down AI
application development more than is widely appreciated. AI faces
multiple bottlenecks — we need more GPUs, better algorithms, cleaner
data in large quantities. But when I look at the day-to-day work of
application builders, there’s one additional bottleneck that I think is
underappreciated: The time spent wrestling with version management is an
inefficiency I hope we can reduce.”</p>
</blockquote>
<p>Andrew Ng, 28.02.2024</p>
</section>
<section class="slide level1">
<blockquote>
<p>“Building on top of open source can mean hours wrestling with package
dependencies, or sometimes even juggling multiple virtual environments
or using multiple versions of Python in one application. This is
annoying but manageable for experienced developers, but creates a lot of
friction for new AI developers entering our field without a background
in computer science or software engineering.”</p>
</blockquote>
<p>Andrew Ng, 28.02.2024</p>
</section>
<section class="slide level1">
<h2 id="api-access">API Access</h2>
<ul>
<li class="fragment">Create a token in the <a
href="https://codebase.helmholtz.cloud/-/user_settings/personal_access_tokens">helmholtz
codebase settings - (https://codebase.helmholtz.cloud)</a> with the api
scope</li>
<li class="fragment">Copy the token</li>
<li class="fragment">Go to <a
href="https://api.helmholtz-blablador.fz-juelich.de/docs">https://api.helmholtz-blablador.fz-juelich.de/docs</a></li>
<li class="fragment">Click on Authorize, and paste the token</li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-api">Demo: API</h2>
<p><img data-src="images/fastapi-main.png" /></p>
</section>
<section class="slide level1">
<h2 id="demo-api-1">Demo: API</h2>
<p><img data-src="images/fastapi-authorize.png" /></p>
</section>
<section class="slide level1">
<h2 id="demo-api-2">Demo: API</h2>
<ul>
<li class="fragment">Go to /v1/models</li>
<li class="fragment">Click on Try it out</li>
<li class="fragment">Click on Execute</li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-api-3">Demo: API</h2>
<p><img data-src="images/fastapi-models.png" /></p>
</section>
<section class="slide level1">
<h2 id="demo-curl">Demo: cURL</h2>
<ul>
<li class="fragment"><div class="sourceCode" id="cb1"><pre
class="sourceCode bash"><code class="sourceCode bash"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a><span class="ex">curl</span> <span class="at">--header</span> <span class="st">&quot;Authorization: Bearer MY_TOKEN_GOES_HERE&quot;</span> https://api.helmholtz-blablador.fz-juelich.de/v1/models</span></code></pre></div></li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-vscode-continue.dev">Demo: VScode + Continue.dev</h2>
<ul>
<li class="fragment">Yes. It DOES run with Emacs too. Ask your favorite
Emacs expert.</li>
<li class="fragment">Yes, vim too!</li>
<li class="fragment">Add <a
href="https://marketplace.visualstudio.com/items?itemName=Continue.continue">continue.dev</a>
extension to VSCode</li>
<li class="fragment">On Continue, choose to add model, choose Other
OpenAI-compatible API</li>
<li class="fragment">Click in Open Config.json at the end</li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-vscode-continue.dev-1">Demo: VScode + Continue.dev</h2>
<p><img data-src="images/continue-add-model.png" height="600" /></p>
</section>
<section class="slide level1">
<h2 id="demo-vscode-continue.dev-2">Demo: VScode + Continue.dev</h2>
<ul>
<li class="fragment"><p>Inside config.json, add at the
<code>"models"</code> section:</p></li>
<li class="fragment"><div class="sourceCode" id="cb2"><pre
class="sourceCode json"><code class="sourceCode json"><span id="cb2-1"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a> <span class="fu">{</span></span>
<span id="cb2-2"><a href="#cb2-2" aria-hidden="true" tabindex="-1"></a> <span class="dt">&quot;model&quot;</span><span class="fu">:</span> <span class="st">&quot;AUTODETECT&quot;</span><span class="fu">,</span></span>
<span id="cb2-3"><a href="#cb2-3" aria-hidden="true" tabindex="-1"></a> <span class="dt">&quot;title&quot;</span><span class="fu">:</span> <span class="st">&quot;Blablador&quot;</span><span class="fu">,</span></span>
<span id="cb2-4"><a href="#cb2-4" aria-hidden="true" tabindex="-1"></a> <span class="dt">&quot;apiKey&quot;</span><span class="fu">:</span> <span class="st">&quot;glpat-YOURKEYHERE&quot;</span><span class="fu">,</span></span>
<span id="cb2-5"><a href="#cb2-5" aria-hidden="true" tabindex="-1"></a> <span class="dt">&quot;apiBase&quot;</span><span class="fu">:</span> <span class="st">&quot;https://helmholtz-blablador.fz-juelich.de:8000/v1&quot;</span><span class="fu">,</span></span>
<span id="cb2-6"><a href="#cb2-6" aria-hidden="true" tabindex="-1"></a> <span class="dt">&quot;provider&quot;</span><span class="fu">:</span> <span class="st">&quot;openai&quot;</span></span>
<span id="cb2-7"><a href="#cb2-7" aria-hidden="true" tabindex="-1"></a> <span class="fu">}</span></span></code></pre></div></li>
<li class="fragment"><p>Try with the other models you got from the
API!</p></li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-vscode-continue.dev-3">Demo: VScode + Continue.dev</h2>
<ul>
<li class="fragment">Select some code in a python file</li>
<li class="fragment">Type Control-I (cmd-I on Mac) to edit the code, or
Control-L to “talk” to blablador about this code</li>
<li class="fragment">Ask Blablador to explain this code!</li>
<li class="fragment">Can also fix, add tests, etc</li>
</ul>
</section>
<section class="slide level1">
<h2 id="demo-vscode-continue.dev-4">Demo: VScode + Continue.dev</h2>
<p><img data-src="images/continue-ask-code.png" /></p>
</section>
<section id="what-can-you-do-with-it" class="slide level1">
<h1>What can <em><em>you</em></em> do with it?</h1>
<p><img data-src="images/blablador-uncle-sam.png" /></p>
</section>
<section class="slide level1">
<h2 id="like-the-slides-want-to-use-them">Like the slides? Want to use
them?</h2>
<p>Gitlab link to source code of the slides (needs JUDOOR account)</p>
<p><a
href="https://gitlab.jsc.fz-juelich.de/strube1/2024-08-talk-euro-scipy">https://gitlab.jsc.fz-juelich.de/strube1/2024-08-talk-euro-scipy</a></p>
href="https://gitlab.jsc.fz-juelich.de/strube1/2024-12-talk-jsc-colloquium">https://gitlab.jsc.fz-juelich.de/strube1/2024-12-talk-jsc-colloquium</a></p>
</section>
<section class="slide level1">
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment