Update minutes Journal Club 21 09 2020 authored by Susanne Wenzel's avatar Susanne Wenzel
[[Home](Home)] [[Activities](JULAIN Activities)][[Journal Club](JULAIN Journal Club)]
---
# JULAIN journal club, 21 Sept 2020
......@@ -74,3 +77,6 @@ People try to already do this, for instance: "Deep Transformer Models for Time S
* MinGPT: minimal PyTorch implementation, https://github.com/karpathy/minGPT
* HuggingFace: https://github.com/huggingface/transformers, this is more for fine-tuning pre-trained transformers for NLP or training them from scratch.
They also have a tokenization library https://github.com/huggingface/tokenizers, which implements Byte-Pair encoding (see above) among other methods.
---
[[Home](Home)] [[Activities](JULAIN Activities)][[Journal Club](JULAIN Journal Club)]
\ No newline at end of file