Lecture 8.1 - Tokenization and embeddings

The first step in transformer architectures is converting raw data into input tokens and encoding them as dense embeddings. We'll give a brief outline of the most commonly used techniques, especially for text data.