LLM Basics

Understand the fundamental building blocks of Generative AI. This module covers how LLMs work under the hood, from tokenization to the Transformer architecture.

Module Contents

1. What are LLMs?

Understand LLMs as probabilistic engines. Includes a Next Token Prediction simulator.

2. Tokenization

How text becomes numbers. Explore BPE vs Character tokenization with an Interactive Tokenizer Playground.

3. The Transformer Architecture

Dive into the “Attention Is All You Need” paper. Visualize Self-Attention weights interactively.

Review: Flashcards & Cheat Sheet

Test your knowledge with interactive flashcards and a quick reference guide.

Module Chapters

Chapter 03

The Transformer Architecture

[!NOTE] This module explores the core principles of The Transformer Architecture, deriving solutions from first principles and hardware constraints to build world-class, production-ready expertise.

Start Learning