Machine Learning & AI fundamentals
Build a transformer-based LLM from scratch using Python and PyTorch. Master tokenization, positional encodings, multi-head self-attention, and autoregressive model training.
Learn how to fine-tune an LLM (DistilGPT-2) from scratch using Python and Hugging Face Transformers. Covers tokenization, dataset preparation, Trainer API training, and inference.