LLM Training: Superman's Kryptonite-Proof Suit
Update: 2023-05-29
Description
Why isn't Superman's suit Kryptonite-proof? This question reveals how large language models are trained. We break down transformers (the T in GPT), self-attention mechanisms, and the inference process—using Superman to explain why GPT-3 can generate coherent answers to questions it's never seen before. Solo episode on LLM architecture.
To stay in touch, sign up for our newsletter at https://www.superprompt.fm
CommentsÂ
In Channel




