Deep Learning
Neural networks from the ground up, through CNNs, RNNs and transformers.
Expert
Research-level depth and specialist material.
[GRPO Explained] DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
An explainer from Yannic Kilcher on [GRPO Explained] DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models. In-depth material for learners already confident in Deep Learning. It plays here in the portal, and your progress is saved as you watch.
Yannic Kilcher
[Paper Analysis] On the Theoretical Limitations of Embedding-Based Retrieval (Warning: Rant)
A walkthrough of a research paper from Yannic Kilcher on [Paper Analysis] On the Theoretical Limitations of Embedding-Based Retrieval (Warning: Rant). In-depth material for learners already confident in Deep Learning. It plays here in the portal, and your progress is saved as you watch.
Yannic Kilcher
[Paper Analysis] The Free Transformer (and some Variational Autoencoder stuff)
A walkthrough of a research paper from Yannic Kilcher on [Paper Analysis] The Free Transformer (and some Variational Autoencoder stuff). In-depth material for learners already confident in Deep Learning. It plays here in the portal, and your progress is saved as you watch.
Yannic Kilcher
Context Rot: How Increasing Input Tokens Impacts LLM Performance (Paper Analysis)
A walkthrough of a research paper from Yannic Kilcher on Context Rot: How Increasing Input Tokens Impacts LLM Performance (Paper Analysis). In-depth material for learners already confident in Deep Learning. It plays here in the portal, and your progress is saved as you watch.
Yannic Kilcher
Energy-Based Transformers are Scalable Learners and Thinkers (Paper Review)
A walkthrough of a research paper from Yannic Kilcher on Energy-Based Transformers are Scalable Learners and Thinkers (Paper Review). In-depth material for learners already confident in Deep Learning. It plays here in the portal, and your progress is saved as you watch.
Yannic Kilcher
How I use LLMs
A video from Andrej Karpathy on How I use LLMs. In-depth material for learners already confident in Deep Learning. It plays here in the portal, and your progress is saved as you watch.
Andrej Karpathy
TiDAR: Think in Diffusion, Talk in Autoregression (Paper Analysis)
A walkthrough of a research paper from Yannic Kilcher on TiDAR: Think in Diffusion, Talk in Autoregression (Paper Analysis). In-depth material for learners already confident in Deep Learning. It plays here in the portal, and your progress is saved as you watch.
Yannic Kilcher
Titans: Learning to Memorize at Test Time (Paper Analysis)
A walkthrough of a research paper from Yannic Kilcher on Titans: Learning to Memorize at Test Time (Paper Analysis). In-depth material for learners already confident in Deep Learning. It plays here in the portal, and your progress is saved as you watch.
Yannic Kilcher
Neural Networks: Zero to Hero
Karpathy's series that builds neural networks and language models from scratch in code, up to a working GPT.
Andrej Karpathy