Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94

Ilya Sutskever is the co-founder of OpenAI, is one of the most cited computer scientist in history with over 165,000 citations, and to me, is one of the most brilliant and insightful minds ever in the field of deep learning. There are very few people in this world who I would rather talk to and brainstorm with about deep learning, intelligence, and life than Ilya, on and off the mic.

Support this podcast by signing up with these sponsors:
Cash App - use code "LexPodcast" and download:
Cash App (App Store): https://apple.co/2sPrUHe
Cash App (Google Play): https://bit.ly/2MlvP5w

EPISODE LINKS:
Ilya's Twitter:   / ilyasut  
Ilya's Website: https://www.cs.toronto.edu/~ilya/

PODCAST INFO:
Podcast website:
https://lexfridman.com/podcast
Apple Podcasts:
https://apple.co/2lwqZIr
Spotify:
https://spoti.fi/2nEwCF8
RSS:
https://lexfridman.com/feed/podcast/
Full episodes playlist:
   • Lex Fridman Podcast  
Clips playlist:
   • Lex Fridman Podcast Clips  

OUTLINE:
0:00 - Introduction
2:23 - AlexNet paper and the ImageNet moment
8:33 - Cost functions
13:39 - Recurrent neural networks
16:19 - Key ideas that led to success of deep learning
19:57 - What's harder to solve: language or vision?
29:35 - We're massively underestimating deep learning
36:04 - Deep double descent
41:20 - Backpropagation
42:42 - Can neural networks be made to reason?
50:35 - Long-term memory
56:37 - Language models
1:00:35 - GPT-2
1:07:14 - Active learning
1:08:52 - Staged release of AI systems
1:13:41 - How to build AGI?
1:25:00 - Question to AGI
1:32:07 - Meaning of life

CONNECT:
Subscribe to this YouTube channel
Twitter:   / lexfridman  
LinkedIn:   / lexfridman  
Facebook:   / lexfridmanpage  
Instagram:   / lexfridman  
Medium:   / lexfridman  
Support on Patreon:   / lexfridman