Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment

In terms of the depth and range of topics, this episode is the best I’ve done. No part of my worldview is the same after talking with Carl Shulman. He's the most interesting intellectual you've never heard of. We ended up talking for 8 hours, so I'm splitting this episode into 2 parts. This part is about Carl’s model of an intelligence explosion, which integrates everything from:
how fast algorithmic progress & hardware improvements in AI are happening,
what primate evolution suggests about the scaling hypothesis,
how soon before AIs could do large parts of AI research themselves, and whether there would be faster and faster doublings of AI researchers,
how quickly robots produced from existing factories could take over the economy.

We also discuss the odds of a takeover based on whether the AI is aligned before the intelligence explosion happens, and Carl explains why he’s more optimistic than Eliezer. The next part, which I’ll release next week, is about all the specific mechanisms of an AI takeover, plus a whole bunch of other galaxy brain stuff. Maybe 3 people in the world have thought as rigorously as Carl about so many interesting topics. This was a huge pleasure.

Watch Part 2 here:    • Carl Shulman (Pt 2) — AI Takeover, bio & c...  

𝐄𝐏𝐈𝐒𝐎𝐃𝐄 𝐋𝐈𝐍𝐊𝐒
Transcript: https://www.dwarkeshpatel.com/carl-sh...
Apple Podcasts: https://bit.ly/3P9rPpJ
Spotify: https://bit.ly/42Vnbzb
Follow me on Twitter:   / dwarkesh_sp  
Carl's blog: http://reflectivedisequilibrium.blogs...

𝐓𝐈𝐌𝐄𝐒𝐓𝐀𝐌𝐏𝐒
00:00:00 - Intro
00:00:47 - Intelligence Explosion
00:17:18 - Can AIs do AI research?
00:38:15 - Primate evolution
01:02:45 - Forecasting AI progress
01:33:35 - After human-level AGI
02:08:54 - AI takeover scenarios