OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil

Kevin Weil is the chief product officer at OpenAI, where he oversees the development of ChatGPT, enterprise products, and the OpenAI API. Prior to OpenAI, Kevin was head of product at Twitter, Instagram, and Planet, and was instrumental in the development of the Libra (later Novi) cryptocurrency project at Facebook.

In this episode, you’ll learn:
1. How OpenAI structures its product teams and maintains agility while developing cutting-edge AI
2. The power of model ensembles—using multiple specialized models together like a company of humans with different skills
3. Why writing effective evals (AI evaluation tests) is becoming a critical skill for product managers
4. The surprisingly enduring value of chat as an interface for AI, despite predictions of its obsolescence
5. How “vibe coding” is changing how companies operate
6. What OpenAI looks for when hiring product managers (hint: high agency and comfort with ambiguity)
7. “Model maximalism” and why today’s AI is the worst you’ll ever use again
8. Practical prompting techniques that improve AI interactions, including example-based prompting

Find the transcript at: https://www.lennysnewsletter.com/p/ke...

Brought to you by:
• Eppo—Run reliable, impactful experiments: https://www.geteppo.com/
• Persona—A global leader in digital identity verification: https://withpersona.com/lenny
• OneSchema—Import CSV data 10x faster: OneSchema — Import CSV data 10x faster

Where to find Kevin Weil:
• X: https://x.com/kevinweil
• LinkedIn:   / kevinweil  

Where to find Lenny:
• Newsletter: https://www.lennysnewsletter.com
• X:   / lennysan  
• LinkedIn:   / lennyrachitsky  

In this episode, we cover:
(00:00) Kevin’s background
(05:16) OpenAI’s new image model
(08:13) The role of chief product officer at OpenAI
(11:42) His recruitment story and joining OpenAI
(15:59) Working at OpenAI
(18:44) The importance of evals in AI
(24:40) Opportunities in the space
(26:34) Shipping quickly and consistently
(29:47) Product reviews and iterative deployment
(32:53) Winning consumer awareness
(36:03) Designing thoughtful experiences
(40:56) Chat as an interface for AI
(45:21) Collaboration between researchers and product teams
(48:05) Hiring product managers at OpenAI
(53:06) How OpenAI uses AI: vibe coding, AI prototyping, and more
(01:04:34) Raising kids in an increasingly intelligent AI world
(01:08:07) Why Kevin feels optimistic about our AI future
(01:14:20) The AI model you're using today is the worst AI model you'll ever use
(01:17:58) Reflections on the Libra project
(01:21:51) Lightning round and final thoughts

Referenced:
• OpenAI: https://openai.com/
• The AI-Generated Studio Ghibli Trend, Explained: https://www.forbes.com/sites/danidipl...
• Introducing 4o Image Generation: https://openai.com/index/introducing-...
• Waymo: https://waymo.com/
• X: https://x.com
• Facebook: https://www.facebook.com/
• Instagram: https://www.instagram.com/
• Planet: https://www.planet.com/
• Sam Altman on X: https://x.com/sama
• A conversation with OpenAI’s CPO Kevin Weil, Anthropic’s CPO Mike Krieger, and Sarah Guo:    • A conversation with OpenAI's CPO Kevin Wei...  
• OpenAI evals: https://github.com/openai/evals
• Deep Research: https://openai.com/index/introducing-...
• Ev Williams on X: https://x.com/ev
• OpenAI API: https://platform.openai.com/docs/over...
• Dwight Eisenhower quote: https://www.brainyquote.com/quotes/dw...
• Inside Bolt: From near-death to ~$40m ARR in 5 months—one of the fastest-growing products in history | Eric Simons (founder & CEO of StackBlitz): https://www.lennysnewsletter.com/p/in...
• StackBlitz: https://stackblitz.com/
• Claude 3.5 Sonnet: https://www.anthropic.com/news/claude...
• Anthropic: https://www.anthropic.com/
• Four-minute mile: https://en.wikipedia.org/wiki/Four-mi...
• Chad: https://chatgpt.com/g/g-3F100ZiIe-cha...
• Dario Amodei on LinkedIn:   / dario-amodei-3934934  
• Figma: https://www.figma.com/
• Julia Villagra on LinkedIn:   / juliavillagra  
• Andrej Karpathy on X: https://x.com/karpathy
...References continued at: https://www.lennysnewsletter.com/p/ke...

Recommended books:
• Co-Intelligence: Living and Working with AI: https://www.amazon.com/Co-Intelligenc...
• The Accidental Superpower: Ten Years On: https://www.amazon.com/Accidental-Sup...
• Cable Cowboy: https://www.amazon.com/Cable-Cowboy-M...

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email [email protected].

Lenny may be an investor in the companies discussed.