Second Order Optimization - The Math of Intelligence #2

Gradient Descent and its variants are very useful, but there exists an entire other class of optimization techniques that aren't as widely understood. We'll learn about second order method variants, how they compare to first order methods, and implement our own in Python.

Code for this video (with challenge):
https://github.com/llSourcell/Second_...

Alberto's Winning Code:
https://github.com/alberduris

Ivan's Runner up Code:
https://github.com/PiaFraus

Please Subscribe! And like. And comment. That's what keeps me going.

Course Syllabus:
https://github.com/llSourcell/The_Mat...

More learning resources:
https://web.stanford.edu/class/msande...
https://www.cs.toronto.edu/~hinton/cs...
https://www.quora.com/In-mathematical...
https://en.wikipedia.org/wiki/Newton%...
   • (ML 15.1) Newton's method (for optimizatio...  
   • (ML 15.2) Newton's method (for optimizatio...  

Join us in the Wizards Slack channel:
http://wizards.herokuapp.com/

And please support me on Patreon:
https://www.patreon.com/user?u=3191693
Follow me:
Twitter:   / sirajraval  
Facebook:   / sirajology   Instagram:   / sirajraval   Instagram:   / sirajraval  
Signup for my newsletter for exciting updates in the field of AI:
https://goo.gl/FZzJ5w
Hit the Join button above to sign up to become a member of my channel for access to exclusive content! Join my AI community: Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available): https://www.wagergpt.xyz