Understanding XGBoost From A to Z!

I often say that I some point in my career, I became more of a XGBoost modeler than a Machine Learning modeler. That's because if you were working on large tabular datasets, there was no point to try another algorithm, it would provide close to optimum results without much effort. Yeah ok, LightGBM and Catboost are obviously as good and sometimes better, but I will always keep a special place in my heart for XGBoost.

So let me show you how this algorithm was put together. In a previous video we looked at how the gradient boosted trees algorithm works, now I am going to show you XGboost improved on it. Doesn't that feel like some fresh air in this GenAI madness. Let's get into it!