Fine-tune LLMs 30x faster! With Daniel Han (Unsloth AI)

Become a Patreon:   / theaiepiphany  
👨‍👩‍👧‍👦 Join our Discord community:   / discord  

Daniel Han from Unsloth AI joined us to walk us through his bug-hunting process and how to make LLM fine-tuning 30x faster. :)

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
check out unsloth ai: https://unsloth.ai/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

⌚️ Timetable:
00:00:00 - 00:01:40 Intro
00:01:40 - 00:03:21 Hyperstack GPUs! (sponsored)
00:03:21 - 00:06:30 About Daniel, getting started with ML
00:06:30 - 00:11:00 Using Desmos to check grads
00:11:00 - 00:38:00 Deep dive into Gemma bugs
00:38:00 - 00:50:00 approximate GELU bug
00:50:00 - 00:54:15 What are the bottlenecks to speeding up the runtime?
00:54:15 - 00:58:30 comparison with llm.c?
00:58:30 - 01:00:00 Is multi-GPU coming to Unsloth? :)
01:00:00 - 01:05:19 Reproducibility in ML research

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 SPONSOR

The AI Epiphany -   / theaiepiphany  
One-time donation - https://www.paypal.com/paypalme/theai...

Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar Veličković

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

💼 LinkedIn -   / aleksagordic  
🐦 Twitter -   / gordic_aleksa  
👨‍👩‍👧‍👦 Discord -   / discord  

📺 YouTube -    / theaiepiphany  
📚 Medium -   / gordicaleksa  
💻 GitHub - https://github.com/gordicaleksa
📢 AI Newsletter - https://aiepiphany.substack.com/

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

#unslothai #llms #finetuning #ml