Netflix's Ray Platform: From Deep Learning to GenAI | Ray Summit 2024 Highlight

In this breakout session from Ray Summit 2024, Pablo Delgado of Netflix demonstrates how the company is augmenting its machine learning platform with Ray to meet the demands of the generative AI era. The presentation explores how Netflix is enhancing its large-scale deep learning infrastructure to support the complexities of modern machine learning, including foundation model pre-training, memory-intensive LLM fine-tuning, and low-latency deployments for multi-billion-parameter models.

Delgado walks through Netflix's implementation of Ray for various crucial tasks: large-scale data processing and curation, LLM fine-tuning, foundation model training, and distributed inference. He shares insights into Netflix's strategies for integrating Ray into their existing ML infrastructure, creating a GenAI-ready environment that addresses the needs of the modern deep learning landscape. This session offers valuable perspectives for organizations looking to enhance their own platforms with Ray's capabilities, particularly in the context of a major tech company's production environment.

--

Interested in more?
Watch the full Day 1 Keynote:    • Ray Summit 2024 Keynote Day 1 | Where Buil...  
Watch the full Day 2 Keynote    • Ray Summit 2024 Keynote Day 2 | Where Buil...  

--

🔗 Connect with us:
Subscribe to our YouTube channel:    / @anyscale  
Twitter: https://x.com/anyscalecompute
LinkedIn:   / joinanyscale  
Website: https://www.anyscale.com