18 Understand DAG, Explain Plans & Spark Shuffle with Tasks |Skipped Stage |Benefit of Shuffle Write
Автор: Ease With Data
Загружено: 2023-11-18
Просмотров: 21926
Video explains - How to read DAG? How to read Explain Plan in Spark? How Spark creates Stages and Tasks ?
Chapters
00:00 - Introduction
00:39 - Example Demonstration
08:59 - Understand DAG
10:25 - Understand Explain Plan
12:04 - Skipped Stages
13:26 - Benefits of Shuffle Write
Local PySpark Jupyter Lab setup - • 03 Setup Docker PySpark Jupyter Lab Enviro...
Python Basics - https://www.learnpython.org/
GitHub URL for code - https://github.com/subhamkharwal/pysp...
The series provides a step-by-step guide to learning PySpark, a popular open-source distributed computing framework that is used for big data processing.
New video in every 3 days ❤️
#spark #pyspark #python #dataengineering
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
