Fabric Monday 55: Pipelines High Concurrency to Save Your Time and Money
Автор: Dennes Torres
Загружено: 2024-10-08
Просмотров: 381
When working with Microsoft Fabric pipelines, you don’t want your notebooks sitting in a queue, one after another. That’s where High Concurrency for Notebooks comes in.
By enabling this feature, your pipeline can:
🔹 Execute multiple notebooks in parallel within the same activity
🔹 Maximize resource usage by assigning the same session for the notebooks
🔹 Dramatically reduce pipeline runtime — which means lower costs and faster results
Think of it as upgrading your data factory line: instead of processing items one by one, you open up multiple production lanes that keep everything moving smoothly.
💡 The best part? You can activate this with just a setting in your pipeline — no redesign, no extra coding.
Chapters
00:00 Introduction
00:10 Start
00:29 Explaining the Sample Pipeline
01:35 Independent Sessions Explanation
03:05 High Concurrency for Pipelines changing session behaviour
03:42 Enabling High Concurrence for multiple notebooks in pipeline
04:10 Session Tag configuration
05:30 Execution Time Comparison using High Concurrency
Let's connect
============
MMDPUG Meetup: https://www.meetup.com/MMDPUG/
MMDPUG Facebook Page : https://tinyurl.com/MMDPUGPAGE
MMDPUG Facebook Group : https://tinyurl.com/MMDPUGGROUP
LinkedIn: / dennestorres
Twitter: / dennes
What's App Group: https://tinyurl.com/MMDPUGCHAT
Email: dennes@bufaloinfo.com.br
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
