how to manage slowly changing dimensions with dlt | Python ETL | SCD Type 2
Автор: BI Insights Inc
Загружено: 2024-09-06
Просмотров: 2165
Are you tired of manually updating your dimensional tables? And managing the changes to dimension tables? We've got the solution for you! We are covering Slowly Changing Dimensions with dlt. What are slowly changing dimensions, you ask? Simply put, they're changes that occur over time in dimension tables, such as Changing employee titles, Merging departments, Updating product categories.
With dlt, you can automate these updates in a breeze! Say goodbye to manual data manipulation and hello to a more streamlined data warehouse.
In this vidoe we use dlt to successfully manage slowly changing dimensions type 2. The result? A robust, scalable, and easy-to-maintain data warehouse that just keeps on growing!
#dlt #SlowlyChangingDimensions #DataWarehouse"
Link to dlt snapshot: https://dlthub.com/blog/scd2-and-incr...
Link to dlt repo :https://github.com/hnawaz007/pythonda...
Link to Channel's site:
https://hnawaz007.github.io/
--------------------------------------------------------------
💥Subscribe to our channel:
/ haqnawaz
📌 Links
-----------------------------------------
#️⃣ Follow me on social media! #️⃣
🔗 GitHub: https://github.com/hnawaz007
📸 Instagram: / bi_insights_inc
📝 LinkedIn: / haq-nawaz
🔗 / hnawaz100
🚀 https://hnawaz007.github.io/
-----------------------------------------
Topics in this video (click to jump around):
==================================
0:00 - Overview of the Slowly Changing Dimensions (SCD)
0:55 - Types of SCDs
2:48 - Build dlt pipeline
3:24 - dlt scd2 configurations
4:07 - Run dlt pipeline
4:47 - Update Source Table
5:09 - Re-run dlt pipeline
5:15 - Review scd2 Updates
6:11 - Final thoughts
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке: