1 YAML file is ALL your need to start your data stack
Автор: mehdio debugs
Загружено: 2024-12-16
Просмотров: 1808
I've been running two small data pipeline projects for a while with this setup and wanted to take the idea further. I'll continue experimenting, focusing on simplicity.
I hope it inspires some of you!
📓 Resources
The MAD data landscape used in the intro : https://mattturck.com/mad2024/
Code example 1 : https://github.com/mehd-io/duckdb-ext...
Code example 2 : https://github.com/mehd-io/pypi-duck-...
✍️Follow me there for written content:
➡️Blog : https://mehdio.com/blog
➡️LinkedIn : / mehd-io
➡️Bluesky : https://bsky.app/profile/mehdio.com
➡️X/Twitter : https://x.com/mehd_io
0:00 A modern data stack is complex!
01:12 CI/CD Tools for data pipelines
02:39 Code example 1
04:44 Code example 2
08:18 Monitoring
09:35 Pricing & Limits
11:28 Outro
#devops #dataengineering #githubactions #github #datapipelines
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
