1 YAML file is ALL your need to start your data stack

I've been running two small data pipeline projects for a while with this setup and wanted to take the idea further. I'll continue experimenting, focusing on simplicity.

I hope it inspires some of you!

📓 Resources
The MAD data landscape used in the intro : https://mattturck.com/mad2024/
Code example 1 : https://github.com/mehd-io/duckdb-ext...
Code example 2 : https://github.com/mehd-io/pypi-duck-...

✍️Follow me there for written content:
➡️Blog : https://mehdio.com/blog
➡️LinkedIn :   / mehd-io  
➡️Bluesky : https://bsky.app/profile/mehdio.com
➡️X/Twitter : https://x.com/mehd_io

0:00 A modern data stack is complex!
01:12 CI/CD Tools for data pipelines
02:39 Code example 1
04:44 Code example 2
08:18 Monitoring
09:35 Pricing & Limits
11:28 Outro

#devops #dataengineering #githubactions #github #datapipelines