SDLC with Apache NiFi
Автор: DataWorks Summit
Загружено: 2018-07-12
Просмотров: 8138
Join us as we walk through examples of integrating Apache NiFi into existing enterprise ETL environments. We'll look at how to solve the challenges of integrating a real-time, interactive dataflow tool like NiFi into traditional ETL workflows, touching on common topics like design and deployment, version control, dataset testing, environment variables, and code promotion.
We will demonstrate how to manage changes to your NiFi data flows using SDLC approaches traditionally applied to batch processing scripts. We will walk you through the building blocks of achieving continuous integration and deployment (CI/CD) for your data flows. This includes examples of NiFi automation.
We will cover:
Using the NiFi Command Line Interface (CLI) to script interaction with NiFi and NiFi Registry
Utilizing NiPyApi, a Python module that provides an abstraction for interacting with the NiFi REST API, for advanced automation
Setting up Docker-based integration test environments for NiFi
Lastly, we will demonstrate how to integrate these tools in SDLC workflows for NiFi flow versioning.
Speaker
KEVIN DORAN
Software Developer
Hortonworks
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
