Building an Open Source Streaming Analytics Stack with Kafka and Druid - Fangjin Yang,

Building an Open Source Streaming Analytics Stack with Kafka and Druid - Fangjin Yang

The maturation and development of open source technologies has made it easier than ever for companies to derive insights from vast quantities of data. In this session, we will cover how to build a streaming analytics stack using Kafka and Druid. This combination of technologies can power a robust data pipeline that supports real-time and batch ingestion, and flexible, low-latency queries.

Analytics pipelines running purely on batch processing systems can suffer from hours of data lag. Initial attempts to solve this problem often lead to inflexible solutions, where the queries must be known ahead of time, or fragile solutions where the integrity of the data cannot be assured. Combining Kafka, and Druid can guarantee system availability, maintain data integrity, and support fast and flexible queries.

About Fangjin Yang
Fangjin is one of the main committers to the open source Druid project and a co-founder of Imply, a San Francisco technology company. Fangjin previously held senior engineering positions at Metamarkets and Cisco. He holds a BASc in Electrical Engineering and a MASc in Computer Engineering from the University of Waterloo, Canada.