Популярное

Музыка Кино и Анимация Автомобили Животные Спорт Путешествия Игры Юмор

Интересные видео

2025 Сериалы Трейлеры Новости Как сделать Видеоуроки Diy своими руками

Топ запросов

смотреть а4 schoolboy runaway турецкий сериал смотреть мультфильмы эдисон
dTub
Скачать

Building a hybrid data pipeline using Kafka and Confluent

Автор: Google Cloud Tech

Загружено: 2020-09-15

Просмотров: 2832

Описание:

Building a data pipeline on Google Cloud is one of the most common things customers do. Increasingly, customers want to build these data pipelines across hybrid infrastructures. Using Apache Kafka as a way to stream data across hybrid and multi-region infrastructures is a common pattern to create a consistent data fabric. Using Kafka and Confluent allows customers to integrate legacy systems and Google services like BigQuery and Dataflow in real time.

Learn how to build a robust, extensible data pipeline starting on-premises by streaming data from legacy systems into Kafka using the Kafka Connect framework.

This session highlights how to easily replicate streaming data from an on-premises Kafka cluster to Google Cloud Kafka cluster. Doing this integrates legacy applications and analytics in the cloud, using different Google services like AI Platform, AutoML, and BigQuery.

Speakers: Sarthak Gangopadhyay, Josh Treichel

Watch more:
Google Cloud Next ’20: OnAir → https://goo.gle/next2020

Subscribe to the GCP Channel → https://goo.gle/GCP

#GoogleCloudNext

DA211



event: Google Cloud Next 2020; re_ty: Publish; product: Cloud - Data Analytics - Dataflow, Cloud - Data Analytics - BigQuery; fullname: Sarthak Gangopadhyay, Josh Treichel;

Building a hybrid data pipeline using Kafka and Confluent

Поделиться в:

Доступные форматы для скачивания:

Скачать видео mp4

  • Информация по загрузке:

Скачать аудио mp3

Похожие видео

array(10) { [0]=> object(stdClass)#5137 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "g6Fmrmh8C20" ["related_video_title"]=> string(96) "Managed Airflow Instance with Google Cloud Composer | Product Spotlight | Google Cloud Platform" ["posted_time"]=> string(21) "3 года назад" ["channelName"]=> string(12) "Sushil Kumar" } [1]=> object(stdClass)#5110 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "PRvUVVCVIUI" ["related_video_title"]=> string(69) "From Kafka to BigQuery – Ofir Sharony, Kafka Summit London 2018" ["posted_time"]=> string(19) "6 лет назад" ["channelName"]=> string(12) "Ofir Sharony" } [2]=> object(stdClass)#5135 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "hbseyn-CfXY" ["related_video_title"]=> string(74) "Лучший Гайд по Kafka для Начинающих За 1 Час" ["posted_time"]=> string(28) "11 месяцев назад" ["channelName"]=> string(14) "Vlad Mishustin" } [3]=> object(stdClass)#5142 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "tIyibb4Dc_M" ["related_video_title"]=> string(101) "Creating a free trial marketing strategy that works - Alan Hwang & Mike Nierengarten | PLGTM 2025" ["posted_time"]=> string(21) "7 дней назад" ["channelName"]=> string(42) "PLGTM - The only event for product-led GTM" } [4]=> object(stdClass)#5121 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "-AZOi3kP9Js" ["related_video_title"]=> string(27) "Про Kafka (основы)" ["posted_time"]=> string(21) "4 года назад" ["channelName"]=> string(41) "Владимир Богдановский" } [5]=> object(stdClass)#5139 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "_mfs4RANcc8" ["related_video_title"]=> string(100) "From ETL to Automation: Leveraging DBT, BigQuery, CI/CD and Airflow - Anima Acharya|GDG Sydney Jun25" ["posted_time"]=> string(25) "2 недели назад" ["channelName"]=> string(10) "GDG Sydney" } [6]=> object(stdClass)#5134 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "blWdjRUPP6E" ["related_video_title"]=> string(72) "Разведчик о том, как использовать людей" ["posted_time"]=> string(25) "3 недели назад" ["channelName"]=> string(18) "Коллектив" } [7]=> object(stdClass)#5144 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "d4cu_rzv4A8" ["related_video_title"]=> string(57) "GCP Cloud Composer Introduction | Airflow managed service" ["posted_time"]=> string(21) "2 года назад" ["channelName"]=> string(26) "Anjan GCP Data Engineering" } [8]=> object(stdClass)#5120 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "8fNnqshJ2Nw" ["related_video_title"]=> string(34) "Protect data with authorized views" ["posted_time"]=> string(21) "4 года назад" ["channelName"]=> string(17) "Google Cloud Tech" } [9]=> object(stdClass)#5138 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "YtbfPlvHcEs" ["related_video_title"]=> string(60) "Data Warehouse Modernization with Confluent and Google Cloud" ["posted_time"]=> string(21) "3 года назад" ["channelName"]=> string(9) "Confluent" } }
Managed Airflow Instance with Google Cloud Composer |  Product Spotlight | Google Cloud Platform

Managed Airflow Instance with Google Cloud Composer | Product Spotlight | Google Cloud Platform

From Kafka to BigQuery – Ofir Sharony, Kafka Summit London 2018

From Kafka to BigQuery – Ofir Sharony, Kafka Summit London 2018

Лучший Гайд по Kafka для Начинающих За 1 Час

Лучший Гайд по Kafka для Начинающих За 1 Час

Creating a free trial marketing strategy that works - Alan Hwang & Mike Nierengarten | PLGTM 2025

Creating a free trial marketing strategy that works - Alan Hwang & Mike Nierengarten | PLGTM 2025

Про Kafka (основы)

Про Kafka (основы)

From ETL to Automation: Leveraging DBT, BigQuery, CI/CD and Airflow - Anima Acharya|GDG Sydney Jun25

From ETL to Automation: Leveraging DBT, BigQuery, CI/CD and Airflow - Anima Acharya|GDG Sydney Jun25

Разведчик о том, как использовать людей

Разведчик о том, как использовать людей

GCP Cloud Composer Introduction | Airflow managed service

GCP Cloud Composer Introduction | Airflow managed service

Protect data with authorized views

Protect data with authorized views

Data Warehouse Modernization with Confluent and Google Cloud

Data Warehouse Modernization with Confluent and Google Cloud

© 2025 dtub. Все права защищены.



  • Контакты
  • О нас
  • Политика конфиденциальности



Контакты для правообладателей: [email protected]