Kubernetes Cluster Logging with the OpenTelemetry Collector and ClickHouse® | Grafana | Open Source

Have questions about ClickHouse®? Get a free consultation with Altinity. No pressure, no sales talk. Just answers to your questions. Book a free help session: https://hubs.la/Q02qr1RZ0

------------------------------------

Logs may be looked down upon by today’s observability thought leaders, but there is a reason they are the first pillar of observability: there’s a relevant log message at the end of almost every debugging journey! Collecting those logs from applications and infrastructure in a standard format is now trivial thanks to the OpenTelemetry Collector, and we get to keep it in the same format — and potentially the same database — as our other telemetry signals like traces, metrics, and profiles.

In this webinar, Joshua Lee (Dev Advocate) shows how to use the OpenTelemetry Collector to gather all application and cluster logs from a Kubernetes cluster. He uses ClickHouse to store and query our logs and Grafana to visualize trends. By the end of the session, you’ll have everything you need to standardize your cluster logs on the most forward-looking format available today: OpenTelemetry.

====================
CHAPTERS
====================
0:00 Introduction
3:06 Why logs matter
9:27 Metrics, traces, and logs
10:14 Why do you need application logs?
11:15 Logging in Kubernetes
14:47 Cluster logging is essential
18:00 OpenTelemetry Collector
21:06 Kubernetes resource attributes processor
23:20 Altinity Kubernetes Operator for ClickHouse
26:17 Why ClickHouse for log storage?
28:15 Demo
42:52 Scaling the solution to prod
45:25 Q&A

========================
PRESENTATION SLIDES
========================
https://altinity.com/webinarspage/kub...

==================================
MANAGED CLOUD FOR CLICKHOUSE
==================================
https://altinity.com/managed-clickhouse/

====================
RESOURCES
====================
Altinity Knowledge Base for ClickHouse: https://kb.altinity.com/
Altinity Documentation for ClickHouse: https://docs.altinity.com
Altinity Stable Builds for ClickHouse: https://altinity.com/altinity-stable/
Training for ClickHouse: https://altinity.com/clickhouse-train...
Altinity vs other ClickHouse vendors: https://altinity.com/altinity-cloud-v...

====================
COMMUNITY
====================
🧑🏽‍💻 Join the Community: https://www.altinity.com/slack
🙋🏽 Get Support on Slack: https://www.altinity.com/slack
⭐️ Star on GitHub: https://github.com/Altinity/
🌐 Connect on LI:   / 10955938  
🌐 Follow on 𝕏:   / altinitydb  
🌐 Say Hi on Reddit:   / clickhouse  

#opentelemetry #kubernetes #clickhouse #grafana #datawarehouse #cloud #devops #realtimedata #datalake #databasemanagement #realtimeanalytics #webinar #Altinity #opensource #database