ClickHouse: what is behind the fastest open source columnar database

(Troy Sellers, Olena Kutsenko) An open source columnar database ClickHouse is in many ways exceptional - it is exceptionally fast, exceptionally efficient, but also, at times exceptionally confusing.

Its approach to handling data goes against many principles and concepts that we use in other databases. To give some examples: its primary index doesn't index each row and doesn't guarantee uniqueness; a secondary index is used to skip data and doesn't point to specific rows; JOINS is a complex topic and transactions are supported partially, not to mention that its SQL dialect holds a couple of surprises up its sleeve.

But, all that said, if used correctly, ClickHouse is a superb solution for online analytical processing (OLAP).

The goal of this talk is to help you get the most of ClickHouse and avoid the pitfalls. We'll talk about OLAP and columnar databases. We'll touch topics of indexing, searching and disk storage. We'll look at the reasons behind the most puzzling concepts of ClickHouse, so that by the end of the talk you find them not only logical, but maybe even fascinating.

If your challenge is analysing terabytes of data - this talk is for you. If you're a data scientist looking for tools to work with big data - this talk is for you. And, of course, if you are just curious about what makes ClickHouse crazy fast - this talk is for you as well.

https://2023.everythingopen.au/schedu...

Videos licensed as CC BY-NC-SA 4.0

Everything Open is a conference focused on open technologies, including Linux, open source software, open hardware and open data, and the communities that surround them. The conference provides technical deep-dives as well as updates from industry leaders and experts on a wide array of topics from these areas.

Licensed as CC-BY-SA - http://creativecommons.org/licenses/b...

Produced by Next Day Video Australia: https://nextdayvideo.com.au

#everythingopen #linux.conf.au #linux #foss #opensource

Tue Mar 14 10:45:00 2023 at Clarendon Room D