NOTE: The event will be held in Central Daylight Time (CDT), UTC -5.

View More Details for Open Source Summit + Embedded Linux Conference North America 2020
Registration Information.
Back To Schedule
Wednesday, July 1 • 12:15pm - 1:05pm
Breaking Out of the Proprietary Cage: Real-time Data Warehouses Come to Open Source - Robert Hodges, Altinity LTD

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
SQL data warehouses are the foundation of high performance analytic solutions on structured information like market tick data or network flow logs. Until recently this type of application has been dominated by proprietary solutions. The situation changed radically with ClickHouse, an Apache 2.0 SQL data warehouse that meets or exceeds performance of Vertica, Redshift, and other closed-source implementations. This talk starts with a quick history of data warehouses including recent open source offerings. We then dive into ClickHouse and study optimizations it uses to achieve record-setting speed. These include compression, vectorized query processing, SIMD instructions, and efficient pre-aggregation through materialized views. Finally we'll show how open source tools like Kafka and Grafana combine with ClickHouse to create complete solutions that offer sub-second response on datasets running into trillions of rows and ingested at millions of events per second. The resulting stack enables users to add real-time analytics to any application without the constraints of proprietary licenses. It's a key open source innovation for the age of big data.

avatar for Robert Hodges

Robert Hodges

CEO, Altinity
Robert Hodges has worked with database systems since 1983, including 20 different DBMS types ranging from pre-relational systems like M204 to MySQL to analytic databases like ClickHouse. He is currently CEO of Altinity.

Wednesday July 1, 2020 12:15pm - 1:05pm CDT
OS Databases Theater