ClickHouse Data Integration — September 2020 Meetup Report

Our last ClickHouse SF Bay Area meetup was on September 10th and focused on data integration. This turned out to be a popular subject.  We had well over 100 signups with 59 people in attendance.[...]

Read More
Webinar: Adding Fast Analytics to MySQL Applications with ClickHouse

October 10 , 2019
with Robert Hodges

Successful MySQL applications have a very common scale problem: how to provide analytics when data grows too large for MySQL to handle. Fortunately, there is a good answer. ClickHouse is a popular, open source column store you can use to add fast analytics to MySQL applications. We'll start with an introduction to ClickHouse for MySQL users showing familiar SQL syntax and table engine design. We'll then walk through important features like support for MySQL wire protocol, ability to read data directly from MySQL tables, and different ways to move data from MySQL into ClickHouse. Finally, we'll touch on design approaches that allow you to extend MySQL applications with analytics that can handle billions of rows.
Watch here

Read More
ClickHouse and ProxySQL queries rewrite

ProxySQL is a popular open source, high performance and protocol-aware proxy server for MySQL and its forks. Since September 2017 ProxySQL supports ClickHouse as a backend, so clients can connect to ClickHouse via MySQL protocol. In practice, this helps MySQL-aware applications to start using ClickHouse as without changes in the client library.

To avoid some limitations to this approach, ProxySQL creator René Cannaò added additional functionality for query rewrite. With his permission, we cross-post his article describing new functionality in our blog.

Read More
Realtime replication from MySQL to ClickHouse in practice

July 2, 2018
Vladislav Klimenko from Altinity and Valery Panov from Ivinco presented a talk at HighLoad Siberia 2018 conference recently. They described the real problem that Ivinco faced and how it has been solved with migration of analytics from MySQL into ClickHouse using MySQL to ClickHouse replication. A few months ago we introduced clickhouse-mysql tool in our blog, and Ivinco was the first company we know that tried it and used it in production.

Read More
Analyze MySQL Audit Logs with ClickHouse and ClickTail

In this blog post, I’ll look at how you can analyze MySQL audit logs (Percona Server for MySQL) with ClickHouse and ClickTail.  Audit logs are available with a free plugin for Percona Server for MySQL. Besides providing insights about activity on your server, you might need the logs for compliance purposes.

Read More
Archiving MySQL Tables in ClickHouse

Why Archive? Hard drives are cheap nowadays, but storing lots of data in MySQL is not practical and can cause all sorts of performance bottlenecks. 

In this article Percona's blogger Alexander Rubin is talking about archiving MySQL tables in ClickHouse for storage and analytics.

Read More
Aggregate MySQL data at high speed with ClickHouse

Feb 12, 2018
There are multiple ways how ClickHouse and MySQL can work together. External Dictionaries, ProxySQL support or [realtime streaming] of MySQL binary logs into ClickHouse. A few weeks ago ClickHouse team has released mysql() table function that allows to access MySQL data directly from ClickHouse. This opens up a number of interesting capabilities. Accidentally we have found [a blog article in Japanese] by Mikage Sawatari? , that tests a new way of integration and translated it for our blog with some minor edits.

Read More
MySQL to ClickHouse data migration and replication

Altinity has developed an open source clickhouse-mysql tool that helps to migrate existing MySQL table to ClickHouse and setup realtime replication of changes (INSERTS only). Here we review necessary steps using a simple example.

Read More