ClickHouse Data Integration — September 2020 Meetup Report
Our last ClickHouse SF Bay Area meetup was on September 10th and focused on data integration. This turned out to be a popular subject. We had well over 100 signups with 59 people in attendance.[...]
Read MoreWebinar: Adding Fast Analytics to MySQL Applications with ClickHouse
October 10 , 2019
with Robert Hodges
Successful MySQL applications have a very common scale problem: how to provide analytics when data grows too large for MySQL to handle. Fortunately, there is a good answer. ClickHouse is a popular, open source column store you can use to add fast analytics to MySQL applications. We'll start with an introduction to ClickHouse for MySQL users showing familiar SQL syntax and table engine design. We'll then walk through important features like support for MySQL wire protocol, ability to read data directly from MySQL tables, and different ways to move data from MySQL into ClickHouse. Finally, we'll touch on design approaches that allow you to extend MySQL applications with analytics that can handle billions of rows.
Watch here
ClickHouse and ProxySQL queries rewrite
ProxySQL is a popular open source, high performance and protocol-aware proxy server for MySQL and its forks. Since September 2017 ProxySQL supports ClickHouse as a backend, so clients can connect to ClickHouse via MySQL protocol. In practice, this helps MySQL-aware applications to start using ClickHouse as without changes in the client library.
To avoid some limitations to this approach, ProxySQL creator René Cannaò added additional functionality for query rewrite. With his permission, we cross-post his article describing new functionality in our blog.
Read MoreRealtime replication from MySQL to ClickHouse in practice
July 2, 2018
Vladislav Klimenko from Altinity and Valery Panov from Ivinco presented a talk at HighLoad Siberia 2018 conference recently. They described the real problem that Ivinco faced and how it has been solved with migration of analytics from MySQL into ClickHouse using MySQL to ClickHouse replication. A few months ago we introduced clickhouse-mysql tool in our blog, and Ivinco was the first company we know that tried it and used it in production.
Analyze MySQL Audit Logs with ClickHouse and ClickTail
In this blog post, I’ll look at how you can analyze MySQL audit logs (Percona Server for MySQL) with ClickHouse and ClickTail. Audit logs are available with a free plugin for Percona Server for MySQL. Besides providing insights about activity on your server, you might need the logs for compliance purposes.
Read MoreArchiving MySQL Tables in ClickHouse
Why Archive? Hard drives are cheap nowadays, but storing lots of data in MySQL is not practical and can cause all sorts of performance bottlenecks.
In this article Percona's blogger Alexander Rubin is talking about archiving MySQL tables in ClickHouse for storage and analytics.
Read MoreAggregate MySQL data at high speed with ClickHouse
Feb 12, 2018
There are multiple ways how ClickHouse and MySQL can work together. External Dictionaries, ProxySQL support or [realtime streaming] of MySQL binary logs into ClickHouse. A few weeks ago ClickHouse team has released mysql() table function that allows to access MySQL data directly from ClickHouse. This opens up a number of interesting capabilities. Accidentally we have found [a blog article in Japanese] by Mikage Sawatari? , that tests a new way of integration and translated it for our blog with some minor edits.
MySQL to ClickHouse data migration and replication
Altinity has developed an open source clickhouse-mysql tool that helps to migrate existing MySQL table to ClickHouse and setup realtime replication of changes (INSERTS only). Here we review necessary steps using a simple example.
Read More