Delivering Better S3 Support in ClickHouse

Delivering Better S3 Support in ClickHouse

S3-compatible object storage support is critical for ClickHouse applications. There is a new community proposal to make it much better.

What’s Up with Parquet Performance in ClickHouse?

What’s Up with Parquet Performance in ClickHouse?

Supported in ClickHouse, Apache Parquet has use cases other than just a storage format in the Hadoop ecosystem. See what results we got when we tested it in Altinity.Cloud to query Parquet files at S3 with the same efficiency as with MergeTree tables.

Loading 100B Rows in Minutes in Altinity.Cloud

Loading 100B Rows in Minutes in Altinity.Cloud

A few weeks ago the SingleStore team published interesting research in their blog. They demonstrated how to load 100 billion rows in a database in 10 minutes. While it did not seem outstanding for ClickHouse, we were intrigued to learn how much faster we can accomplish the same task, so we conducted some experiments in Altinity.Cloud.

Ultra-Fast Data Loading and Testing in Altinity.Cloud

Ultra-Fast Data Loading and Testing in Altinity.Cloud

Learn how you can load and test ClickHouse datasets with lightning speed and leverage the power of cloud operation with this Altinity.Cloud tutorial. PS…You’ll find it’s really easy too!

Tips for High-Performance ClickHouse Clusters with S3 Object Storage

Tips for High-Performance ClickHouse Clusters with S3 Object Storage

ClickHouse often runs in a cluster, and cluster operation poses some interesting questions regarding S3 usage. They include parallelizing data load across nodes, benefits of horizontal vs. vertical scaling, and avoiding unnecessary replication. In this article, we will discuss how ClickHouse clusters can be used with S3 efficiently thanks to two important new features: the ‘s3Cluster‘ table function and zero-copy replication.

ClickHouse Object Storage Performance: MinIO vs. AWS S3

ClickHouse Object Storage Performance: MinIO vs. AWS S3

ClickHouse now fully supports both AWS S3 and MinIO as S3-compatible object storage services. In this comparison, we will test the performance of AWS S3 and MinIO when used to store table data from two of our standard datasets: the OnTime dataset; and the New York Taxi dataset.

Integrating ClickHouse with MinIO

Integrating ClickHouse with MinIO

In November 2020, Alexander Zaitsev introduced S3-compatible object storage compatibility with ClickHouse. In his article ClickHouse and S3 Compatible Object Storage, he provided steps to use AWS S3 with ClickHouse’s disk storage system and the S3 table function. Now, we are excited to announce full support for integrating with MinIO, ClickHouse’s second fully supported S3-compatible[…]

ClickHouse and S3 Compatible Object Storage

ClickHouse and S3 Compatible Object Storage

ClickHouse is a polyglot database that can talk to many external systems using dedicated engines or table functions. In modern cloud systems, the most important external system is object storage. It can hold raw data to import from or export to other systems (aka a data lake) and offer cheap and highly durable storage for table data. ClickHouse now supports both of these uses for S3 compatible object storage.