Real-time, Exactly-once Data Ingestion from Kafka to ClickHouse at eBay
eBay depends on Kafka to solve the impedance mismatch between rapidly arriving messages in event streams and efficient block insert into ClickHouse clusters. Naïve loading procedures from Kafka to ClickHouse generate non-deterministic blocks, leading to data loss and incorrect results in applications. Learn how the eBay team solved this problem.