ClickHouse
Kubernetes Cluster Logging with the OpenTelemetry Collector and ClickHouse®
Logs may be looked down upon by today’s observability thought leaders, but there is a reason they are the first pillar of observability: there’s a relevant log message at the end of almost every debugging journey! Collecting those logs from applications and infrastructure in a standard format is now trivial thanks to the OpenTelemetry Collector, and we get to keep it in the same format — and potentially the same database — as our other telemetry signals like traces, metrics, and profiles.
In this webinar, we’ll show how to use the OpenTelemetry Collector to gather all application and cluster logs from a Kubernetes cluster. We’ll use ClickHouse to store and query our logs and Grafana to visualize trends. By the end of the session, you’ll have everything you need to standardize your cluster logs on the most forward-looking format available today: OpenTelemetry.
Altinity Administrator Training for ClickHouse®, September 2024 (Session 4 of 4)
Earn your Altinity Certified ClickHouse® Administrator certification in this 8-hour learning series (Four 2-hour sessions over two weeks).
OpenInfra Days North America Talk at Indiana University: Modern Application Debugging: An Introduction to OpenTelemetry
In this talk, Joshua will share his insights and experiences with OpenTelemetry, an open-source project that offers protocols, APIs, and SDKs for collecting metrics, traces, and logs from applications and services. He will cover the comprehensive toolkit provided by the OpenTelemetry community, including language SDKs, the Collector, and the OTLP formats for metrics, traces, and logs.
He will demonstrate how to instrument and monitor a microservices application running on a Kubernetes cluster, utilizing the full potential of OpenTelemetry. Attendees will learn how to use powerful open-source tools like Jaeger and Prometheus to effectively analyze telemetry signals from their applications.
The Doctor Is In–Quick First Aid for Broken ClickHouse® Clusters
Properly managed ClickHouse servers are well-behaved, but every cluster runs into problems at some point.
In this webinar, we'll introduce common issues that require admin intervention or even application changes. Topics include too many connections, too many parts, lost replicas, stuck mutations, and too many detached parts on startup. In each case, we'll explain the problem, show you the symptoms, and give you the standard cures.
There will be extra time for questions, so bring your favorites. We'll be happy to offer opinions.
Open Source Observability Day Talk 2024 – O11y-in-One: ClickHouse as a Unified Telemetry Database
In this talk, Josh from Altinity explores how organizations can simplify their observability stack by using ClickHouse as a unified telemetry database.
Traditionally, separate tools handle metrics, logs, and traces, making data correlation a challenge. Josh discusses the tradeoffs between specialized tools and a unified approach, emphasizing how ClickHouse provides the scalability, performance, and cost-effectiveness needed for modern observability.
Attendees will learn about ClickHouse’s ability to store diverse telemetry data—metrics, logs, traces—and integrate with OpenTelemetry and other observability tools to create a seamless, efficient system for monitoring complex environments.
All Things Open 2024: Fast, Cheap, DIY Observability with Open Source Analytics and Visualization
All Things Open 2024 is a technology conference focusing on the tools, processes, and people making open source possible. THis conference's sophisticated and diverse audience is a technical one that includes designers, developers, decision-makers, entrepreneurs, and technologists of all types and skill levels.
Our CEO, Robert Hodges, will be presenting the talk:
Fast, Cheap, DIY Observability with Open Source Analytics and Visualization
Want to build real-time analytics on big data? Think like a distributed systems engineer! Fast, Faster, Fastest: Object Storage, Cloud Block Storage, and SSD in Analytic Databases Introduction to Real-time Analytics on Kubernetes with ClickHouse.
Dev Fest Atlanta 2024 Talk: Modern Application Debugging: An Introduction to OpenTelemetry
In this talk, Joshua will share his insights and experiences with OpenTelemetry, an open-source project that offers protocols, APIs, and SDKs for collecting metrics, traces, and logs from applications and services. He will cover the comprehensive toolkit provided by the OpenTelemetry community, including language SDKs, the Collector, and the OTLP formats for metrics, traces, and logs.
He will demonstrate how to instrument and monitor a microservices application running on a Kubernetes cluster, utilizing the full potential of OpenTelemetry. Attendees will learn how to use powerful open-source tools like Jaeger and Prometheus to effectively analyze telemetry signals from their applications.
By the end of this session, attendees will have a solid understanding of how to implement OpenTelemetry in their projects, enhancing their debugging and observability practices. Join us as we delve into the world of OpenTelemetry, unlocking the capabilities of this powerful technology for your development needs.
JSConf Mexico 2024: Collect, Ingest, Observe: A New Era for (free) JS Monitoring!
Monitoring JavaScript applications might seem like a formidable challenge, but it's time for a change in perspective. This session is set to demystify the complexities of observability, paving a clear and impactful path to proficiency with OpenTelemetry (OTel) alongside a selection of powerful open-source tools (Grafana & ClickHouse).
Prepare to easily navigate the intricate waters of observability, as we guide you through the essentials of collecting comprehensive telemetry data for insightful visibility into your application's performance and health. We'll explore the synergistic power of OTel and the JavaScript ecosystem, further enhanced by other OSS tools and a real-time DB. This combination will ensure you never miss what is happening within your applications, but what is better: it achieves this without wasting thousands (or even millions) of dollars on third-party services.
Cloud Native Rejekts 2024 Talk: Building an Open Source Observability Stack from Raw Telemetry
We'll dive into integrating OpenTelemetry with tools like GitLab, ArgoCD, ClickHouse, and Grafana to capture, store, and visualize telemetry data.
Whether you're an SRE, DBA, or developer, you'll leave with practical tips for setting up efficient monitoring and ensuring top performance. See you there!
KubeCon & CloudNativeCon Project Lightning Talks 2024 – The OpenTelemetry Hero’s Journey: Working with Open Source Observability
Having correlated metrics, traces, and logs from our services and infrastructure is a vital component of observability.
We will discuss what’s possible with OpenTelemetry and where the gaps are with today’s open-source tools.
KubeCon Observability Day NA 2024 Talk: Where’s the Auto in Auto-Instrumentation? A Look at Current Automation Strategies with OTel
"Automatic Instrumentation” can mean a lot of things depending on context. Whether we discuss the Instrumentation SDKs or full-kernel observability with eBPF, the promise is the same: end-to-end observability coverage with no custom code and minimal setup. First, I will review how the different mechanisms available for automatic instrumentation work within each of the 11 languages supported by OpenTelemetry. I’ll examine:
How code-path instrumentation works at the library level by diving into the Node.js OpenTelemetry Extension and the JavaScript libraries it supports
Automatic instrumentation via attachment with Java and Python
Automatic instrumentation injection using the OTel Operator for DotNet, Java, and NodeJS
Finally, I’ll take a peek at the future of automatic instrumentation of compiled binaries with a look at the Go instrumentation library built using eBPF.
OSA CON 2024 – Register today!
The Open Source Analytics Conference (OSA CON) is the go-to conference for all things open-source analytics. Join the doers of the modern data stack. Want to be part of OSA CON's great speakers? Submit your talk proposals until June 27, 2024.