Category: OpenTelemetry

Articles tagged OpenTelemetry

Subscribe
Filters
How we moved the OpenTelemetry Java agent to invokedynamic in 70+ pull requests
Observability Labs

How we moved the OpenTelemetry Java agent to invokedynamic in 70+ pull requests

We did the same migration twice, three years apart, and the second time there were a hundred contributors instead of three. What changes when you rebuild how a Java agent instruments code and nothing in production is allowed to break.

Sylvain Juge
YAML meets IConfiguration: Declarative configuration for the OpenTelemetry .NET SDK
Observability Labs

YAML meets IConfiguration: Declarative configuration for the OpenTelemetry .NET SDK

You can change sampling without shipping a new build, because the first declarative configuration package parses YAML into a typed model and projects it into the flat keys the OpenTelemetry .NET SDK already reads.

Steve Gordon
The Great Cat Escape: A hands-on guide to OpenTelemetry, Elastic APM, and Kibana alerting
Observability Labs

The Great Cat Escape: A hands-on guide to OpenTelemetry, Elastic APM, and Kibana alerting

Six cats are plotting their escape and you get one alert to stop them. Instrument a Python game with OpenTelemetry, ship it to Elastic APM, and the ES|QL rule you write decides whether you catch the worst offender before it hits ten attempts.

Sophia Solomon
Your trace stops at the span; continuous profiling with OpenTelemetry doesn’t
Observability Labs

Your trace stops at the span; continuous profiling with OpenTelemetry doesn’t

Continuous profiling sampled an unmodified Java app serving 30,150 requests on a little over half a CPU core, with no code change and no restart.

Jeffrey Rengifo
One ES|QL query, 365 days of audit logs: Same search on hot data and searchable snapshots
Observability Labs

One ES|QL query, 365 days of audit logs: Same search on hot data and searchable snapshots

Collect audit logs with the EDOT Collector, then confirm the 365-day retention policy actually applied before an auditor asks you to.

Jeffrey Rengifo
Kubernetes node pressure: Catching the memory drop 7 minutes before the first pod eviction
Observability Labs

Kubernetes node pressure: Catching the memory drop 7 minutes before the first pod eviction

The pod you lose is rarely the pod that grew. This walkthrough follows a per-node anomaly detection alert all the way to the pod whose working set moved.

Jeffrey Rengifo
Kubernetes noisy neighbor in a multi-tenant cluster: Find it with ES|QL
Observability Labs

Kubernetes noisy neighbor in a multi-tenant cluster: Find it with ES|QL

Every pod was Running, and storefront requests under 500 ms still fell from 99.6% to 59%. ES|QL on kubelet metrics found a batch job taking 1.7 of the node's 2 cores, and a 500m cap brought the storefront back above 99%.

Jeffrey Rengifo
Automated root cause analysis for AWS: From a CloudWatch alert to a diagnosed incident in 36 seconds
Observability Labs

Automated root cause analysis for AWS: From a CloudWatch alert to a diagnosed incident in 36 seconds

We broke a live RDS instance with a connection leak, and the workflow came back with the Postgres refusals, the downstream 5xx and a root cause nobody had to write by hand.

Jesse Miller
The service with the most errors was healthy: root cause analysis from logs with ES|QL
Observability Labs

The service with the most errors was healthy: root cause analysis from logs with ES|QL

Metrics ranked three services identically at 19.1%. Four ES|QL queries over the same 4,688 OpenTelemetry log records traced 955 of 956 failure chains back to one of them, and needed no service dependency model to do it.

Jeffrey Rengifo
Kubernetes attributes processor v1: What it means for EDOT Collector
Observability Labs

Kubernetes attributes processor v1: What it means for EDOT Collector

Default EDOT Collector setups are fine. Anything custom that queries labels, annotations or container.image.tag quietly stops returning data after EDOT 9.6.

Christos Markou
Temporal Cloud observability in Elastic: 50+ metrics, zero collectors
Observability Labs

Temporal Cloud observability in Elastic: 50+ metrics, zero collectors

Elastic scrapes metrics.temporal.io, so the workflow that has been stuck in Running for an hour turns out to be a task queue nobody is polling, and you find that out before you open a single worker log.

Ishleen Kaur
Telemetry Policy: change OpenTelemetry sampling and log levels at runtime, no restart
Observability Labs

Telemetry Policy: change OpenTelemetry sampling and log levels at runtime, no restart

Telemetry Policy says what you want to happen and leaves each component to work out how. Change an OpenTelemetry Java agent's trace sampling to 1% and the JVM keeps serving traffic.

Jack Shirazi

Elastic Observability Labs Newsletter