The Telemetry team at Lightbend is pleased to announce a new release of Lightbend Telemetry, a suite of monitoring and observability tooling for Lightbend technologies. This release brings some new capabilities to Telemetry, including:
Lightbend Telemetry provides deep observability into the inner-workings of distributed applications built with Akka, Lagom, Play, Java, and Scala. This lets users tap into the “black box” of distributed systems via events, metrics and distributed tracing. Telemetry provides a wide variety of integrations, including: Grafana, Prometheus, Elasticsearch, Jaeger, Zipkin, New Relic, Datadog, and others, including any tool that supports OpenTracing.
Telemetry 2.15 introduces support for instrumenting services that use Akka Projections to process a stream of events or records from a source to a projected model or external system. The screenshots below show the Prometheus/Grafana-backed dashboard alongside an explanation of the metrics included:
Multiple envelope metrics are available, such as:
You can mouse over to see detailed information per projection:
In combination with envelope metrics and events, there are metrics specific to projections themselves:
Here you can see metrics such as:
See more details about these metrics and others in our new metrics dictionary.
There were some cases where Datadog tracing spans were not connecting properly when the application is instrumented by both cinnamon-agent and datadog-agent. The main cause was the currently active context not being captured as expected, or Lightbend Telemetry expecting a proper implementation of equality comparison for spans.
Both agents also try to create a global tracer, leading to the application having multiple global tracers. Moreover, both agents try to instrument the same code (Akka dispatcher executor), so one overrides another. Although it is unusual to have the two agents running side by side, fixing these problems makes the result more predictable.
This release also contains a number of fixes, enhancements and performance improvements that are fully documented in the release notes with links through to the relevant documentation where appropriate.
As always, we’re interested in your feedback or ideas for Lightbend Telemetry, to improve the visibility into Reactive applications and distributed systems. We encourage our clients to reach out to us through the Lightbend Support Portal, or get in touch with your Lightbend representative.
To get a first-hand experience with Telemetry, visit the free Lightbend Academy course "Monitoring Akka with Lightbend Telemetry":