Open Source Summit + Embedded Linux Conference Europe 2020

Metrics are the perfect tool for setting up alerts and being notified when something goes wrong. Once you get notified, if the root cause of the issue is not obvious, it’s great to have other tools such as Distributed Tracing to get more details. It’s already hard enough to get from the metrics behind your alerts to the exact underlying problematic traces, but even when you get there, you often want to compare a problematic trace with a non-problematic one to determine the differentiators and help root cause the issue. This talk will demonstrate how you can link and jump straight from an alert notification to an underlying problematic trace along with how you can make use of the associations in the metrics space to get to a comparison with a non-problematic trace. This is accomplished with a combination of open source tools such as Prometheus, Jaeger, Grafana and M3. The audience will learn how recent advances in the community can enable them to reduce their time-to-mitigation by providing the relevant context of a good vs bad request directly from an alert notification. The talk will go over different scenarios and techniques from the one being presented at Kubecon EU.