Full session (30 minutes)
monitoring
big data
data visualisation
In Taboola, we swim, and sometimes drown in data.
I will share my secrets of how to have good visibility to our big data. For that, I use three tools: Grafana, Kibana and Kusto (Azure Data Explorer) together. Before that, I had to jump back and forth from one application to the other in order to build my puzzle.
For example:
- Added the error count from Kibana to the CPU load from Grafana. Boom, got a correlation between CPU hogers to applicative errors.
- Mixed HTTP error rate from Azure Data Explorer, Kibana installation timestamps and business KPIs from Grafana, this resulted in a razor sharp graph that tracks our SLA compliance in a glimpse of an eye.
I am sure that by seeing how much value did I got from it, you also be interested in this cocktail.