From monitoring…to analytics…to understandingData Driven NYC #41 - @alqhttp://dtdg.co/data-driven-nyc-41

#1: AggregateDatadog gathers performance data from all your application components.

#2: Visualize

#3: Alert

Your understanding is only as good as your monitoring

Massive increase of monitoring data

Here’s why: virtualization, distributed architectures & micro-services

Many more metrics

Overwhelming...

Premium on rate of changeUnlike the physical lines of production

Many more metrics…Changing much faster

Extract signal from noise

Extract signal from noiseWith signal processing and data science

Signal from noise: outliers

Signal from noise: outliers

Signal from noise: anomalies

For technical detailssee Pydata NYC 2015http://nyc2015.pydata.org/schedule/presentation/116/

Extract signal from noiseWith a better mental model

The importance of the model

Back to basicshttps://www.datadoghq.com/blog/monitoring-101-collecting-data/

Not all metrics are created equal

Simplify, simplify, simplify

Focus on metricsthat matter

Deal with massive increase of monitoring data with:(1) data science(2) education

Thanks!

We. Are. Hiring.datadoghq.com/jobs

Appendix

DASHBOARDSBuild Real-Time Interactive Dashboards

CORRELATIONSearch And Correlate Metrics And Events

See It All In One PlaceYour Servers, Your Clouds, Your Metrics, Your Apps, Your team. Together.

COLLABORATIONShare What You Saw, Write What You Did

METRIC ALERTSGet Alerted On Critical Issues

DEVELOPER APIInstrument Your Apps, Write New Integrations

See It All In One PlaceYour Servers, Your Clouds, Your Metrics, Your Apps, Your team. Together.