network visibility for all - grafanacon · need network, system, and application visibility, all...
TRANSCRIPT
![Page 1: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/1.jpg)
Network Visibility for All
![Page 2: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/2.jpg)
To really ensure user experience…
Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems.Kentik takes network traffic data; solves network nerd problems. Like peering, planning, DDoS, performance, and security analytics. W/ backend storing all the data, with no aggregates or roll-ups.
But what about the rest of the compnany?Grafana is everywhere J So we had Grafana Labs develop the Kentik Connect app.
Protect the Network, Protect the Apps
2
![Page 3: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/3.jpg)
Why > than metrics for network? “Is it the Network?” is WAY too common “How can we not know?”
But Network data is big data Kill “Aggregate and Discard” And kill Siloes But DIY is a large effort
Network Traffic Analytics Is Broken
3
![Page 4: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/4.jpg)
Secure Multi-Tenant SaaS orOn-Premises Option
Kentik Detect: Platform for Data-Driven NetOps
NetOps
Network Security
Network Planning
Finance
Sales
4
Cross-OrganizationalNetwork Visibility
Network traffic &performance data
Servers/Agents
Routers
Switches
Sensors
![Page 5: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/5.jpg)
5
Root cause involves systems, network, & apps.
Grafana integration fills traffic and netperf gap for correlating and exposing on metrics dashboard.
Providing all three critical views.
For many kinds of groups and users.
Kentik / Grafana Integration
![Page 6: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/6.jpg)
This Approach is in Use and Working!
6
![Page 7: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/7.jpg)
Architecture
![Page 8: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/8.jpg)
Kentik By The Numbers
8
![Page 9: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/9.jpg)
Instant, escalation-free troubleshooting
Peering and transit analytics Sales prospecting & customer success
DDoS detection and mitigation
Capacity planning
Cross-team access and collaboration
Portal integration Infrastructure & customer security
Customer cost analytics
Kentik Detect Enables
9Note: Service Provider audience
![Page 10: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/10.jpg)
3 year old company, HQ in San Francisco
SaaS network traffic visibility provider Founders from Akamai, Netflix, YouTube, CloudFlare
Who is Kentik?
10
![Page 11: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/11.jpg)
Kentik Data Engine (KDE)
The Need Fast, unlimited drill-down, full retention back-end
Kentik Data Engine
Column-store, distributed system supporting SQL, REST, multi-tenancy, and extensible schema. Bare-metal, containerized, micro-services architecture
Modeled After Akamai Query and Google Dremel
Comparatives 10x to 100x speed and 10x+ advantage over Hadoop, Impala, Drill, Spark, Cassandra, and Red Hat
11
![Page 12: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/12.jpg)
Kentik Data Engine Architecture
12
![Page 13: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/13.jpg)
Getting Your Data to Kentik
13
![Page 14: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/14.jpg)
Use Cases
14
![Page 15: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/15.jpg)
15
90 days (or more) of instantly accessible raw flows No aggregation, no roll-ups, no data cube fragility Instant data cubes Ad-hoc, raw data query: 95%ile response < 2 seconds Benefits:
– Service assurance– Operational excellence– Shift to Innovation
Unconstrained Ad-Hoc Traffic Analysis
![Page 16: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/16.jpg)
16
90 days (or more) of instantly accessible raw flows No aggregation, no roll-ups, no data cube fragility Instant data cubes Ad-hoc, raw data query: 95%ile response < 2 seconds Benefits:
– Service assurance– Operational excellence– Shift to Innovation
Unconstrained Ad-Hoc Traffic Analysis
![Page 17: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/17.jpg)
Flexible, network-wide detection Alerts operate on order of seconds, not five minute data segments Exploratory analytics to hunt for threats and intrusions Rapidly adjust alerts with new insights Automated mitigation options Benefits:
– Minimal false positives & negatives– Keep up with changing threats
Agile DDoS Detection & Mitigation
17
![Page 18: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/18.jpg)
18
New state of the art for peering analytics
Interactive BGP path visualizations
Instantaneous filtering and drill-down - no waiting!
Benefits:– Reduce costs
– Increase performance and resilience
– Find new business opportunities
Intuitive BGP Peering Analytics
![Page 19: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/19.jpg)
19
New state of the art for peering analytics Interactive BGP path visualizations Instantaneous filtering and drill-down - no waiting! Benefits:
– Reduce costs– Increase performance
and resilience– Find new business
opportunities
Intuitive BGP Peering Analytics
![Page 20: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/20.jpg)
Long-term storage of detailed records Agile, fast DDoS detection & mitigation
Extensible flow data model including security semantics Ease of integration with Splunk and SIEMs
Multi-tenant access to protect one analyst or query from swamping the system
Network Security
20
![Page 21: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/21.jpg)
21
Any analysis can be saved to a dashboard
Build any number of audience-specific dashboards
Email PDF reports from any dashboard to configurable subscription list
Build and Share Dashboards for Multiple Teams
![Page 22: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/22.jpg)
22
Any analysis can be saved to a dashboard
Build any number of audience-specific dashboards
Email PDF reports from any dashboard to configurable subscription list
Build and Share Dashboards for Multiple Teams
![Page 23: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/23.jpg)
23
Find transit networks that are potential customers
Sales Prospecting: Transit ASNs View
![Page 24: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/24.jpg)
24
Find transit networks that are potential customers
Sales Prospecting: Transit ASNs View
![Page 25: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/25.jpg)
Application Versus Network Performance
25
Analyze NetworkApplication Performance Issues
![Page 26: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/26.jpg)
26
Problem: “Our customers know about issues before we do!”
Solution: Find & mitigate issues faster!
Flexible alerting for many use cases:
– Security, ops, availability, performance
Network-wide scope with raw data granularity Very low latency
Proactive Alerting
![Page 27: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/27.jpg)
27
Highly performant APIs
REST & SQL Sample integrations:
– Grafana.net
– Auvik.com
– ServerCentral
– GeoFlow (Tor)
API and Portal Integration
![Page 28: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/28.jpg)
Identify critical ‘digital trading partners’ in your supply chain– E.g. Key API partners and external users
Monitor and analyze in real-time
Ensure performance and availability Establish and manage advantageous peerings
Digital Supply Chain Assurance
28
![Page 29: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/29.jpg)
Add traffic tags for each service, user, sub-network Leverage routing information to support “packet mile” cost analysis
Analyze patterns for upstream and downstream traffic Analyze individual or groups of links by customer or application
Variable granularity from high-level aggregation to individual flows
Service Cost Analytics
29
![Page 30: Network Visibility for All - GrafanaCon · Need network, system, and application visibility, all integrated. But network, APM, logs, and metrics, have all been siloed systems. Kentik](https://reader035.vdocuments.us/reader035/viewer/2022071114/5feb0b8c1ee2355deb0ee111/html5/thumbnails/30.jpg)
www.kentik.com
Thank You!
30