geo-analytics with apache spark and in-memory data grids
TRANSCRIPT
![Page 1: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/1.jpg)
Geo-Analytics with Apache Spark and In-Memory Data Grids
Copyright © GigaSpaces 2016. All rights reserved.
Ali HodrojVP, Products and Strategy
@ahodrojStrata+Hadoop New York 2016
![Page 2: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/2.jpg)
2
In-Memory Computing Product Portfolio
Direct customers300+
Fortune / Organizations
40+ / 500+ Cloud Customers
75+ISVs
25+
![Page 3: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/3.jpg)
3
Selected Customers
![Page 4: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/4.jpg)
Geo-Spatial Intelligence
Beyond just maps and visualizations….
GeoSpatial Intelligence: Confluence of 3 Trends
![Page 5: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/5.jpg)
5
GeoSpatial Insight is Essential
Financial Services: Detect and prevent fraud by correlating spatial, temporal, and transactional data altogether
Retail: Geospatial data in personalization can help retailers optimize their promotional activity based on customer locations
Insurance: Risk is often tied to location. Insurers can perform risk simulations against vast amounts of data to come up with the right risk model
![Page 6: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/6.jpg)
6
Implementing true GeoSpatial insight
Batch + Real-timeData
Convergence
Closed Loop Analytics(Insights trigger
workflows)
Multi-tenant, Geo-
Federated, Scale-out
requires…
![Page 7: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/7.jpg)
7
XAP: fast scale-out in-memory data grid
Large-scale data processing framework
Low-Latency GeoSpatial SQL
Apache Spark meets Low-Latency GeoSpatial Processing
![Page 8: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/8.jpg)
8
GigaSpaces XAP In-Memory Data Grid
Elastic Scale-out In-Memory Storage (Shared-nothing, Linear scalability, Elastic capacity)
Low latency and High Throughput (co-located ops, event-driven, fast indexing)
High Availability and Resiliency (auto-healing, multi-data center replication, fault tolerance)
Rich API and Query Language (SQL, Spring, Java, .NET, C++)
![Page 9: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/9.jpg)
9
Pluggable data initial load
High Performance Spark with OLTP Capabilities
![Page 10: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/10.jpg)
10
Pluggable data initial load
![Page 12: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/12.jpg)
12
Case Study: Vehicles/Fleet Spatial Analytics
Challenge
• Stream data from 1,000s of Taxis• Actively monitor and generate real-
time notifications• Location-based tracking, Geo-fencing
Solution
• Elastically scale stream processing and transactional apps together
• Real-time operational intelligence through live in-memory data grid
• Extensible and dynamic pricing/routing/fleet rebalancing rules
Edge components
Data Sources
![Page 13: Geo-Analytics with Apache Spark and In-Memory Data Grids](https://reader033.vdocuments.us/reader033/viewer/2022051520/588471af1a28ab5e248b49ad/html5/thumbnails/13.jpg)
Try it out
http://insightedge.io
@InsightEdgeIO Booth #667