real-time gis: geoevent extension - esri · real-time gis: geoevent extension arcgis is a dynamic...
TRANSCRIPT
Sagar AyareReal-Time GIS Product Engineer
Greg TiemanReal-Time GIS Product Engineer
Real-Time GIS:GeoEvent Extension
AgendaWhat is Real-Time GIS?Working with Real-Time DataApplying Real-Time AnalyticsReal-Time in Web AppsWrap-up
1
2
3
4
5
What is Real-Time GIS?1
GIS DataWhat has happened, what is happening, what will happen
The ‘current’ snapshot is outdated almost as soon as it’s created…
Credit: iStockphoto/chris_lemmens
FeaturesRequirement #1
ApplicationsNetwork Sensor
Warehouse Item
110°
Storm
Wind
Temperature
Earthquake
Wild Fire
Police Person
Ambulance
Police Car
Each event represents the latest state of the sensor…
Real-Time GIS DataContinuous stream of events flowing from a data feed
Features
Requirement #2
Continuous Analysis
InsideBoundary
VesselAlert
Applications
Real-Time AnalyticsWhat fishing vessels are inside designated ‘no fishing’ zones?
Requirement #3
Continuous Analysis
Features
OutsideBoundary
Child
Applications
Real-Time Notifications and AlertingTell a parent when their child leaves school property
Real-Time CapabilityArcGIS 10.4
DesktopWeb Device
ArcGIS Server
Ingestion
GeoEventExtension
Visualization
Live and HistoricAggregates & Features
SpatiotemporalBig Data Store
Map and Feature Service
• Ingest high velocity real-time data into ArcGIS
• Perform continuous analytics on events as they are received
• Store observations in a Spatiotemporal Big Data Store
• Visualize high velocity and volume data:
- as an aggregation- as discrete features
• Notify those who need to know about patterns of interest in real-time
Stream Service
Live Features
Storage
Analytics
Working with Real-TimeData2
Working with Real-Time DataMaking features come alive• Connect an output to your feature/stream service• Import the schema of your feature as a GeoEvent Definition• Configure an input to receive real-time data• Author and publish a GeoEvent Service• Visualize your real-time features
GeoEvent Extension
Out
puts
Inpu
ts
GeoEvent Services
ArcGIS Server
feature services
GeoEvent Definitions
Operations Dashboard for ArcGIS
stream services
operation views
web maps
ArcGIS Online /Portal for ArcGIS
Tracking Snow Plows
Making FeaturesCome Alive
Ingesting real-time data into ArcGISInput connectors
You can createyour own
connectors.
GeoEvent Extension
Inpu
ts
Out
puts
GeoEvent Services
Poll an ArcGIS Server for Features
Poll an external website for GeoJSON, JSON, or XML
Receive Features, GeoJSON, JSON, or XML on a REST endpoint
Receive RSS
Receive GeoJSON or JSON on a WebSocket
Receive Text from a TCP or UDP Socket
Subscribe to an external WebSocket for GeoJSON or JSON
Watch a Folder for new CSV, GeoJSON, or JSON Files
Out
of t
he B
ox REST
.csv
WS
WS
HTTP
Esri
Gal
lery
ActiveMQ
CAP
Exploitation Support Data
Cursor-on-Target
RabbitMQ
NMEA 0183
MQTT
Sierra Wireless (RAP)
KML
Kafka *
Trimble (TAIP)
Part
ner G
alle
ry
CompassLDE
enviroCar
GNIP
FAA (ASDI)
exactEarth AIS
Zonar
Valarm
Networkfleet
OSIsoft ***
*
*
Storing real-time data in ArcGIS and alertingOutput connectors
You can createyour own
connectors.
GeoEvent Extension
Inpu
ts
Out
puts
GeoEvent Services
Out
of t
he B
oxAdd or Update a feature
Publish Text to a UDP Socket
Send a Text Message
Send an Email
Push Text to an external TCP Socket
Push GeoJSON or JSON to an external WebSocket
Push GeoJSON or JSON to an external Website
Send an Instant Message
Send Features to a Stream Service
Write to a CSV, GeoJSON, or JSON File .csv
WS
im
HTTP
Add a Feature to a Spatiotemporal Big Data Store
Update a feature in a Spatiotemporal Big Data Store
ActiveMQ
Esri
Gal
lery Cursor-on-Target
Hadoop (HDFS)
Kafka
MongoDB
MQTT
RabbitMQ
*
Applying Real-TimeAnalytics3
Applying Real-Time AnalyticsGeoEvent Services• A GeoEvent Service defines the flow of GeoEvents
- The Filtering and Processing steps to perform- what input(s) to apply them to- and what output(s) to send the results to
Applying Real-Time AnalyticsGeoEvent filtering• A Filter eliminates GeoEvents based on an expression
=
=
=
=
Attribute, Spatial, and CombinationExpressions
Filtering
Performing continuous analytics in ArcGISProcessors
You can createyour own
processors.
• You can perform continuous analytics on events as they are received using a processor.
GeoEvent Extension
Inpu
ts
Out
puts
GeoEvent Services
Buffer Creator
Convex Hull Creator
Difference Creator
Envelope Creator
Field Calculator
Field Enricher
Field Mapper
Geotagger
Incident Detector
Intersector
Projector
Simplifier
Symmetric Difference
Track Gap Detector
Field Reducer Union Creator
Out
of t
he B
oxAdd XYZ
Esri
Gal
lery
Bearing
Ellipse
Event Volume Control
Extent Enricher
Field Grouper
GeoNames Lookup
Range Fan
Reverse Geocoder
Service Area Creator
Symbol Lookup
Track Idle Detector
Unit Converter
Visibility
Motion Calculator Query Report
Detecting Events of InterestProcessing
Additional Real-Time Spatial AnalyticsSpatial filtering
• Spatial operators:inside outsideenter exit
intersects disjointtouches containscrosses equalsoverlaps within
Additional Real-Time Spatial AnalyticsExample – Impending weather notifications
Additional Real-Time Spatial AnalyticsExample – Convoy separation alerting
Additional Real-Time Spatial AnalyticsGeoFence scope
• All GeoFences• Any GeoFence
• Specify a GeoFence scope: Any or All
Additional Real-Time Spatial AnalyticsExample – Territory adherence alerting
Real-Time in Web Apps4
Two patterns
GeoEvent Extension
ArcGIS Server
YourApplications
Stream Layer
Map ServicesFeature Services
Feature Layer
feature layers
Update a FeatureAdd a Feature
EGDB
Polling(Pull)
Stream Services
Getting Real-Time Data into Web Apps
• Feature layers pull from feature services- Web apps poll to get periodic updates- Must be backed by an enterprise geodatabase (EGDB)
• Stream layers subscribe to stream services - Web apps subscribe to immediately receive data- Low latency and high throughput
Send Features to a Stream Service
Stream ServicesReal-Time GIS DesktopWeb Device
ArcGIS Server
GeoEventExtension
SpatiotemporalBig Data Store
Stream Service
Stream Layer
Using Web App Builder
Real-TimeIn Web Apps
Wrap-up5
SummaryReal-Time GIS: GeoEvent Extension
• ArcGIS is a dynamic system that enables continuous analytics and real-time visualization for better understanding of our world.
• The Real-Time GIS capabilities allow you to:- know what is happening, as it happens- react and make smarter decisions faster- be notified when events of interest occur
Where to learn moreResources• Step by step illustrated tutorials, free to download:
- http://links.esri.com/geoevent- Introduction- Notifications- Stream Services- Spatiotemporal Big Data Store- RSS, HTTP, Files- REST Admin API
• Ask questions on the GeoEvent space on GeoNet:- http:// links.esri.com/geoevent-forum
Real-Time GIS
• Real-Time GIS: GeoEvent Extension Wed 10:15-11:30am, Room 14B
• Real-Time GIS: Leveraging Stream Services Wed 8:30-9:45am, Hilton Sapphire Ballroom A/D
• Real-Time GIS: Applying Real-Time Analytics Tue 1:30-2:45pm, Room 14AWed 10:15-11:30am, Room 15B
• Real-Time GIS: Archiving & Visualizing Observation Data Wed 10:15-11:30am, Room 08Thu 10:15-11:30am, Room 07A/B
• Real-Time GIS: Best Practices Thu 8:30-9:45am, Room 14A
• Real-Time GIS: The Internet of Things Wed 1:30-2:45pm, Room 05B
• Road Ahead: Real-Time GIS Thu 1:30-2:45pm, Room 10
• Real-Time 3D GIS: Making Scenes Come Alive Wed 3:30-4:15pm, Demo Theater 5
Other sessions
Please take our SurveyYour feedback allows us to help maintain high standards and to help presenters
Find the session you want to review
Find your event in the Esri Events App
Scroll down to the bottom of the session
Answer survey questions and submit
Questions / Feedback?
http://links.esri.com/geoeventhttp://links.esri.com/geoevent-forum
To learn more:
http://esriurl.com/IoTSurveyPlease take our IoT survey:
Sagar AyareReal-Time GIS Product Engineer
Greg TiemanReal-Time GIS Product Engineer