ArcGIS GeoEvent Processor

for Server: An Introduction

2013 Esri Mid-Atlantic User Conference December 10-11 | Baltimore, MD

Derek Law

Esri, Redlands

Agenda

• Real-time GIS overview

• Working with real-time data

• Performing continuous processing and analysis

GIS data

Credit: iStockphoto/chris_lemmens

• GIS data typically represents state at a specific moment in time:

“historic”, “current”, or “future”.

Real-time GIS data

• Real-time GIS data is a continuous stream of events flowing from

sensors where each event represents the latest state of the sensor.

- Emergency Response

- Utility Networks and Warehouses

- Environmental

Web Desktop

Runtime

Mobile

Applications

Features Challenge #1

Police Person

Ambulance

Police Car

110°

Storm

Wind

Temperature

Earthquake

Wild Fire

Network Sensor

Warehouse Item

Analyzing real-time GIS data

• Are my field personnel working within the designated project area?

Web Desktop

Runtime

Mobile

Applications Features

Equipment

Alert

Challenge #2

Continuous

Analysis

Outside

Boundary

Analyzing real-time GIS data

• Tell customer when their delivery truck is 15 minutes away.

Continuous

Analysis

Web Desktop

Runtime

Mobile

Applications Features

Delivery Vehicle

Notification Enter

Customer Area

Challenge #3

ArcGIS supports real-time GIS

Real-time data

ArcGIS Online /

Portal for ArcGIS

Operations

Dashboard Collector

ArcGIS Server

GeoEvent Processor

ArcGIS GeoEvent Processor for Server

• Receives real-time streaming data

• Performs continuous processing and analysis

• Sends updates and alerts to those who need it where they need it

Continuous Processing

and Analysis

Connectors

Connectors

im

ws://

Alerts

Real-Time Data Features

Web Desktop

Runtime

Mobile

Applications

ArcGIS Server

GeoEvent Processor

Working with real-time data

You can add your own connectors.

Receiving real-time data Input connectors

• You can easily integrate real-time data with ArcGIS by using a

connector that meets your needs.

Real-time data

ArcGIS for Server

GeoEvent Processor

Receive NMEA

Receive Sierra Wireless

Receive Tweets

Receive Instagram

Receive Trimble

Receive GPX

NMEA

GPX Receive Vessels

Receive Geomessages

Receive Air Traffic Control

Receive Cursor-on-Target

Receive VMF

CoT

VMF

Message Geo

Watch a folder for new Files

Receive RSS

Receive from a Socket

Receive from a Web Socket

Receive on a REST Endpoint

Poll an ArcGIS Server

Poll an external website

ws://

http://

http://

Receive RSS

Receive from a Socket

Receive from a Web Socket

Receive on a REST Endpoint

ws://

http://

Receive from a Socket

Receive from a Web Socket ws://

Twitter monitoring

Demonstration

Demo

Sending real-time data Output connectors

• You can easily send resulting streams to those who need it where

they need it using a connector.

Web Desktop

Runtime

Mobile ArcGIS for Server

GeoEvent Processor

Real-time data

You can

add your

own

connectors

Send to RabbitMQ

Send to ActiveMQ

Send to HornetQ

Write to Hadoop

Write to MongoDB

Send a Tweet

Send to CESIUM

im

ws://

Send an Instant Message

Send an email

Update a Feature

Add a Feature

Send to Tracking Analyst

Send a Text Message

Publish to REST Endpoint

Send to a Web Socket

Send to a Socket

Write to a File

im

ws://

Send an Instant Message

Send an email

Update a Feature

Add a Feature

Send to Tracking Analyst

Send a Text Message

im

Update a Feature

Add a Feature

Send to Tracking Analyst

Update a Feature

Add a Feature

ArcGIS for Server

feature layers

Sending real-time data to features Using local feature services

GeoEvent Processor

Filters Processors

Inp

uts

Ou

tpu

ts

GeoEvent Services

Update a Feature

Add a Feature

Operations Dashboard

for ArcGIS

ArcGIS

Online / Portal

operation view

web map

Your Dashboards

Your

Applications

Web APIs

JavaScript

Flex

Silverlight/WPF

Mobile GIS

iOS

Android

Windows Phone

Runtimes

Windows Store

Mac OS X

Java

Qt

Real-time

data

Your

Applications

Web APIs

JavaScript

Flex

Silverlight/WPF

Mobile GIS

iOS

Android

Windows Phone

Runtimes

Windows Store

Mac OS X

Java

Qt

ArcGIS

Online / Portal

operation view

web map

Sending real-time data to features Using remote feature services

ArcGIS for Server

feature layers

GeoEvent Processor

ArcGIS for Server

Filters Processors

Inp

uts

Ou

tpu

ts

GeoEvent Services

Update a Feature

Add a Feature

Operations Dashboard

for ArcGIS

Your Dashboards

Real-time

data

Your

Applications

ArcGIS

Online / Portal

operation view

web map

Sending real-time data to features Using ArcGIS Online feature services

feature layers

GeoEvent Processor

ArcGIS for Server

Filters Processors

Inp

uts

Ou

tpu

ts

GeoEvent Services

Update a Feature

Add a Feature

Web APIs

JavaScript

Flex

Silverlight/WPF

Mobile GIS

iOS

Android

Windows Phone

Operations Dashboard

for ArcGIS

Your Dashboards

Runtimes

Windows Store

Mac OS X

Java

Qt

Real-time

data

Real-time

data

Sending real-time data to big data stores

• GIS Tools for Hadoop

- http://github.com/Esri/gis-tools-for-hadoop

ArcGIS for Desktop

Geoprocessing

GIS Tools for Hadoop

2013/03/06/10/vehicles-2013-03-06-10.json

2013/03/06/11/vehicles-2013-03-06-11.json

2013/03/06/12/vehicles-2013-03-06-12.json

2013/03/06/13/vehicles-2013-03-06-13.json

2013/03/06/10/vehicles-2013-03-06-10.tsv

2013/03/06/11/vehicles-2013-03-06-11.tsv

2013/03/06/12/vehicles-2013-03-06-12.tsv

2013/03/06/13/vehicles-2013-03-06-13.tsv

GeoEvent Processor

ArcGIS for Server

Filters Processors

Inp

uts

Ou

tpu

ts

GeoEvent Services

Write to Hadoop

Write to MongoDB

Write to a Hadoop Distributed File System (HDFS)

Write to a MongoDB Document Store

Performing continuous

processing and analysis

Web Desktop

Runtime

Mobile

im

ws://

Continuous processing and analysis GeoEvent Services

• A GeoEvent Service configures the flow of GeoEvents,

- the Filtering and GeoEvent Processing steps to perform,

- what input(s) to apply them to,

- and what outputs(s) to send the results to.

ArcGIS for Server

GeoEvent Processor

Real-time data

Twitter Input Add Tweet Feature Geolocated

Filter

Write Tweets to Hadoop

Twitter Monitor (GeoEvent Service)

Continuous processing and analysis

• Calculate new fields on a geoevent: Field Calculator, GeoTagger

• Modify a geoevent: Field Enricher, Field Reducer

• Derive a new geoevent: Field Mapper, Incident Detector

GeoEvent Service

GeoTagger

Field Calculator

Field Enricher

Field Reducer

Field Mapper

Incident Detector

Input 1 Output 1

ArcGIS Server with GeoEvent Processor

Processors

Processors Calculate new field on a geoevent

• A Field Calculator processor uses an expression to

- calculate a new field or update an existing field.

- Expressions can be mathematical expressions or regular expressions.

• A GeoTagger processor

- uses a spatial condition to tag the event with related geometries.

Expression

Enriched GeoEvent

GeoEvent

Spatial Condition

Enriched GeoEvent

GeoEvent

Processors Modify a geoevent

• A Field Enricher processor

- enriches the geoevent with new fields derived from a data source:

feature service or file.

Enriched GeoEvent

GeoEvent

Feature Service

• A Field Reducer processor

- removes fields from a geoevent.

Reduced GeoEvent

Fields to remove

Processors Derive a new geoevent

• A Field Mapper processor

- translates from one geoevent format to another.

Translated GeoEvent

Incoming GeoEvent

Mapping

Continuous processing and analysis

• An Incident Detector processor

- creates an incident upon an opening condition being met,

- maintains state for the duration of the incident,

- closes the incident based on a closing condition or expiration.

GeoEvent Service

Incident Detector

91 90 92 65 68 90 91 90 92 81 73 68 66

Close Incident

81

Open Incident

90 noiseDecibel >= 90

Opening Condition

Input 1 Output 1

Derive a new geoevent

Ambulance monitoring

Demonstration

Demo

Processors Using an incident detector to monitor conditions

AmbulanceMonitor (GeoEvent Service)

ArcGIS Server with GeoEvent Processor

AmbulanceMonitor/1 “Vehicle”

ambulance-feature-service-out

Speed

Monitoring

AmbulanceMonitor/0 “Alerts”

alert-feature-service-out

Panic

Monitoring

ambulance-in

DangerousAreaMonitor (GeoEvent Service)

Dangerous Area

Monitoring alert-feature-service-out ambulance-in

HospitalArrivalMonitor (GeoEvent Service)

Hospital

Proximity

text-message-out

email-out

alert-feature-service-out ambulance-in

Solutions and sample applications Applying real-time GIS

• A number of sample applications and solutions leverage GeoEvent

Processor to enable real-time GIS capabilities within them including:

- Defense and Intelligence: http://resources.arcgis.com/en/communities/defense-and-intelligence/

- ArcGIS for the Military

- ArcGIS for the National Guard

- ArcGIS for Intelligence

- Asset Monitor

- Route Monitor

ArcGIS

for the Military

ArcGIS for

Intelligence

Route

Monitoring

Asset

Monitoring

Real-time GIS with GeoEvent Processor Summary

• ArcGIS is a dynamic platform that enables real-time visualization,

continuous analysis, and understanding of our world.

• GeoEvent Processor allows you to:

- be alerted when interesting events occur

- react and make smarter decisions faster

- to know what is happening, as it happens

• Product Page

- http://pro.arcgis.com/share/geoevent-processor

- Dlaw@esri.com

Copyright © 2013 All Rights Reserved