empower your operations - esri...

28

Upload: vanmien

Post on 22-Apr-2018

219 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics
Page 2: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Empower your operations

with real time visibility- Manishkumar Patel

Page 3: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

What is Real-Time GIS?

Working with Real-Time Data

Applying Real-Time Analytics

Real-Time in Web Apps

Summary

1

2

3

4

5

Agenda

Page 4: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

What is Real-Time GIS?1

Page 5: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

FeaturesRequirement #1

ApplicationsNetwork Sensor

Warehouse Item

110°°°°

Storm

Wind

Temperature

Earthquake

Wild Fire

Police Person

Ambulance

Police Car

Each event represents

the latest state of the sensor�

Real-Time GIS DataContinuous stream of events flowing from a data feed

Page 6: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Requirement #2 Requirement #2

Continuous

AnalysisFeatures

Outside

Boundary

Child

Applications

Real-Time Notifications and AlertingTell a parent when their child leaves school property

Page 7: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Features

Requirement #3 Requirement #3

Continuous

Analysis

Inside

Boundary

Vessel

Alert

Applications

Real-Time AnalyticsWhat fishing vessels are inside designated ‘no fishing’ zones?

Page 8: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Real-Time CapabilityArcGIS 10.4

DesktopWeb Device

ArcGIS Server

Ingestion

GeoEvent

Extension

Visualization

Live and Historic

Aggregates & Features

Spatiotemporal

Big Data Store

Map and

Feature Service

• Ingest high velocity real-time

data into ArcGIS

• Perform continuous analytics

on events as they are received

• Store observations in a

Spatiotemporal Big Data Store

• Visualize high velocity and

volume data:

- as an aggregation

- as discrete features

• Notify those who need to

know about patterns of

interest in real-time

Stream Service

Live Features

Storage

Analytics

Page 9: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Working with Real-Time Data2

Page 10: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Working with Real-Time DataMaking features come alive

• Connect an output to your feature/stream service

• Import the schema of your feature as a GeoEvent Definition

• Configure an input to receive real-time data

• Author and publish a GeoEvent Service

• Visualize your real-time features

GeoEvent Extension

Ou

tpu

ts

Inp

uts

GeoEvent Services

ArcGIS Server

feature services

GeoEvent Definitions

Operations Dashboard

for ArcGIS

stream services

operation views

web maps

ArcGIS Online /

Portal for ArcGIS

Page 11: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Ingesting real-time data into ArcGISInput connectors

You can create

your own

connectors.

GeoEvent Extension

Inp

uts

Ou

tpu

ts

GeoEvent Services

Poll an ArcGIS Server for Features

Poll an external website for GeoJSON, JSON, or XML

Receive Features, GeoJSON, JSON, or XML on a REST endpoint

Receive RSS

Receive GeoJSON or JSON on a WebSocket

Receive Text from a TCP or UDP Socket

Subscribe to an external WebSocket for GeoJSON or JSON

Watch a Folder for new CSV, GeoJSON, or JSON Files

Ou

t o

f th

e B

ox

REST

.csv

WS

WS

HTTP

Esri

Gall

ery

ActiveMQ

CAP

Instagram

Exploitation Support Data

Cursor-on-Target

RabbitMQ

NMEA 0183

MQTT

Sierra Wireless (RAP)

KML

Kafka *

Trimble (TAIP)

Twitter

Part

ner

Gall

ery

CompassLDE

enviroCar

GNIP

FAA (ASDI)

exactEarth AIS

Zonar

Valarm

Networkfleet

OSIsoft *

*

*

*

*

Page 12: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Storing real-time data in ArcGIS and alertingOutput connectors

You can create

your own

connectors.

GeoEvent Extension

Inp

uts

Ou

tpu

ts

GeoEvent ServicesO

ut

of

the B

ox

Add or Update a feature

Publish Text to a UDP Socket

Send a Text Message

Send an Email

Push Text to an external TCP Socket

Push GeoJSON or JSON to an external WebSocket

Push GeoJSON or JSON to an external Website

Send an Instant Message

Send Features to a Stream Service

Write to a CSV, GeoJSON, or JSON File .csv

WS

im

HTTP

Add a Feature to a Spatiotemporal Big Data Store

Update a feature in a Spatiotemporal Big Data Store

ActiveMQ

Esri

Gall

ery

Cursor-on-Target

Hadoop (HDFS)

Kafka

MongoDB

MQTT

RabbitMQ

Twitter

*

Page 13: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Applying Real-Time Analytics3

Page 14: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Applying Real-Time AnalyticsGeoEvent Services

• A GeoEvent Service defines the flow of GeoEvents

- The Filtering and Processing steps to perform

- what input(s) to apply them to

- and what output(s) to send the results to

Page 15: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Applying Real-Time AnalyticsGeoEvent filtering

• A Filter eliminates GeoEvents based on an expression

=

=

=

=

Page 16: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Attribute, Spatial, and

Combination

Expressions

Filtering

Page 17: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Performing continuous analytics in ArcGISProcessors

You can create

your own

processors.

• You can perform continuous analytics on events as they are received using a processor.

GeoEvent Extension

Inp

uts

Ou

tpu

ts

GeoEvent Services

Buffer Creator

Convex Hull Creator

Difference Creator

Envelope Creator

Field Calculator

Field Enricher

Field Mapper

Geotagger

Incident Detector

Intersector

Projector

Simplifier

Symmetric Difference

Track Gap Detector

Field Reducer Union Creator

Ou

t o

f th

e B

ox

Add XYZ

Esri

Gall

ery

Bearing

Ellipse

Event Volume Control

Extent Enricher

Field Grouper

GeoNames Lookup

Range Fan

Reverse Geocoder

Service Area Creator

Symbol Lookup

Track Idle Detector

Unit Converter

Visibility

Motion Calculator Query Report

Page 18: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Detecting Events of Interest

Processing

Page 19: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Additional Real-Time Spatial AnalyticsSpatial filtering

• Spatial operators:

inside outside

enter exit

intersects disjoint

touches contains

crosses equals

overlaps within

Page 20: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Additional Real-Time Spatial AnalyticsGeoFence scope

• All GeoFences• Any GeoFence

• Specify a GeoFence scope: Any or All

Page 21: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Real-Time in Web Apps4

Page 22: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Two patterns

GeoEvent Extension

ArcGIS Server

Your

Applications

Stream Layer

Map Services

Feature Services

Feature Layer

feature layers

Update a Feature

Add a Feature

EGDB

Polling

(Pull)

Stream Services

Getting Real-Time Data into Web Apps

• Feature layers pull from feature services

- Web apps poll to get periodic updates

- Must be backed by an enterprise geodatabase (EGDB)

• Stream layers subscribe to stream services

- Web apps subscribe to immediately receive data

- Low latency and high throughput

Send Features to a Stream Service

Page 23: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Stream Services

Real-Time GISDesktopWeb Device

ArcGIS Server

GeoEvent

Extension

Spatiotemporal

Big Data Store

Stream Service

Stream Layer

Page 24: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

SummaryReal-Time GIS: GeoEvent Extension

• ArcGIS is a dynamic system that enables continuous analytics and real-time

visualization for better understanding of our world.

• The Real-Time GIS capabilities allow you to:- know what is happening, as it happens

- react and make smarter decisions faster

- be notified when events of interest occur

• GeoEvent extension extends the capabilities of ArcGIS Server enabling

real-time event-based streams to be integrated as data sources in your

enterprise GIS.

Page 25: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Where to learn moreResources

• Step by step illustrated tutorials, free to download:

- http://links.esri.com/geoevent

- Introduction

- Notifications

- Stream Services

- Spatiotemporal Big Data Store

- RSS, HTTP, Files

- REST Admin API

Page 26: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

Survey/FeedbackSurvey/FeedbackSurvey/FeedbackSurvey/Feedback

• ???????

Page 27: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics

THANK YOUTHANK YOUTHANK YOUTHANK YOU

Page 28: Empower your operations - Esri Singaporeesrisingapore.com.sg/u/lib/esrisg/cms/empower-your-operations-with... · Kafka MongoDB MQTT RabbitMQ Twitter * 3 Applying Real-Time Analytics