location analytics by marc planaguma at big data spain 2014

SPATIAL DATA ANALYTICS

MARC PLANAGUMÀLEAD DATA ENGINEER AND RESEARCHER BDIGITAL

Ciudad 2020Exploratory lines and further work

Joana Simoes, BDigital27/05/2014

Scaling up a in a world of geolocated dataMarc Planagumà, BDigital Technology Centre

Our team

Our work

A world of geolocated data

Applications

Spatial data analytics

Spatial analysis or spatial statistics includes any ofthe formal techniques which studies entities usingtheir topological, geometric or geographicproperties

Spatial data analytics

Basic Spatial Types

Line Point Polygon

* plus others

Spatial data analytics

Geometries

Spatial data analytics

Operations

Contains Within

Spatial data analytics

Operations

Equals Disjoint

Spatial data analytics

Operations

Crosses

Touches Overlaps

Spatial data analytics

Operations

Distance

Spatial data analytics

Operations

Union Difference

Spatial data analytics

Operations

Intersection Symmetric Diff

Spatial data analytics

Complex operations

BufferingConvex Hull

Spatial data analytics

Complex operations

Area

Spatial data analytics

Geospatial data mining techniques

Density-based clustering Hierarchy-based clustering

Spatial data analytics

Geospatial data mining techniques

Heatmaps

Spatial data analytics

Geospatial data mining techniques

Trajectory mining

Spatial data analytics

Geospatial data mining techniques

Geospatial queryingSpatial anomalies

Geographically weighted regressionsSelf-organizing Maps

Agent-based modeling

Our Use Cases

Customeractivitytracking

Where does people buy?

What is the profile of the buyer?

Traffic agenciesCan we predict the

traffic status?

Can we predict the traffic incidences?

Spatial data analytics

Our Datasets

Twitter (Point)Meteo (Polygon)Traffic status (Multi-Line-String) Traffic incidence (Multi-Point) Credit card ops (Multi-Point) Demographic (Point & Polygon)Shapefiles (Multi-Polygon)

Spatial data analytics

Our Tools

Queries

Clustering

Heat maps

TrajectoryAnomaly detection

Spatial data analytics

Our Stacks

Old School Stack - Why Not?

PostGIS Hadoop + GIS Tools ElasticSearch

Kibana

Spatial data analytics

Hadoop Stack - The new Classic

PostGIS Hadoop + GIS Tools ElasticSearch

Kibana

Spatial data analytics

Complete Stack - Big Data GIS

PostGIS Hadoop + GIS Tools ElasticSearch

Kibana

Spatial data analytics

Do’s and Don’ts

Geo Batch

Near Real-Time

Basic Geo Operations

Workflow Composition

Geo Streams

Real-Time

Advanced Geo Op.

Unattended Workflow

Spatial data analytics

What’s next?

RFC ;)

Spatial data analytics

Moltes gràcies!

nom@bdigital.orgmplanaguma@bdigital.org@djkram @bdigital

17TH ~ 18th NOV 2014MADRID (SPAIN)