big data challenges in infrastructure the problems of time ... · big data challenges in...
TRANSCRIPT
![Page 1: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/1.jpg)
Big Data Challenges in Infrastructure –
the problems of time and space
Dr Jennifer Schooling
Cambridge Centre for Smart Infrastructure and Construction
![Page 2: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/2.jpg)
Infrastructure Challenges
![Page 3: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/3.jpg)
Implications for……
Design Operation
Reliability Safety
Futureproofing
![Page 4: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/4.jpg)
Recent developments in sensor technologies provide
major new opportunities for ensuring resilient infrastructure
![Page 5: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/5.jpg)
Four scales of challenge
![Page 6: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/6.jpg)
Image credit: Prof. Duncan McFarlane
In construction coordination and management
![Page 7: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/7.jpg)
In adaptive operations and
condition based asset management
Image credit: Prof. Duncan McFarlane
![Page 8: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/8.jpg)
Many interfaces with other disciplines
![Page 9: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/9.jpg)
Movements
from LIDAR
Real time 3D model constructionFO Monitoring
Analysis
Real time people monitoring
Real time people
movement prediction
Wireless Noise
monitoring
Social Media
tracking
Design > Construction > Operation > Maintenance > Replacement
![Page 10: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/10.jpg)
Scope of I&M
What?
Construction Area: assets and working area
Where?
Zones influenced by short term and/or long term
How accurate?
Tolerance of asset?
Pattern recognition?
How often?*
The quickest we are expected to react?
Why?
Safety of Work
Managing Risks
Legal Records
Observational Method
Research
I&M Data
![Page 11: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/11.jpg)
Any information that is needed to assess the
safety of the construction and the influenced
assets
Data
Movements
Pressure (Water)
Construction Progress
Others:
Temperature
Weather Condition
Site Condition
etc
What are the I&M Data?
![Page 12: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/12.jpg)
Movements
Absolute
Differential
Tilt/Strain/Displacement
Inclinometers/ Tiltmeters
Extensometers/ Strain-gauges
Optical Measurements (e.g. total stations)
Types of Movements & Instrumentations
![Page 13: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/13.jpg)
• Position – 1D, 2D, 3D
• Location – m to 10’s km
• Temperature
• Humidity
• Acceleration
• Images
• ….
Variety
• Sub second
• Minute
• Week
• Month
• Year
Veracity
• As data generated – e.g. faulty
sensors
• Over time – confidence in data
over decades
Purpose
• Responsive (immediate)
• Reflective (months –
years)
• Long term (decades –
centuries)
Design > Construction > Operation > Maintenance > Replacement
![Page 14: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/14.jpg)
Other challenges – data standards
• Smart Cities – PAS180, 1802, …..
• Asset Management – ISO 55000
• BIM – PAS1192
![Page 15: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/15.jpg)
What are smart cities standards?
• Smart cities standard (PAS 182) offers a handful of generic concepts (such
as place, observation, metric etc.) to formulate a common language for
linking data across organizations in a city.
• The main goal is to seamlessly integrate information from multiple
organisations using Linked Data (Semantic Web technology) that can be
shared and edited. Different from BIM, Smart Cities allow for the sharing of
critical but less tangible aspects that relate to the data: such as related
Assumptions and Objectives.
![Page 16: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/16.jpg)
Concept model
![Page 17: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/17.jpg)
Potential benefits?
1. Real-time infrastructure monitoring and prediction
system – save lives and infrastructure.
2. A smart framework that can correlate sensor data with
design and analysis to understand the interactions
between infrastructures and people – Better
engineering understanding
3. Multiple organizations/public benefit from gathered data
that is in a universal format and organically linked to
other critical information
4. Improve communication between agents by uniformly
representing data/related aspects (eliminate
redundancies and misunderstandings)
![Page 18: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/18.jpg)
Active train station
(Network Rail)
High risk construction
activity
(Costain)
Active Jubilee Line and
tunnels 30m below (London
Underground)
Critical lifelines (Weston
St. sewer) and important
structures (Shard, Guy’s
Hospital, SER Offices)
nearby
1 retrieved from www.paulweston.info on 04.09.14
![Page 19: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/19.jpg)
3 rows of ~20m deep
bored piles were installed
Built in:
1893
Span, Depth and Arch
Thickness:
10m, 3.2m, 0.7m
State:
Uncracked and no water
drainage problems
The structure – Arch E951
![Page 20: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/20.jpg)
Monitoring a ‘complex infrastructure’
Surveying data
from Costain
for Arches and
Tunnels
Fibre optics data
from CSIC
Design predictions
from WSP
Cloud comparison
data from CSIC
Rail track
displacement
data from
Network Rail
Can we link all this information to:
1) Retrieve a better understanding of response
2) Improve communication between agents
![Page 21: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/21.jpg)
Data exists in different formats for different
metrics, what do we do to link them?
Dilemma about distributed sensing -> How do we describe it and
link it to other data
![Page 22: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/22.jpg)
Raw data is not of interest, evaluated data
with trigger levels interest stakeholders more
Dilemma about assessment of the data – should we link alarms
and triggers? That requires data processing but is an important
aspect that needs to be discussed.
![Page 23: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/23.jpg)
Querying
- Is there a crack opening greater than 5mm in the arches, during piling?
- > Trigger an alarm
- At London Bridge Arch E951 area, has there been a black alarm
triggered during the piles constructed 12.13-01.14?
- > Modify the process for the next pile
- Number of data readings required for a strain profile – within a
tolerance of X?
- Modify data collection methods
- How does the choice of analyser affect the quality of the strain
readings?
- > Re-analyse historic data
- What is the maximum strain observed during creation of a tunnel cross-
passage, over several different projects?
- > Influence design codes to reduce material required
![Page 24: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/24.jpg)
Spatio-Temporal Query Processing
• Semantic analytics tools have primarily focused on
thematic relationships, but spatial and temporal
relationships are often critical components in analytical
domains.
• Current GIS and spatial database technology does
not support complex thematic analytics operations.
Traditional data models used for GIS excel at modelling
and analysing spatial and temporal relationships among
geospatial entities but tend to model the thematic
aspects of a given domain as directly attached attributes
of geospatial entities. Thematic entities and their
relationships are not explicitly and independently
represented, making analysis of these relationships
difficult.
![Page 25: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/25.jpg)
Why conventional relational dbs won’t cut it?
Sensor Location Date/Time Displacem
ent X
Displacem
ent Y
Displacem
ent Z
42 51°N 0°30W 201509101
2000
2 1.5 3
42 51°N 0°30W 201509101
3000
2.1 1.5 3
Sensor Location Date/Time Temperature
57T 51°N 0°30W 20150910123
00
24
Humidity? Vibration? 3D point cloud data? …
![Page 26: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/26.jpg)
Bristol Air Pollution Measurement
![Page 27: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/27.jpg)
Time Slices
![Page 28: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/28.jpg)
Graph processing
Property graph
Sensor
(WSN-#42)
Measurement
(displacement)
measures
Since Sep’15
Key value
12:00 53.5 mm
12:05 53.6 mm
12:10 53.6 mm
![Page 29: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/29.jpg)
Map Reduce (Batch Process) or
In memory (real-time) computation?
• Map Reduce
– Batch processing
– Larger set of data to
extract features and
correlations
• In memory
– Real-time predictions
– Uses features and
correlations from
statistical analysis
– Works on a smaller set
of data and focused
output.
![Page 30: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/30.jpg)
Data Challenges
• Varied types of sensor
• Generating different kinds of data
• At different time intervals
• Likely to be used for different purposes including
– Immediate process control
– Design / code modification
– Long term asset management over decades or
centuries
• Current approaches to handle EITHER thematic
relationships OR spatio-temporal relationships – but both
are important here
![Page 31: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/31.jpg)
Future direction
• Applying Machine Learning algorithms such as ‘deep-
learning’ techniques to extract features and correlations.
• Real-time prediction of infrastructure behaviour based on
statistical correlations and relationships.
“Transform the future of infrastructure through smarter information”
![Page 32: Big Data Challenges in Infrastructure the problems of time ... · Big Data Challenges in Infrastructure – ... Data Challenges • Varied types of sensor • Generating different](https://reader034.vdocuments.us/reader034/viewer/2022042916/5f56de3ad5912167276d9415/html5/thumbnails/32.jpg)
www.centreforsmartinfrastructure.com
Thank you!