sc7 workshop 2: big data pilots for secure societies
TRANSCRIPT
![Page 1: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/1.jpg)
UNCLASSIFIED/FOR OFFICIAL USE ONLY
UNCLASSIFIED / FOR OFFICIAL USE ONLYEuropean Union Satellite Centre © 2016
Big Data pilots for Secure Societies
Sergio AlbaniResponsible for RTDI
![Page 2: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/2.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
2
RTDI activities at SatCen
• Research, Technology Development and Innovation
- Fostering cooperation with EC, EU entities and key organisations
in Space such as ESA and GEO
- Implementing new solutions with regard to the whole data lifecycle
on issues related to Big Data and Cloud Computing
EVER-EST
NextGEOSS
![Page 3: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/3.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
3
• Integrating Big Data, software &
communities for addressing Europe’s
Societal Challenges
- Health, Food, Energy, Transport, Climate,
Social Sciences, Secure Societies
• BigDataEurope main activities:
- Gathering user requirements
- Developing a Big Data platform
- Implementing relevant pilots
• SatCen is:
- Building a Secure Societies community
- Eliciting Big Data requirements
- Implementing a Space and Security pilot
The BigDataEurope Project
![Page 4: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/4.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
4
Stakeholders interviews• Building of a Secure Societies Community with an interest in
the Big Data issue
• Four types of customized questionnaires submitted
- Real use cases, data stories and user needs collected
- Inputs analyzed looking for commonalities amongst users
• 1st Workshop held in Brussels on September 2015 at SOST
• Formalized set of user requirements for the design of the
system and the pilot deployment defined
Collection of User Requirements
![Page 5: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/5.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
5
• Data Chain
- To exploit data coming from space (using open data and tools)
- To integrate satellite, geospatial and other data
- To develop automatic tools for the whole data chain management
- Possible applications of Big Data should be mainly related to
access, archiving, analysis, visualization and dissemination
• Platform Characteristics
- Reliable, stable, efficient, time reducing, economically convenient,
open source-based, user-friendly, multi-lingual and interoperable
- Security compliant, geospatial oriented, Platform as a Service
(PaaS), single access, customizable and extensible
User Requirements in Secure Societies
![Page 6: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/6.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
6
Dissemination Activities
• Technical Webinars
- To present inputs from experts responsible for the architecture, the
implementation and the upcoming pilots roll-out
• Secure Societies Hangouts
- To give details on the use of Big Data in the Security domain
• Conferences
- 2nd Big Data from Space Conference (15-17 March 2016)
- Living Planet Symposium (9-13 May 2016)
- EO Open Science Conference (12-14 September 2016)
- SatCen Expert User Fora
![Page 7: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/7.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
7
The BigDataEurope SC7 Pilot
Remote Sensing Big Data Platform Social Sensing
Change Detection Workflow
Event Detection Workflow
![Page 8: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/8.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
8
• European Virtual Environment for
Research – Earth Science Themes
- A VRE is a distributed collaborative system
facilitating access, processing and sharing
of data, algorithms and results
• EVER-EST main activities:
- Establish a VRE for Earth Science
- Validate the VRE with 4 main VRCs
- Implement the use of ROs in ES
• SatCen is:
- Representing the Land Monitoring VRC
- Eliciting requirements for the VRE
- Implementing a Space and Security pilot
The EVER-EST Project
![Page 9: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/9.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
9
The EVER-EST LaMo Pilot
Binary Map (changes / no changes)
Classified Map (e.g. land cover)
![Page 10: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/10.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
10
• Next Generation GEOSS for
Innovation & Business
- The Group on Earth Observations is
building the Global Earth Observation
System of Systems
• NextGEOSS main activities:
- Engaging EO and related communities
- Advocating GEOSS
- Delivering a DH for EO data exploitation
• SatCen will be:
- Engaging with data providers
- Liaising with GEO communities/activities
- Implementing a Space and Security pilot
The NextGEOSS Project
NextGEOSS
![Page 11: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/11.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
11
Big Data General User Scenario
Data Access
Data Selection
Data Processing
Data Visualization
Data Analytics
![Page 12: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/12.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
12
Preliminary Results and Conclusions
• Technical solutions for Big Data exploitation
- System to search, download, pre-process and compare images
- Social media and news monitoring by a crawling system
- Web-GIS client to properly visualise information and results
- Solutions to guarantee a better access to open data
- Downloaded images storage in a distributed way
- Scalability improved with tile-based processing approaches
• Big Data and Cloud Computing based solutions can improve
the capabilities of the Space and Security community
- Foster use of open source technologies and of free/open datasets
- Cooperation with ESA, EC and EU entities to be furthered
- Results to be exploited in GEO (e.g. through NextGEOSS)
![Page 13: SC7 Workshop 2: Big Data pilots for Secure Societies](https://reader031.vdocuments.us/reader031/viewer/2022022411/58ea066d1a28ab89748b6015/html5/thumbnails/13.jpg)
UNCLASSIFIED / FOR OFFICIAL USE ONLY
European Union Satellite Centre © 2016
UNCLASSIFIED/FOR OFFICIAL USE ONLY
Sergio Albani
Responsible for RTDI
Thank You!