icsu world data center for geoinformatics and sustainable...

37
ICSU World Data Center for Geoinformatics and Sustainable Development as a platform for interdisciplinary research

Upload: doannhu

Post on 04-Feb-2018

218 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

ICSU World Data Center for Geoinformatics and Sustainable Development as a platform for interdisciplinary research

Page 2: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

ICSU World Data System worldwide «community of excellence» for multidisciplinary scientific data

105 Member Organizations 68 Regular Members, 11 Network Members, 8 Partner Members, 18 Associate Members

WDS Scientific Committee: Sandy Harrison (Chair), Ingrid Dillo (Vice-chair), Wim Hugo (Vice-chair), Aude Chambodut, Alex de Sherbinin, Arona Diedhiou, Claudia Emerson, Elaine M. Faustman, Toshihiko Iyemori, Guoqing Li, Sanna Sorvari.

Ex officio: Heide Hackmann (ICSU), Yasuhiro Murayama (NICT) http://icsu-wds.org

Page 3: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

TRUSTED DATA SERVICES

FOR GLOBAL SCIENCE

Goals • Enable universal and equitable access to

quality-assured scientific data, services, products and information

• Ensure long-term data stewardship • Foster compliance to agreed-upon data

standards and conventions • Provide mechanisms to facilitate and improve

access to data and data products

Initial System Architecture & Functional Structure

ICSU-WDS is an interdisciplinary global federated system of long-term data archives and data services. Roles in the system encompass the entire data management chain, from data production to publication, and WDS Members can hold a number of these roles. Emphasis is also placed on linking with data production facilities, in particular, science projects and programmes.

http://icsu-wds.org

Page 4: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

WDC-Ukraine establishment

WDC-Ukraine creation Decision of - Presidium of National Academy of Sciences of Ukraine, - Ministry of Education and Science of Ukraine and - Geophysical Center of the Russian Academy of Sciences

2006

WDC-Ukraine certification as WDS member

2011

Memorandum of Understanding between the International Council for Science (ICSU)

and the World Data Center for Geoinformatics and Sustainable Development (WDC-Ukraine)

Page 5: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Main science directions

• Geoinformatics • Sustainable Development

• Modeling of complex systems of different nature, incl. social, economic, environmental systems and processes

Main activities • Provision of all main phases of data management

(collection, quality assurance, storage, processing, sharing, reporting and long-term stewardship) for scientific data of various nature.

• Development of mathematical models, methods and tools for assessment and decision-making in complex systems.

• Development and support of information systems and services focused on data analysis and processing.

Page 6: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

WDC Structure

• Laboratory of Computer Modeling and Data Mining • Laboratory of Geographic Information Systems • Laboratory of Econometrics and Forecasting • Laboratory of space data • Laboratory of international scientific and educational

projects • Laboratory of system analysis of financial markets

(with Institute for Applied System Analysis)

• Laboratory of environmental sustainability monitoring (with Department of Cybernetics of Chemical Technology Processes)

• Laboratory of the global economy, regional research and microeconomics (with Department of International Economics)

• High Performance Computing Centre • Engineering Group • Administrative group

Page 7: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Institute of Geography

of NAS of Ukraine

cartography data

Main Astronomical Observatory

of NAS of Ukraine

space geodesy and geodynamic; ultrarays; sun information

Chornobyl Center for Nuclear

Safety, Radioactive Waste and

Radioecology

data on radiation, ecological, and medical consequences of

the Chornobyl catastrophe (Shelter Safety, Health and

Radioecological Consequences)

Institute for Applied System Analysis

basic and applied research in the field of methodology of system analysis of complex objects and processes of social, economic, environmental and technological directions

Institute of Geophysics

of NAS of Ukraine

seismology, gravimetry, thermal stream, arkheo- and paleomagnetism, magnetic

measuring, current motions

Scientific Center for Aerospace Researches

of Earth

aerospace pictures for the use in geology, ecology, rural,

forest and water economy, prognostication of global

changes of environment and catastrophes

WDC-UKRAINE

New model for multidisciplinary WDC was defined as "network of networks" 21st Int.CODATA Conf., 2008, Kyiv, Ukraine

Network of Networks

Central Geophysical Observatory

Hydrology, hydrography, meteorology and climatology, environmental pollution

http://wdc.org.ua

Page 8: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Research infrastructure

Geographically dispersed nodes High performance computing cluster

Page 9: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

HPCC Structure System 1: • Sites:

44 nodes with two Quad-core Intel Xeon E5440 @ 2.83 Ghz processors and 8 GB of RAM 68 nodes with two Dual-core Intel Xeon 5160 @ 3.00 Ghz processors and 4 GB of RAM

• Data exchange network: InfiniBand • Disk space: 6 Tb distributed file system based on the LustreFS • Capacity: 7, peak linpack TFlops • ОС: CentOS release 5.2 • MPI: openmpi 1.2.8 • The local resource manager: Slurm • Access protocol: SSH

System 2: • Sites: 16 nodes with two Quad-core Intel Xeon E5345 @ 2.33 Ghz processors,

8 GB of RAM and disk capacity of 500 GB • Data exchange network: InfiniBand • ОС: MS Windows Server 2008 HPC Edition • MPI: MS MPI 2.0.1551 • The local resource manager: HPC Job Manager • Protocol access: RDP

Node motherboard supports IPMI interface for remote control. Data storage system includes the following components: • 6Tb + 6.5 Tb of space on the base of FalconStor storage systems • 20 Tv space in strip archive

Page 10: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

• Distribute data • share data • control access • establish copyright • promote

data

• Follow-up research • new research • undertake research reviews • scrutinize findings • teach

and learn

• Design research • plan data management (formats, storage etc) • plan consent for sharing, locate existing data

• collect data (experiment, observe, measure, simulate)

• capture and create metadata

• Enter data, digitize, transcribe, translate • check, validate, clean data

• anonymity data where necessary • describe data

• manage and store data

• Interpret data • derive data

• produce research outputs • author publications

• prepare data for preservation

• Migrate data to best format &suitable medium

• back-up and store data • create metadata and documentation • archive data

Creating data

Processing data

Analyzing data

Preserving data

Giving access to data

Re-using data

Link: http://www.data-archive.ac.uk/create-manage/life-cycle

CONTINUOUS LIFE CYCLE OF RESEARCH DATA

Page 11: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

BI & Analytics Platform of WDC-UA

Basic • Online Single Page Application (SPA) design • SPA Hosting • Widget based dashboards • Widgets interaction • Flexible navigation • Flexible page layout (device independent) • Skins, full app internalization (without reload),

management of app resources • User collaboration support • Apps Access policy

Advanced • Toolkit for Apps Management (ready to use) • Toolkit for Data Management: Reach metadata support (tags,

categories, lookups), full dataset internalization, dataset version service, data uploads/downloads (ready to use)

• Toolkit for Data Analysis & Visualization: multidimensional data cube manipulation, data queries (projections, selections, joins), interactive charts, multilayered maps, tables, embedded data processing and data mining (ready to use)

• Toolkit for Project Management (implementation stage)

Key features Pilot version: http://open.wdc.org.ua/app/SDI/

Page 12: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Analysis of Complex Social, Economic and Ecological Systems

• Cointegration for data of different nature • Working with unstructured information • Developing methods and models for data

quality estimations, filling of empties and data-based forecasts. • Validity check of data using regression analysis

and filtration. • Clasterization and sampling for dig data. • Modelling optimal strategies based on object’s

previous behavior estimations. • Data mining for big data in conditions of strong

time limitations.

Page 13: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Multivariate exploratory techniques

Normalizing

Filtration

Dependence analysis and reduction of models

Dependency Analysis

Investigation of causality

Design of influence diagrams

Estimation of model parameters

Definition of intervals for data visualization

Reduction of the parameter space and the choice of projections

Gaps in Data Processing

(missing data)

Formal Clusterization

Formal interpretation of causality

Dependency Analysis

Development of indicators

Development of indicators

Development of indicators

Gaps in Data Processing (missing data)

Gaps in Data Processing (missing data)

Gaps in Data Processing (missing data)

Error Estimation

Analysis of reliability and validity

Development of indicators

Basic Statistics

Goodness-of-fit test

Principal Component Analysis

Factor Analysis

Bayesian Networks

Entropy Analysis

Correlation Analysis

Clusterization

Regression Analysis

Page 14: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Advanced / Big Data Analytics

• Statistics • Optimization • Uncertainty quantification • Machine learning • Network and graph analysis • Analysis of streaming data • Data reduction

(incl. dimension reduction, feature extraction and topological methods)

Page 15: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Research Projects and Grants 2012 - 2013 The development of tools for multi- complex models building (0112U000557) 2013 - 2018 DFATD funded project “Laying the Foundation for a Spatial Data Infrastructure: Building

Capacity within the Ukrainian Government to Support Sustainable Economic Growth” (S-065681)

2014 - 2015 The development of tools for the analysis of municipalities’ sustainable development (0114U000671)

2014 - 2016 Methodology of quantitative evaluation and analysis of a k-society development (0114U000670)

2015 - 2016 A system approach and implementation methods for technical-communicational component of strategic environmental assessment in context of adaptation to regional climate change (0116U006141)

2016 - 2016 SSE Chornobyl NPP Status Monitoring (130516) 2016 - 2017 Foresight Analysis of future economy of Ukraine for midterm (2015–2020) and longterm

(2020–2030) time horizons 2016 - 2017 Development of information technologies for modeling, quantitative evaluation and

forecasting the impact of the threats of conflicts and weapons proliferation on sustainable development of the society in regional and global contexts (STCU #6166)

2017 - 2019 Development of an online platform for analysis and scenario planning of sustainable development of the regions of Ukraine in the context of the quality and safety of human life (0117U002476)

Page 16: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Annual analytical reports

http://wdc.org.ua

Analysis of sustainable development: global and regional contexts Foresight Analysis of future economy of Ukraine for midterm (2015–2020) and longterm (2020–2030) time horizons

Page 17: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Foresight and construction of the strategies of socio-economic development of Ukraine on mid-term (up to 2020) and long-term (up to 2030) time horizons Done SWOT-analysis of 10 drivers (clusters) of Ukraine's economy and

its socio-economic segment, as an integrated system. Using the SWOT analysis techniques, the method of "two axes" and the

method of "branch" the 8 scenarios of socio-economic development of Ukraine for 2030 were created.

The influence of external and internal factors (events) to the level of social transformations in Ukraine through measurement differences (angle) between the vector of the government's actions and the vector of social activity of society was estimated.

Fifty-lined main actions of the government in the form of socio-economic development strategy of Ukraine were constructed.

These results may be used by decision makers at the state level, civil society institutions and international organizations for defining rational policy and constructive plans of social and economic development of Ukraine for mid-term and long-term time prospects.

http://wdc.org.ua/sites/default/files/WDC-IASA-FORESIGHT-2016-EN.pdf

Foresight Analysis

Page 18: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Indicator models

Hierarchical system of indicators and indices (>80 datasets).

Sustainable development Index 2016

Page 19: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Index of Ecological dimension Environmental threats

The index covers 15 indicators, in particular

The index of drinking water quality Indicator of radiological condition of the

territory (за 137Cs, 90Sr, 238+239+240Pu)

Indicator of the carbon trend of the regional economy

Page 20: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Sustainable Development Index 2016 Country Ranking

10 lead countries Germany Australia Switzerland Sweden Canada Denmark Norway Netherlands Finland Japan

10 last countries Kenya Mozambique Angola Philippines Ukraine Syria Nigeria Central African Republic Pakistan Yemen

Page 21: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is
Page 22: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Chornobyl NPP Status Monitoring Project tasks: • Inventory and cataloging of information resources SSE

"Chornobyl NPP" to organize interactive search by subject classifications.

• Publication of information and deployment of databases of Chornobyl NPP in the ICSU World Data System.

• Development and implementation of information and technical means to collect, exchange and sharing of information in the field of decommissioning nuclear power reactors, radioactive waste management, nuclear safety, the transformation of "Shelter" into an ecologically safe system, rehabilitation of contaminated areas.

• Exchange of scientific information and data on the basis of software standardization, interoperability, meta descriptions and continuous actualization of data based on international standards and requirements of the World Data System.

• Using communication equipment and server hardware, data warehousing and application software of WDC-Ukraine for the collection, storage, and archiving of SSE "Chornobyl NPP" data.

Page 23: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Prediction of Air Pollution Nitrogen dioxide in Kyiv

Page 24: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

The relationship between ground observations data and remote sensing data NO2

Page 25: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Correct with using research tool for value of measuring pollution NO2.

Page 26: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Dynamics of change of air pollution index by cities of 1992 - 2013

Page 27: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is
Page 28: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Building of Architecture Geoinformation Systems

• Geodatabase development • creation of applications

• Web geoservices processing and services

Competence World Data Center in GIS Spatial Data Analysis:

geostatistical analysis machine learning Spatio-temporal clustering Geographically Weighted Regression

Page 29: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

PPRD‐East Project Title • Programme for the Prevention, Preparedness and Response to

Man‐Made and Natural Disasters in the ENPI East Region (PPRD‐East) – EuropeAid/129397/C/SER/Multi

Countries: • Armenia, Azerbaijan, Belarus, Georgia, Moldova, Ukraine

Project purposes: • To contribute to the development of the Partner Countries' civil

protection capacities for disaster prevention, preparedness and response

• To bring the Partner Countries progressively closer to the EU Civil Protection Mechanism and improve cooperation among themselves.

WDC-Ukraine tasks • Developing geospatial database for determination of

characteristics of critical infrastructure • Estimation of asset characterizations of critical Ukraine

infrastructure on the base of overlay analysis using geospatial layers

• Developing the Critical Asset map for territory of Ukraine

2011-2014

Page 30: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Web Atlas "Sustainable development"

Page 31: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Catalog of remote sensing open data

The catalog contains open data of thematic processing of remote sensing for Ukraine, which sorted the following areas: • Land Cover • Nature resources • Environmental issues

Page 32: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Vancouver Island University, Canada Taras Schevchenko National University of Kyiv, Ukraine National Technical University of Ukraine, “Igor Sicorsky

Polytechnic Institute", Ukraine

Laying the Foundation for a Spatial Data Infrastructure: Building Capacity within the Ukrainian Government to Support Sustainable Economic Growth

Page 33: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Primary Project Goals

• Preparation of certified professionals for key government agencies in the fields of GIS and Spatial Data Infrastructure (SDI)

• Transfer of Canadian experience in the field of training for SDI

• Help to establish an educational centre located at the NUK and NTUU “KPI”, which provides educational and scientific expertise for the Ukrainian SDI

Page 34: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Main Immediate Outcomes

• Six NUK and NTUU “KPI” instructors trained in technologies to support the Ukrainian NSDI

• Six course curricula on SDI developed, adapted, and translated

• Approximately 100 civil servants (70 female and 30 male) trained and certified in Spatial Data Infrastructure and Geomatics technologies

Page 35: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Professional community "Geomatics"

120 members, 25 organizations and 10 regions Expert advice in the field of GIS and Geomatics 6 training courses 22 scientific, educational and applied projects

Page 36: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Links

• http://wdc.org.ua • http://wdc.org.ua/activities/Service/StatPlanet.html • http://wdc.org.ua/~atlaswdc • http://wdc.org.ua/data_analysis/ • http://wdc-app.cloudapp.net/app/Slavytych/ • http://wdc-app.herokuapp.com/app/Pollution/pol3 • http://wdc-app.cloudapp.net/app/sustainable-

development/threats

Page 37: ICSU World Data Center for Geoinformatics and Sustainable ...inform.ikd.kiev.ua/content/ua/news/2017/kyiv_smart_era_planet/2017...multidisciplinary scientific data . ... ICSU-WDS is

Contacts World Data Center for Geoinformatics and Sustainable Development http://wdc.org.ua [email protected] Address: 37, Peremohy ave., 03056, Kyiv, Ukraine. Phone: (+380 44) 204 80 14 Fax: (+380 44) 204 8153

Any questions?

Thank you for your attention