energy data management center presentation file sdmx-ml ... (comma separated value) ... energy data...
TRANSCRIPT
![Page 1: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/1.jpg)
© OECD/IEA 2013
The Energy Data
Management Center &
Database Structure
Presentation and Exercises
Energy Statistics Training
Paris, February 29 – March 4, 2016
Ivo Letra
Energy Data Manager
![Page 2: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/2.jpg)
© OECD/IEA 2013
Outline
WHAT is EDMC?
WHY is EDMC Important?
HOW to use EDMC?
![Page 3: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/3.jpg)
© OECD/IEA 2013
WHAT is EDMC?
The EDMC is a complex database available on-line
Profile Based Client-Server application
Responsible for Collecting, Processing and Reporting of Energy Data
![Page 4: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/4.jpg)
© OECD/IEA 2013
WHAT is EDMC?
Data Collection
Responsible for Storing Data for 34 Countries
![Page 5: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/5.jpg)
© OECD/IEA 2013
WHAT is EDMC?
Data Processing Submission of annual and monthly questionnaires by countries using any
of the 11 available questionnaires
Validate it according to a predefined set of rules
![Page 6: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/6.jpg)
© OECD/IEA 2013
WHAT is EDMC?
Data Visualization
Tables
Time series
![Page 7: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/7.jpg)
© OECD/IEA 2013
WHY is EDMC Important?
Cross-questionnaire checking
More efficient co-operation with EuroStat.
The country users can automate the data submission
A faster data quality process.
Data submissions are done in a more secure way
![Page 8: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/8.jpg)
© OECD/IEA 2013
WHY is EDMC Important?
Guarantees the consistency of the forms being used
A client-server solution for a better dissemination of
new questionnaires
Country user
Internet EDMC
online forms
Excel
questionnaire
![Page 9: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/9.jpg)
© OECD/IEA 2013
HOW to use EDMC?
The EDMC: Excel Templates and Forms
EDMC
online forms
Excel
questionnaire
Country
database
Country user Country users
IEA users
ASCII
file
SDMX-ML
file
![Page 10: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/10.jpg)
© OECD/IEA 2013
HOW to use EDMC?
EDMC Questionnaires
5 independent Annual Questionnaires(Electricity, Coal, Gas, Oil,
Renewables). Questionnaires sent with prefilled time series.
5 Monthly Questionnaires(MOS Oil, MOS Gas, Maxi JODI, JODI Gas,
JODI). Empty templates.
1 flexible Emergency Reporting Questionnaire (QuE).
![Page 11: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/11.jpg)
© OECD/IEA 2013
HOW to use EDMC?
Data transfers from CSV (comma separated value)
From a CSV file created from the annual/monthly IEA excel questionnaire.
Use the “Export” button on the menu page in excel questionnaire.
Directly from your own database:
via a CSV file
![Page 12: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/12.jpg)
© OECD/IEA 2013
HOW to use EDMC?
EDMC Online Forms
![Page 13: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/13.jpg)
© OECD/IEA 2013
HOW to use EDMC?
EDMC Inconsistency Checks Internal consistency checks
Cross-questionnaires consistency checks
Running the checks online
![Page 14: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/14.jpg)
© OECD/IEA 2013
HOW to use EDMC?
EDMC Notify
Once you complete a questionnaire inform us
A consistency check will be run automatically
![Page 15: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/15.jpg)
© OECD/IEA 2013
HOW to use EDMC?
EDMC Monitoring The EDMC consists of over 170 data sheets!
And it keeps track on: New Submissions:
Which data have been modified?
By whom?
What was the previous value?
Data changes are transparent. User can follow data “history”
![Page 16: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/16.jpg)
© OECD/IEA 2013
Conclusion
WHAT is EDMC?
Online reporting tool to facilitate gains in timeliness, completeness and consistency of data submissions .
Collects, Processes and Reports Energy Data from National Administration
WHY is EDMC Important?
Integrated tool for data quality (consistency checks, log historical changes)
A faster and secure way for Data Submissions
HOW to use EDMC?
Use Online Forms or CSV files for Data Submissions
Monitor and check submitted energy data. And assure its quality.
![Page 17: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/17.jpg)
© OECD/IEA 2013
Questions
How many Input Questionnaires can EDMC process?
A) 3
B) 10
C) 11
Ways for uploading Data?
A) EDMC Online Forms and XLS
B) XLS and CSV
C) CSV and EDMC Online Forms
![Page 18: Energy Data Management Center presentation file SDMX-ML ... (comma separated value) ... Energy Data Management Center presentation Author: Frederic Daniel Created Date:](https://reader034.vdocuments.us/reader034/viewer/2022051723/5aab10077f8b9aa9488b823e/html5/thumbnails/18.jpg)
© OECD/IEA 2013
Questions?
Now let’s practice the interaction between the excel files and the energydatacenter website
https://test.energydatacenter.org