1 Data management and QA/QC with priority data flows in EEA 8 th Joint TFEIP/EIONET meeting Dublin, October 2007 Sheila Cryan, EEA 2 Priority data flows EEA and EIONET set of agreed, stable, well-defined objectives provide a focus for countries when they are putting procedures in place for regular reporting. better performance through comptition amicale praise for achievements rather than blame for failures. 3 Who and what? 4 Regular annual cycle 5 Data reporting in 1990s The Public and Decision-Makers NFP, other National Authorities PCP, NRC EEA Big report consultants ETC ACC ETC BD ETC Water CECOthers 6 What is Reportnet? Reportnet is a system of integrated IT tools and processes creating a shared information infrastructure to support the reporting of environmental data and information in Europe 7 EEA The Public and Decision-Makers ETC ACC ETC BD ETC Water NFP and other National Authorities PCP, NRC ESTATDG ENV Others Reportnet and after :-) 8 EEA NRC NRC NFP ETC Data Collection Data Handling Dissemination of information 9 Rotating Reportnet 10 Reportnet Reporting Obligations Database Reporting obligations [Acidification] 11 Definitions in Reportnet Data Dictionary 12... > Tables > Elements > Code lists 13 Reportnet Central Data Repository 14 Immediate feedback to the data reporter 15 2nd level data quality checks outlier median max. tolerated value = median * 1.5 min. tolerated value = median / 2 no outlier outlier? example chart outlier 16 Reportnet, version 1b Content monitoring Information products EEA data services Reporting obligations Network directory Data dictionary Data exchange modules Data repository 17 QA/QC Summary 1.National level: MS responsibility 2.EU level: Data quality index 3.EU level: Validation of reported data The Reportnet system is designed to support quality control of reported data. A clear specification of data elements, data types and code lists is needed. Data element specification in most reporting sheets need further elaboration so that meaningful quality checks can be carried out. 18 We do not have a magic data washing machine! The good thing about data quality is that literally anyone who wants can contribute to its improvement. 19 20 Content in Reportnet 3716 envelopes (8 October 2007) 21 Information products Content monitoring Data dictionary Reporting obligations EEA data services Data exchange modules Network directory Data repository Data handling Data reportingData dissemination Reportnet under the magnifying glass 22 Data repository New features Content monitoring 2004 GDEM = Converters + Webforms + QA 2005 More (automatic) converters Data Merging Module (DMM) = Aggregator UNS = Content monitoring, CAS 2006 Improved handling of GIS data: i.e. conversion, editing, display and QA 2007 (?) Default workflow >> Customised workflow