© wrc plc 2005 wise access tool article 8 reporting yvonne gordon-walker
TRANSCRIPT
![Page 1: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/1.jpg)
© WRc plc 2005
WISE Access ToolArticle 8 Reporting
Yvonne Gordon-Walker
![Page 2: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/2.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
• Introduction
• Functionality
• Concluding remarks
![Page 3: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/3.jpg)
© WRc plc 2005
Introduction
![Page 4: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/4.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Background
• Tool builds on the Access tool developed to support Article 5 reporting.• Schema group recognised the need for a tool to
help Member States prepare valid data files for submission
• This has now been extended to support Article 8 reporting
![Page 5: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/5.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Development and testing
• Initial development • Testing:
• DE,FR,FI,UK,NL,BE,IE,ES,SK,SI,SE,CZ,PL,IT:• All documentation and software provided on 12th October
2006. • All testing feedback by 3rd November.• Only testing access tool, not upload to ReportNet.• Some MS testing automatic generation of schema from
own internal systems.
• Feedback from testers used to improve tool (Nov/Dec 05)• Bug fixes• Functionality improvements• Schema changes
![Page 6: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/6.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
WISE data flow (all steps involve QA/QC)
Submission
Analysis
Development Database
Acceptance
Viewing, GIS visualisation
Production Databases (WISE nodes)
Data definition/requirements Step 1: Compliance or SoE, voluntary (or through comitology)
Step 2: End-user tool, schema/DEM, XML/shape/GML, other tools (DD, glossary), help desk
Step 3: central holding area (CDR), management of access rights
Step 4: Standardised manual or automatic tests, feedback to data submitters
Step 5: Final data storage
Step 6a: Public or restricted viewing, map service, aggregation, statistics, GIS reference dataset
Step 6b: Tools for compliance or SoE assessment, CCM2
![Page 7: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/7.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Relevant Documentation
• Access Tool User Guide.doc• Access Tool Getting Started.doc• Access Article 8 Summary of forms.doc• Access Article 8 Tables.xls• Monitoring-reporting Guidance- V5.0.doc• Article 8 Schema Guide.doc• Monitoring.xsd• SurfaceWaterMonitoringStations.xsd• GroundWaterMonitoringStations.xsd• WFDCommon.xsd
![Page 8: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/8.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
New Document
• Article 8 Workbook.doc
• Pulls together relevant info from various documents• Takes you through each step.
• Installation and setup
• Filling in forms
• Importing data
• Minimum schema requirements
• Generating XML
• Does not include ReportNet
![Page 9: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/9.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Download
• Access tool, documents etc can be downloaded from ftp site
• ftp location: ftp.wrcplc.co.uk
• username: wfdsupport
• password: wise
![Page 10: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/10.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Access tool overview
XML schema
HTML fileHTML
stylesheet
Data entry
XML file
Interface for data entry
Creation of validated XML files ready for up-loading
HTML file for viewing data
Local Remote
![Page 11: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/11.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Access tool structure
• Front-end: interface• WFD Reporting 2006.mdb
• Forms• Queries• System tables• Modules• Report
• Back-end: data storage• WFD Reporting 2005_be.mdb
• Article 8 Reporting 2006_be.mdb
• Data tables
![Page 12: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/12.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Front-End Database
• WFD Reporting 2006.mdb• Contains all functionality – forms, queries,
reports, modules and system tables which are integral with the functionality.
• No data are stored in this file.
• Contains all Article 5 functionality
• Will be familiar to users of Article 5 tool
![Page 13: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/13.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Back-end Databases
• WFD Reporting 2005_be.mdb • same back-end as used with the original front-end WFD
Reporting 2005.mdb.
• can continue to use WFD Reporting 2005.mdb
• Article 8 Reporting 2006.mdb • Separate database for Article 8 data
• Each database has its own set of data tables, stored in separate database files• there is no common data storage. This includes RBDs.
![Page 14: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/14.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Installation and Set-Up
• Full instructions in workbook (section 2)
• Can set up on any number of PCs• No usernames or passwords required
• Requirements:• Access 2000 or Access 2003
• Microsoft MSXML
• Edit Set-Up to specify paths etc.
![Page 15: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/15.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Set-Up
• You must specify• Country code
• Creator
• Output file location
• Schema and stylesheet locations• May be held locally BUT up to user to ensure latest
versions
![Page 16: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/16.jpg)
© WRc plc 2005
Functionality
![Page 17: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/17.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Functionality
• Data entry using forms (programme summary data)
• Direct import of data (monitoring stations)• can be viewed using the forms
• Validation of data
• Creation of XML files
• Creation of HTML report from XML
![Page 18: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/18.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Data entry
• Corresponds to data requirements identified in Reporting Sheets• Monitoring-reporting Guidance- V5.0.doc
• XML schema is derived from data requirements outlined
• Database design matches XML schema• Field names match element names
• Field types match element types
![Page 19: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/19.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Validation of data
• Three levels of validation:
• Point-of-entry• restrictions on what the user can enter
• Form-level• test data against Access equivalent of the schema
• XML generation• direct test against the XML schema
• no provision for validating external XML files
![Page 20: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/20.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Point-of-entry validation: Text Fields
• Alphanumeric data.
• Maximum length of the string, n, is determined by the schema
• Included in the table definition
• Need to escape XML tokens
![Page 21: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/21.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Point-of-entry validation: Text Fields – XML tokens
• Characters recognised by XML as instructions
• Automatically ‘escaped’ during XML creation
• ‘Escaped’ characters add to parsed length:
What you type in How XML interprets it
< <
> >
'
"
& &
![Page 22: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/22.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Data Entry – Caution!
• All data entered or edited via the forms are saved automatically
• A change that has not yet been saved can be undone by pressing the <Esc> keyboard key.
• Use the to create a new record, otherwise existing will be overwritten
![Page 23: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/23.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Direct import of data
• For SW and GW monitoring stations and associated data
• No user interface provided for data entry• Simple form provided for viewing direct-entry data
as datasheets• Can edit, add to, and delete, existing records on this form• Form includes form-level validation
• Use Access Article 8 Tables.xls to see how tables relate, mandatory fields etc
• Use Access Article 8 Summary of forms.doc to see how forms and tables relate
![Page 24: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/24.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Delete Options
• Deletes data for the current record
• Cannot be undone• Always asks for confirmation before deleting
• Level of deletion depends on where selected• Eg if at RBD then all data relating to programme
will be deleted
• Delete records in direct entry but seleting record and pressing <delete> key
![Page 25: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/25.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Form-level validation
• Tests data for current RBD on current form against requirements of schema
• Includes child tables where applicable
• Should be done for every form before proceeding to XML file creation stage
![Page 26: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/26.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
XML Generation: Validation
• XML validation is directly against the schema
• Data that has passed form-level validation should pass XML validation
• XML error messages may not be as helpful as form-level validation error messages
• XML parsers will not ‘assume’ anything so parsing will stop at the first error.• need to fix error before XML validation will continue
![Page 27: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/27.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
XML Generation: Stylesheet
• XML files difficult to read
• Stylesheets convert XML files to a HTML report format
• Issues:• Not complete but links set-up and available.
• Need valid XML files to run
![Page 28: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/28.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Example HTML output
![Page 29: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/29.jpg)
© WRc plc 2005
Concluding remarks
![Page 30: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/30.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Benefits
• Consistent data structures, compliant with Article 8• 3 levels of validation
• Point-of-entry• Form-level• XML generation
• Archive for future submissions• Database for internal use
• Potential to develop alternative front-ends, stylesheets
• Can be extended as new requirements come into force
• Code changes to front-end database only
![Page 31: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/31.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Possible developments
• Address current size restriction of 2000 characters in memo fields
• Provide better tools for direct entry upload and validation (check for hanging/loose records)
![Page 32: © WRc plc 2005 WISE Access Tool Article 8 Reporting Yvonne Gordon-Walker](https://reader035.vdocuments.us/reader035/viewer/2022062409/5697bfe81a28abf838cb64f7/html5/thumbnails/32.jpg)
WRc plc 200604/21/23 Portsmouth Water, November 23rd 2005
Schema changes
• Access tool was designed around schema
• Several changes to the schema were suggested by testers
• Changes to schema affect back-end (database) and front-end design of Access tool
• Better to agree any changes before roll-out of tool• Need to minimise database changes