streamlining data compilation and dissemination
DESCRIPTION
STREAMLINING DATA COMPILATION AND DISSEMINATION . ILO Department of Statistics. Edgardo Greising [email protected]. Introduction. Why ? High maintenance costs Low coverage Problems of comparability between data What? Applications Procedures Objectives Better response rate - PowerPoint PPT PresentationTRANSCRIPT
STREAMLINING DATA COMPILATION AND
DISSEMINATION ILO Department of Statistics
Edgardo [email protected]
Why?◦ High maintenance costs◦ Low coverage ◦ Problems of comparability between data
What?◦ Applications◦ Procedures
Objectives◦ Better response rate◦ Reduced delay in disseminating◦ More indicators covering the DW agenda◦ Improve overall data quality
Introduction
The old system◦Process overview◦IT considerations
The new approach◦Process overview◦IT considerations
Conclusions
Agenda
The old systemProcess Overview
Paper or faxquestionnaire
SAS Database
SAS Database(Replica)
YEARBOOK Publication
Automatic Upload(per sheet basis)
Format & totals check
Manual Inputby Stat. Assistant
Full DB Consistency check
Automatic printout generation
OPTIONAL Editingby Stat. Assistant
Weeklyupdate
LABORSTA Website
YEARBOOK CD
No Answer
Manual data grabbingby Stat. Assistant
Internet
Excel questionnaires(9 books per country)
Manual consistency No procedure to re-contact non-
responding countries Thousands of footnotes, dozens
of them meaning exactly the same
“Source & Methods” metadata collected as text documents
Veracity relayed on huge workload
Declining response rate Delayed publication release High direct costs Overburden to countries
The old systemIT considerations
Paper or faxquestionnaire
SAS Database
SAS Database(Replica)
YEARBOOK Publication
Automatic Upload(per sheet basis)
Format & totals check
Manual Inputby Stat. Assistant
Full DB Consistency check
Automatic printout generation
OPTIONAL Editingby Stat. Assistant
Weeklyupdate
LABORSTA Website
YEARBOOK CD
No Answer
Manual data grabbingby Stat. Assistant
Internet
Excel questionnaires(9 books per country)
Data stored in a hierarchical database
Time consuming «per sheet» upload procedure
Unfriendly consistency checking program turned useless
Data with errors not marked, could be published
No solution for “false positives” Command line editor Disconnected dissemination tools Manual workflow management High maintenance costs
The new approachProcess Overview
Country-centric approach Broader interaction with countries
◦ Off-line x-Questionnaire (Excel)◦ e-Questionnaire◦ EDI (SDMX)
Controlled vocabulary footnotes system
Error-free data passed to the dissemination database
New ILOSTAT website integrated to Department of Statistics’ and ILO’s IKMG
Paper or fax
questionnaire
Data CollectionDatabase
Web Database(Replica)
YEARBOOK Publication
Full AutomaticUpload
Manual Inputby Stat. Assistant
Consistency check
Automatic printout generation
Editingby Stat. Assistant
Weeklyupdate
LABORSTA Website(with dynamic charts and maps)
NO
YEARBOOK CD
Excel questionnaires(1 simplified book)
SDMX fileE-Questionnaires
(on line via internet)
Full AutomaticUpload
Stat. AssistantE-mail or phone call
Country counterparts
Selected data collection mode
CORRECT?
Main Database
YES
No Answer Received
Error Report
Data Flow Control Dashboard
1 2 3 4 5
The new approachIT considerations
Modular design following GSBPM Oracle RDBMS and development tools Automated procedure for xQ and SDMX
uploading with structural consistency E-Questionnaire online data collection Single set of metadata Single interactive consistency
procedure regardless of data collection means
«False positives» handling thru allowance issuing
Full screen data editor Dynamic content dissemination website Data workflow management module
8
Data WorkflowE-mail
(country + user)Qtable
(country + indic + survey)
LABORSTA data
Content &Documents
Current website services deliveryIndependent user interfaces
Colaboration
WCMS 10g
SAS
Plone
LABORSTA backoffice
Oracle WebCenter Portal
Content &Documents(Dynamic)
ILOSTAT data BackofficeApplications
WCMS 11gWCMS 10g
Oracle DBMS
OBI EE
WebCenter Spaces
APEX SAS
Oracle DBMS
Colaboration &Social Network
New website services deliveryUnified user interface
Conclusions Increased coverage Improved opportunity Improved quality Reduced overburden Standards based General purpose Reduced TCO
Questions?E-mail:[email protected]
Skype:egreising
Twitter: egreising
LinkedIn: http://www.linkedin.com/in/egreising
Thank you!E-mail:[email protected]
Skype:egreising
Twitter: egreising
LinkedIn: http://www.linkedin.com/in/egreising