s t a t i s t i k a u s t r i a may 2004 1 wolfgang koller may 2005 © statistik austria i n f o r...

S T A T I S T I K A U S T R I AMay 2004 1www.statistik.at

Wolfgang Koller

May 2005© STATISTIK AUSTRIA

i n f o r m a t i o n

Moving

The Impact of EDR on Long-Established Surveys:Statistic Austria’s experience in the

Short Term Production Survey

S T A T I S T I K A U S T R I AMay 2004 2

Austria‘s leading information service provider

300 surveys

420 publications

1.000 billion data cells in ISIS (data warehouse)

850 employees

50 Mio. € budgettotal quality mgmt

data protection

objective

impartial


The Short Term Survey „Production“…

basis for observing the economic cycle

since 1996 based on concentrated sample

12.000 questionnaires sent out monthly

10 different variants of questionnaires

single-unit enterprise 6 pages, ~90 questions

multi-unit enterprise 3 pages for enterprise,

6 pages per establishment

25 pages of explanation

Classifications: NACE, PRODCOM


The Short Term Survey „Production“

multi-unit enterprise

typical questionnaire: single-unit enterprise

establishment questionnaires

… with 2 to n …


One technology alone will not suffice . . .

and/

or

and/or

and/or

Nnnn

#####

+++

--------


Software development and maintenance . . .

. . . takes up more time than the traditional production process for paper questionnaires

. . . is expensive


“Expensive software experts should only be used where they are really needed”

The Concept

From hand-crafted questionnaires . . .

to the XML production line

SVY 1SVY 2


Survey preparation, -definition

e.g.Survey, VersionPeriodicity, Observation unit types Questionnaire:• content, • representation,• layout,• control flow,• validation

Resp. specificinformationResp.-structureInitialisation data

Respondent

Incoming inspection

Further processing

Complete questionnaire

ST.AT

Phases of data collection


Questionnaire Manager

e-Quest

CSI

CD-ROM

structuralmetadata

(XML)

Responsepackage

(XML) export(XML)

import(XML)

Deploy

Respondent-specific

(meta)data(XML)

[mainframe]

Receive DB

Package Storage

Respondent

MetadataManager

e-Quest follow-up processing systems

Receive

e-Quest

Distributor

Hoover

Package Mgr

Questionnaire Manager

The WindowsTM Solution: e‑Quest


Respondent-specific

(meta)data(XML)

[mainframe]

Respondent

Browser

follow-up processing systems

Generator(WSA)

HTML, JSP JavaScript, Java Web-Services

ST.AT

structuralmetadata

(XML)

e-QuestMetadata Manager

Presentation

Business LogicSOAP

Metadata

e-Quest / WebData

RDBMS

SQL

Intra

net

Internet

Browsere-QuestReceive

Subsystem

op

tion

al

Web- and J2EE-Servers

Survey using e‑Quest/Web


Benefits for the Respondents

No protracted searches in voluminous production code lists and other classifications, but quick retrieval of the correct code instead, aided by display of the codes in hierarchies, full text and synonym search, and automatic insertion of codes, texts and units of measure in the questionnaire.

An extensive multi-layered help system offers context-sensitive help only when and where it is needed.

Automatic input checks mark incorrect or implausible data with warnings and/or error texts.

Automatic calculations (sums, comparisons, etc.)

Questions can be displayed or hidden dynamically, depending on their relevance to the specific case.

Form completion can be interrupted at any time and the data saved for completion at a later time or date.

Third-party respondents have access to their clients’ forms and functions for managing them.


Respondent-side Editing

Single field checks

– Urgency:1. check immediately after the data value was entered2. check when the user says so3. check when the whole questionnaire is being validated

– Importance:

1. must be corrected in all cases

2. important warning which may however in some cases be ignored

3. simple warning

4. comment for the subject matter expert

Inter-field validation

Inter-questionnaire validation

Abstain from checks wherever feasible!


Security Aspects

Avoid risks

– expose the data to a hostile environment for as short a time as possible

Provide confidence in the questionnaire system

– security audit

Take the respondent’s security concerns seriously

– don’t base applications on the use of cookies

– don’t construct applications that do not work without

enabling Javascript

Gain trust

– respect respondent’s privacy


Short Term Survey (until 2000)

Statistics AustriaRespondent

data entry

load DB

file away

file away again

find questionnaire,make notes,

correct on paper

datachecking

registerquest.

dataediting

Error list

Host Database

Host terminal

further processing

correct data


The Short Term Survey Today

Respondent

Pot Mgr.

Data EditingMainframe processing(validation)

Data Editing

HOSTDatabase

PC-CorrApplication

e-Quest/WebIntranet

e-Quest

e-Quest/WebInternet

LAN

Dat

a-E

dit

ing

72%

20%

8%


Media Number %

Paper 7.409 94%

e-Quest 116 1%

Web 373 5%7.898 100%

Paper 6 0%

e-Quest 1891 83%

Web 379 17%2.276 100%

Paper 37 84%

e-Quest 3 7%

Web 4 9%44 100%

Paper 128 78%

e-Quest 16 10%

Web 21 13%165 100%

No response in Oct/04

Paper form

Number of questionnairesReporting month Jan 2005

(10.383 received up to March 8th)

e-Quest

New respondents in the sample as of Jan 2005

The respondents who reportedin Jan 2005 as shown on the rightreported via the following medium

in October 2004

Reporting Stream Analysis - Short Term Survey „Production“


Wir bewegen I n f o r m a t i o n e n

Moving

i n f o r m a t i o n

www.statistik.at

s t a t i s t i k a u s t r i a may 2004 1 wolfgang koller may 2005 © statistik austria i n f o r...

Documents