data management in the field ari haukijärvi 2nd ehes training seminar
TRANSCRIPT
Data management
in the field
Ari Haukijärvi
2nd EHES training seminar
Division of tasks and preparation of the fieldwork
• The Central Office - Overall data management preparation and coordination during the fieldwork
• Arranging computer equipment and networks for the fieldwork teams (if computerized data collection is used):
• Planning the structure of computer network(s) and equipment• Establishing and customizing the network(s)• Installing the survey software• Planning of software updates during the fieldwork• Testing
• Training, responsibilities, and support of the fieldwork teams:
• In putting up the network (if needed)• In using the data recording equipment and software• Issuing responsibilities to team members• Providing instruction manuals for the fieldwork• Arranging helpdesk during the fieldwork
Division of tasks and preparation of the fieldwork
• The Central Office
• Coordinating the fieldwork data management• Database(s) maintained in the Central office can be used to
monitor and control the fieldwork:• Scheduling appointments• Creating invitations, lists of appointment schedules, calendars,
etc.• Storing fieldwork inventory data• Generating feedback
• Receiving and processing the survey data
Division of tasks and preparation of the fieldwork
• The Fieldwork teams
• Setting up the equipment and network connections (if needed) at the fieldwork site
• Basic technical knowledge in using equipment and software for data collection
• Responsibilities in backing up and transferring the data• Named person(s) or all team members?
Collecting the survey data
• Data from• Questionnaires and interviews• Physical measurements• Laboratory tests and samples
• … are recorded• on paper forms• on workstations, from which data files are copied to a
local (fieldwork team) network’s server• directly to the local (fieldwork team) network's server• directly to the central survey database (in the Central
Office)
Example 1 (System architecture of Health 2000 Survey)
Example 2 (MAAMU)
Data error checking
• Routine checking procedures:• Visual checking of key items at examination site• In computer-assisted data collection automatic built-in
software checks at examination site• Extensive checking for all computerized data (in the
Central Office)
• … to ensure:• complete data records• no errors• no lost or mixed-up records
Data management in the field- Key issues
• Identification
• Data confidentiality and security
• Backing up the data
Identification
• Follow-up of participants through the survey process
• to make sure that correct data corresponds to each subject, and
• to monitor in which phase of the survey each subject is
• by means of• unique subject ID code (Serial number): used to identify
the subject throughout the survey• barcodes (referencing to the subject ID)
• in survey forms• in laboratory samples
Data confidentiality and security
• Paper forms• Not to be left alone for unauthorized to see or get lost• Clear responsibilities in collecting and storing• Sealed containers (also during shipments)• No personal information included > subject ID code
• Data in electronic format• Locking workstations and server computers when not used• Safe place for equipment when not used• Encrypted hard disks• Encrypted data transfers• Data should not be archived in personal directories or local
computers' hard drives• The personal data of survey subjects should be encrypted and
available only to persons who have authorized access
Backing up the data
• The data need to be backed up• regularly• on external storage device (e.g. external hard drive,
optical disk, another computer, etc.) separate from the original data source
• ’Remote’ backup: Data transfer to the Central Office
• Logging the data transfers
Data correction/documentation
• Changes to the data • According to the rules for data verification and
correction, specified in the national manual• By trained persons• Need to be documented:
• Version of data• What was changed• Reason for the change• Time of the change
• The original raw data is backed up and unchanged