how to implement survey
TRANSCRIPT
Implementation of an International School Data collection project
Author: Fernando Rui Pinheiro CamposAgrupamento de Escolas Cardoso Lopes
Portugal
Project: ICT as an independent learning tool
Comenius Meeting
Belgium, February 2, 2009
02-02-2009 Fernando Rui Campos 2
Process to collect data
Moodle Plataform
Module QuesttionaireEach partner as its
own enviroment
AnswerQuestionnaire
Cardoso LopesFilipe Neri
Santo AntónioAraskoll
DBMS(Moodle)
ExtractingData
File ConvertionFirst check
http:
http:
SPSSimport
codebook
DBMS(SPSS)
02-02-2009 Fernando Rui Campos 6
After conversion to Excel
� First Line includes variable names fromMoodle, build during the design of thequestionnaire template.
02-02-2009 Fernando Rui Campos 9
First Procedure
� By default SPSS import adjust all the variables to “Nominal”
� Adjust the variable type in “measure” according to:
� Continnuos variables like : Ages need to be convert to scale .
� Likert scale questions 1-5 : Studends leves questions needto convert to ordinal.
�
example
02-02-2009 Fernando Rui Campos 12
Validation Example with only a few samples and analyzing data
� SPSS statistics viewer
02-02-2009 Fernando Rui Campos 15
Cronbach Alpha – Example with real dataextracted from Answer to the questionnaire
Acording to Garson(2008). “The widely-accepted social science cut-off is that alpha should be.70 or higher for a set of items to be considered a scale, but some use .75 or .80 whileothers are as lenient as .60.”
02-02-2009 Fernando Rui Campos 16
Excel File with Three color, ClassExample (This as simulated data)
Level 3Level 2Level 1
Notes: Level 1 - max. 60%,Level 2 - max 80%, Level 3 -100%1201200911406AIdentification reference
Level 1 - 30FM1115
52265M1414
77377M1113
44255F1310
42170M159
53353F115
62,4278F114
44,8256F113
56270F112
32240F131
Final ClassificationLevelClassificationGenderAgeNº
6K0-100%12-01-200911h40
ClassScaleDateTime
02-02-2009 Fernando Rui Campos 17
Things to Add or change to questionnaire after pre-test
1- Add Subjects to the list, and the option Other
2- Add the reference age of the students
3- Add as option the location to found the digital resource used
4- Include explanation for the scale NS/NR or N/A (depends in the language ) actual question 17.
6- Corrected the scale question 12 , level 4 – partially agree .
7- Other minor changes.
8- Added Identification Reference (to Link the students results).
9- Need for an additional user name for each teacher
02-02-2009 Fernando Rui Campos 20
What to do to the openquestion?
� Last question can be answered in mother tongue language (if the teacher doesn't understand) and in English (translated from an expert (an English teacher for example).
� Content analysis from the Questionnaire Open question.
02-02-2009 Fernando Rui Campos 21
Before continue
� Ethical question
� Need a document with authorizations from teachers to be public their data.
� Common document in English
02-02-2009 Fernando Rui Campos 22
Things to be done
� Organize the authorizations � Create the questionnaire after the pretest Phase
and distribute for all the partners. � Create one user for each teacher in each partner.� Create the codebook for the final version, for
students results and teacher questionnaire.� Create de digital resources for additional disciplines
that want to include the three color method or other methods.
� Choose a set of statistics tests according to the project objectives and available data.
� Many other implementation details …
02-02-2009 Fernando Rui Campos 23
References� Garson,D.G.,2008. Available on Line at http://faculty.chass.ncsu.edu/garson/PA765/standard.htm .
� Campos,F., Maio,V. (2008) . Unpublished document. Medidas em Educação uma Introdução.
� http://moodle.org/, Modules and plugins available at May 15, 2008.
� http://www.cardosolopes.net/elearning, available at May 23,2008.
� SPSS version 17, http://www.spss.com/ .
02-02-2009 Fernando Rui Campos 24
The End
Thanks for your patience
http://www.cardosolopes.net
Fernando Rui P. [email protected]
Agrupamento de Escolas Cardoso Lopes Amadora, Portugal