survey methods
TRANSCRIPT
How to implement an International Survey School parternership (an introduction)
Comenius Meeting Agrupamento de Escolas Cardoso LopesNovember 18, 2008
Project Name: ICT as an effective tool for independent learning
ICT as an effective tool for independent learning - Fernando R. Campos 2
Challenge: How to get data and communicate outcomes? From:
Different CountriesDifferent Educational SystemsDifferent Languages
Using scientific and tested methods ?
ICT as an effective tool for independent learning - Fernando R. Campos 3
Challenge: How to get data and communicate outcomes? Have na Agreement with
MethodologyMethodsApproaches Instruments
ICT as an effective tool for independent learning - Fernando R. Campos 4
What is basic needs to start implementing the data acquisition? Agreement of the specific instruments
Questionnaire
Agreement in the methodology
Testing and assesment
ICT as an effective tool for independent learning - Fernando R. Campos 5
How to solve the language diferences? Using a common language (English).
Building common instruments for data acquisition.
Building a participated responsibility between partners.
Include all partners specifcs contexts in the instruments
ICT as an effective tool for independent learning - Fernando R. Campos 6
How to build an instrument when different Countries and different Educational Systems are envolved?
Agree a questionnaire between partners
Build questions to include the several educational systems characteristics .
ICT as an effective tool for independent learning - Fernando R. Campos 7
Type of data
QuantitativeFrom questionnaire closed questions
Qualitative From questionnaire open questions
ICT as an effective tool for independent learning - Fernando R. Campos 8
Using ICT (Moodle) solution Questionnaire. (question example using Likert scale)
(*) - means the question is mandatory for answering.
ICT as an effective tool for independent learning - Fernando R. Campos 9
Example of Questionnaire (cont.)
Possibility to save page by page of the questionnaire.
Finishing the submission by showing the official project web page.
ICT as an effective tool for independent learning - Fernando R. Campos 10
What is the proposal for implementing data acquisition. Answering directly in Moodle questionnaire. Export answers data directly from Moodle to a
data file. One approved English Questionnaire, for the
teacher and for the student (when applicable). One entry for each partner: each school
manages its own discipline, translations, students access.
An excel File with the results from the students
ICT as an effective tool for independent learning - Fernando R. Campos 11
Example of Excel File From Students results (an example)
Time of Day____ Date:_____ School______ Scale Used:_______ Class ID______
ICT as an effective tool for independent learning - Fernando R. Campos 12
Partner responsibilities Each partner is responsible for:
Applying the methods in their schools according to the proposed .
Data recovery Data validationOpen question analysisMoodle discipline management (specific
language).
General platform management by Agrupamento Cardoso Lopes - Portugal
ICT as an effective tool for independent learning - Fernando R. Campos 13
How do I known the responses are minimum credible? Check as internal consistency
Using:
SPLIT-HALF RELIABILITY(Spearman-Brown)
Using Cronbach alfa parameter
ICT as an effective tool for independent learning - Fernando R. Campos 14
How to calculate internal consistency?
Using the acquired data from all the partners
By applying the tests (cronbach and Spearman-Brown) using a statistical package (SPSS for example)
ICT as an effective tool for independent learning - Fernando R. Campos 15
Quantitative Data - Validity
ConcernsObjectivityGeneralizabilityReplicabilityPredictabilitycontrollability
ICT as an effective tool for independent learning - Fernando R. Campos 16
Internal data validation
How do we known that the data received is valid.Check for missing valuesCheck for outliersCheck for cronbach parameter validation by
item.
ICT as an effective tool for independent learning - Fernando R. Campos 17
Some recommendations in the application of the ICT methodologies. Don't inform the students that they are in an
assessments situation (Hawthorne effect). Record the time of the day , week , month
(Stiggins 2001). Use simple indication during the tests Don't give too much information. …
ICT as an effective tool for independent learning - Fernando R. Campos 18
Who is responsible for analysis of open questions data?
Translation to English from the open question is a work to be done by each partner.
Each partner is responsible for the data analysis in the mother tongue language, translate to English and distribute information to others partners.
ICT as an effective tool for independent learning - Fernando R. Campos 19
Analyze data Model – Portuguese responsibilities, for quantities data.• Converter to Excel file from Moodle
• Aggregate data from different partners
• Applying statistics according to available data and statistical methods used in education.
• Distribute aggregated data source to all the partners.
ICT as an effective tool for independent learning - Fernando R. Campos 20
Some Ethical questions?
Obtain explicit authorizations : Each teacher needs to approve their participation in the project .
All partners need to Accept responsibility for maintaining confidentiality.
How owns the data?Shared among the partners.
ICT as an effective tool for independent learning - Fernando R. Campos 21
Some Ethical questions? Cont.
Each partner need to agree that data obtained can be used for the project divulgation proposes only.
Data cannot be used to other proposes without partners authorization.
ICT as an effective tool for independent learning - Fernando R. Campos 22
Copyright questions?
Which copyright to use?You are free: to Share — to copy, distribute and transmit the work.
to Remix — to adapt the work
Creative Comms 3.0
ICT as an effective tool for independent learning - Fernando R. Campos 23
References Cohen,L.,Manion,L.,Morrison,K.(2007). Research methods in
EDUCATION. Sixth edition. Routledge.
Fink,A. (1995).How to analyze Survey Data. Sage Publications.
http://moodle.org/, Modules and plugins available at May 15, 2008.
http://creativecommons.org/license/, available at November 14, 2008.
http://www.cardosolopes.net/elearning/course/category.php?id=12, available at November 14, 2008.
http://www.spss.com/, available at November 14, 2008.SPSS version 16
ICT as an effective tool for independent learning - Fernando R. Campos 24
The End
Thanks for your time
http://www.cardosolopes.net/projectos/Comenius/comenius1_uk.htm
Fernando Rui P. Campos [email protected]
Agrupamento de Escolas Cardoso Lopes (Amadora)Portugal