action research march 12, 2012 data collection. qualities of data collection generalizability –...

Action Research March 12, 2012Data Collection

Qualities of Data Collection

Generalizability – not necessary; goal is to improve school or classroom

Validity – the data measures or represents what it is meant to

Reliability – accuracy of instruments for measurement

Questions to Ask

Do the instruments and methods we plan to use measure what they claim they do?

Do they measure the phenomena we are studying?

Are we collecting enough data?

Establishing Validity

Utilize peer to peer coaching

Engage in persistent and prolonged observations

Record data accurately

Member checks -- check in with respondents to discuss interpretation of data

Provide thick descriptions – describe setting, participants, interventions, and research methods in detail

Establishing Validity

Do a negative case analysis – explore diversity of interpretations

Identify any researcher bias

Confirmability -- create an audit trail

Present results to key audiences

Engage in reflective planning

Quantitative Designs

Measures the extent to which how well something is done Experimental: independent variable

manipulated while other variables are controlled

Causal comparative: attempt to discover ther cause of issue

Correlational: examines 2 variables to see if a relationship exists

Survey: discover a group’s status with regard to certain variables

Qualitative Designs

Describes the qualities of certain aspects of phenomenon Ethnographic: collection of data on may variables in

a naturalistic setting Naturalistic: observations in a natural setting Participant observer: researcher becomes

participant in the research Case study: in depth investigation used to

determine the relationship between variables and certain behaviors

Content analysis: analysis of written or verbal content of documents

Methods of Data Collection

Artifacts Student generated: tests, written

assignment, performances, portfolios, artwork, projects, journals, self-assessment, peer-review

Teacher generated: lesson plans, journals, self assessment, peer review

Archived: reports, school records, documents

Methods of Data Collection

Observational Data Field notes, observation records, logs,

narratives, checklists, tally sheets, videotapes, photographs, audiotapes, organizational maps/charts, behavioral scales, time on task analysis

Inquiry Data Interviews, focus groups, conferencing,

surveys, questionnaires, attitude scales

Suggestions for Surveys & Questionnaires

Ensure that survey questions are aligned with research questions

Pilot test the survey

Keep survey brief and to the point

Do not ask questions unrelated to your survey

Triangulation

Multiple forms of data are collected and analyzed

Use at least three ways to look at phenomena to identify themes or characteristics of the situation

Ethics

Confidentiality: privacy is protected by ensuring confidentiality of information

Permissions: permission is obtained to carry out the research from people in positions of responsibility

Informed consent: participants are informed of the nature of the study and provide formal consent to be included