peer module 4: research & evaluation questions
DESCRIPTION
The Perfect Question You won’t be writing it today. You probably won’t write it tomorrow. And once you start writing, the question you end up with probably won’t look much like the question you started with. Don’t worry…you’re doing it right. This is a process. So, where to start?TRANSCRIPT
![Page 1: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/1.jpg)
PEER Module 4: Research & Evaluation Questions
Erika S. Trapl, PhDOctober 21, 2015
![Page 2: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/2.jpg)
The Perfect Question You won’t be writing it today. You probably won’t write it tomorrow. And once you start writing, the question you end up with probably won’t look much like the question you started with.
Don’t worry…you’re doing it right. This is a process.
So, where to start?
![Page 3: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/3.jpg)
Research Question Defined A clear, focused, concise, complex and arguable question around which you center your research
From https://writingcenter.gmu.edu/how-to-write-a-research-question/
Could also: Refer to the problem or phenomenon Reflect the intervention in experimental research Note the target group of participants Inform the research methods
![Page 4: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/4.jpg)
What makes a Q “good”? RELEVANT Contributes to the field Adds to the theoretical foundation Informs policy
Ask yourself “so what?” Who cares about the question and why What is the potential impact of answering your question
![Page 5: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/5.jpg)
Getting started What topic are you interested in What gets you really excited about it? What are you curious about? Can you narrow this down a little more? How much do you already know? Are there some questions you want to answer?
![Page 6: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/6.jpg)
Getting started What topic are you interested in What gets you really excited about it? What are you curious about? Can you narrow this down a little more? How much do you already know? Are there some questions you want to answer?
You are in pursuit of the Knowledge Gap. What next?
![Page 7: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/7.jpg)
The Circle of Inquiry
Adapted from: Nutting, PA, Stange, KC. Practice-based research: The opportunity to create a learning discipline. In: The Textbook of Family Practice, 6th Edition. Rakel RE (ed.), W. B. Saunders Company, 2001.
Search for Existing
Information
Focus the Study
Question
Design the Study
Collect Data
Analyze & Interpret Results
Disseminate & Implement
Identify Knowledge
Gap
![Page 8: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/8.jpg)
The Circle of Inquiry
Adapted from: Nutting, PA, Stange, KC. Practice-based research: The opportunity to create a learning discipline. In: The Textbook of Family Practice, 6th Edition. Rakel RE (ed.), W. B. Saunders Company, 2001.
2. Search for Existing Informatio
n
3. Focus the Study Question
Design the Study
Collect Data
Analyze & Interpret Results
Disseminate & Implement
1. Identify Knowledge
Gap
![Page 9: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/9.jpg)
Search for existing information Literature Search: (a) to help figure out what works; (b) to pursue a topic, problem, or question
of professional and/or personal interest; (c) to pinpoint an area of further study; (d) to provide a rationale/background for study; (e) to survey or analyze research methodology
![Page 10: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/10.jpg)
The Circle of Inquiry
Adapted from: Nutting, PA, Stange, KC. Practice-based research: The opportunity to create a learning discipline. In: The Textbook of Family Practice, 6th Edition. Rakel RE (ed.), W. B. Saunders Company, 2001.
2. Search for Existing Informatio
n
3. Focus the Study Question
Design the Study
Collect Data
Analyze & Interpret Results
Disseminate & Implement
1. Identify Knowledge
Gap
![Page 11: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/11.jpg)
The Circle of Inquiry
Adapted from: Nutting, PA, Stange, KC. Practice-based research: The opportunity to create a learning discipline. In: The Textbook of Family Practice, 6th Edition. Rakel RE (ed.), W. B. Saunders Company, 2001.
2. Search for Existing Informatio
n
3. Focus the Study Question
Design the Study
Collect Data
Analyze & Interpret Results
Disseminate & Implement
1. Identify Knowledge
Gap
![Page 12: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/12.jpg)
What makes a Q “good”? Contributes to the field Adds to the theoretical foundation Informs policy RELEVANT
Ask yourself “so what?” Who cares about the question and why What is the potential impact of answering your question
![Page 13: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/13.jpg)
How do you know you’ve got it Tell your “story” and see if it sticks Using the literature, provide a rationale Explain what we already know Identify the knowledge gap(s) State your research question(s) Describe the potential impact of your results
![Page 14: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/14.jpg)
“If you can't explain it to a six year old, you don't understand it yourself.”
- Albert Einstein
![Page 15: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/15.jpg)
The Dance of Design What is your unique opportunity to generate new knowledge?
The question
What is known What is feasible
Some questions may be best answered in small, thoughtful steps.PEER is just the start of your research.
![Page 16: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/16.jpg)
The Circle of Inquiry
Adapted from: Nutting, PA, Stange, KC. Practice-based research: The opportunity to create a learning discipline. In: The Textbook of Family Practice, 6th Edition. Rakel RE (ed.), W. B. Saunders Company, 2001.
Search for Existing
Information
Focus the Study
Question
Design the Study
Collect Data
Analyze & Interpret Results
Disseminate & Implement
Identify Knowledge
Gap
![Page 17: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/17.jpg)
Design the Study Match the method to the question Look for your particular opportunity to access meaningful data
How can you inform the knowledge gap? Use the literature to begin to inform your design
What has already been done? What were the strengths/flaws to designs? What needs to be done next to answer the
gap?
![Page 18: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/18.jpg)
Measurement Observe measurement issues as you read the literature Quantitative instruments
Items & scales Validity, reliability, relevance
Existing scales or develop your own Qualitative
Survey / interview Direct observation Case study Etc.
![Page 19: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/19.jpg)
Developing as a Researcher Pay attention and reflect In practice In reading In conversation Learning opportunities Seminars/Conferences Reading Doing your own studies Reading Joining others in their studies Reading Seek and draw lessons from feedback Carry a way to record your thoughts Let your mind wander Constantly ask questions
![Page 20: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/20.jpg)
Identifying a knowledge gap
Questions from practice Questions from listening Questions from reading Evolving questions from
Discussion (develop a team) Action/ reflection cycles Openness Making space
Write them down. Talk them out. (With anyone who’s willing.)
![Page 21: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/21.jpg)
Search for existing knowledge Sources
Google Scholar PubMed Social science literature databases Ask colleagues & experts Professional organizations
Look for Holes/Gaps Paradoxes that are ignored or explained
away (and…the “future studies” statements at the
end of a journal article)
![Page 22: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/22.jpg)
Focus the Question To fill gaps in existing knowledge Common holes to fill:
Person/Client perspective Agency/provider perspective Implementation Boundary regions between disciplines
![Page 23: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/23.jpg)
Evaluation (Research) Evaluation is research and follows the same process
What is the (evaluation) question? Is it RELEVANT? Who cares about this and why? How will the results be used?
The audience for evaluation research may be more narrow
Typically examines aspects of a program Could be process, could be outcomes
![Page 24: PEER Module 4: Research & Evaluation Questions](https://reader036.vdocuments.us/reader036/viewer/2022081503/5a4d1aeb7f8b9ab05997b0a9/html5/thumbnails/24.jpg)
Questions & Discussion