refresher research methods 2011 (caw bal)

Research Refresher to graduate successfully

September 6, 2011

C.A.W. Bal HZ University of Applied Sciences

Vlissingen, The Netherlands

There are many books on research

Luckily, they all tell the same story. 7-‐9-‐2011 C.A.W. Bal, Hogeschool Zeeland

Become a competent researcher !

Research competency:

Phase 1: Planning and preparing your research product: research proposal (background + theory)

Phase 2: Executing your research product: work on site (practical component)

Phase 3: Finalising the research product: report (shared knowledge)

attitude product: success

7-‐9-‐2011 C.A.W. Bal, Hogeschool Zeeland

What is research?

Finding answers to questions In a structured manner:

7-‐9-‐2011

Question/ hypothesis

Orientation

Approach/ Strategy

Gathering data

Analysis

Answer

Sharing/ using

Research phases:

(complex/scientific)

Cycle Two-‐way

C.A.W. Bal, Hogeschool Zeeland

What is research?

Finding answers to questions In a structured manner:

7-‐9-‐2011

Question/ hypothesis

Orientation

Approach/ Strategy

Gathering data

Analysis

Answer

Sharing/ using

Research phases:

(complex/scientific)

Cycle Two-‐way


Research Proposal Practical component

Report

Phase 1: Planning and preparation


1.1 Sketch of problem, research question(s), goal

1.2 Literature and expert review

1.3 Research design (using )

1.4 Research proposal

Bricks

1.1 Research Question

Ends with Not too simple, not too complex Sum of subquestions answer the main question Define the scope and the concepts Link to theory and professional practice

Specific Measurable Attainable Relevant Timed


SMART

Brick

1.1 Research Question

Is this question OK?:

can firm A improve business results How about this one?: What are firm legal, technical and marketing requirements for successful introduction of product Y


Brick

1.2 Literature review

Search strategy (diversity of sources, keep a log) Search terms (synonyms, language, combinations, theory

Use databases (e.g. from the Mediatheek)

Check references for further leads Mind the quality (recent, trustworthy) Be critical (arguments in favor, arguments against) Write summaries, and integrate findings in a chapter

Revise research question if needed


Brick

http://hz.nl/HZ/NL/Studeren+aan+de+HZ/Faciliteiten/Mediatheek/Informatiebronnen/Databanken.htm

1.3 Research design

Research strategy Sample choice (size, representative) Operationalisation satisfaction

Measurement instrument Data analysis method

It is the key to finding a proper answer


1.3 Research design

7-‐9-‐2011

Question + orientation

Approach/ Strategy

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation

Quantitative analysis

Answer/ discussion

Publication

Literature review

Grounded theory Survey Case study Action

Research

Question-‐naire Interview Secundary

data

Qualitative analysis


Question

Experiment

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Experiment

Observation


Answer/ discussion

Publication

Literature review


Research


data


Question

Experiment

Observation


Answer/ discussion

Publication

Literature review


Brick

Question

Experiment

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Experiment

Observation


Answer/ discussion

Publication

Literature review


Research


data



Brick

Grounded theory

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review


Research


data


Question

Observation

Answer/ discussion

Publication

Grounded theory


Coldren, J., & Hively, J., (2009). Interpersonal Teaching Style and Student Impression Formation. College Teaching; Spring2009, 57 [2], pp. 93-‐98

4

Does this look like an effective teaching method? Could you derive a theory?


Brick

Grounded theory

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review


Research


data



Brick

Survey

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review


Research


data


Question


Answer/ discussion

Publication

Literature review

Survey

Question-‐naire


Brick

Survey

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review


Research


data



Brick

Case study

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review


Research


data


Question


Answer/ discussion

Publication

Literature review

Case study

Secundary data


Emerging Energy Research, (2008). Global Wind Turbine Markets and Strategies, 2008 2020 (New market study). [On-‐line, Hyperlink to pdf ] (price 3350). 4


Brick

http://www.emerging-energy.com/user/GlobalWindTurbineMarketsandStrategies20082020710920415_pub/TurbinePromo.pdf




Case study

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review


Research


data



Brick

Action research

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review


Research


data


Question

Answer/ discussion

Literature review

Action Research

Interview


Hall, D.T., Otazo, K.L., & Hollenbeck, G.P. (1999). Behind Closed Doors: What Really Happens in Executive Coaching. Organizational Dynamics, 27 [3], pp. 39-‐54


Brick

Action research

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review


Research


data



Brick



This is the document that convinces yourself and outside parties (host company, tutors) that your research is worthwhile, well prepared, and organized in such a way that you will find an answer/result

Now they will invest in you!

(NB: Count on needing four weeks, after approval and start of the graduation assignment, for finalizing your research proposal)



It consists of several paragraphs (usually 3 to 5 pages): Introduction (sketch of the problem or task)

Research question Theoretical framework Practical relevance Research design + instrument Project planning and scope

Write what you plan to do, and why

Use a solid set of references!

Project planning

Do this upfront (in your research proposal) Arrange budget and access Timing usually runs out:

Theory/literature Setting up interventions/equipment Interviews (travel, preparation) Questionnaire (participants, data)

Leave time for analysis

7-‐9-‐2011

Allow some slack!


Phase 2: Executing your research


2.1 Gathering the data

2.2 Processing the data for interpretation

2.3 Monitor progress and quality

2.1 Gathering the data

Think about access to your data Apply the rules for proper research:

Objectivity Validity Ethics Reliability -‐ Repeatability Transparency

NB: Violation disqualifies research findings


Increase our road capacity

7-‐9-‐2011

How do you apply these rules: Objectivity: Measuring cars or opinions? Validity: Can we use existing simulation models? Ethics: Tell the truth or the desired outcome? Reliability: Who to trust on knowledge? Repeatability: Will we find the same next time? Transparency: Is it 100% clear what we did?


Observation

Take notes Sample choice is important Be systematic, use a coding scheme You only see what looking for Do not interpret, report facts


Brick

Questionnaire

Frequently used Think research through, and pilot test

Do not ask: you

But ask: often do you

Such Likert scale higher reliability and validity

Know the limitations of your sample (non-‐respons)

7-‐9-‐2011

1 2 3 4

1 2 3 4

1 2 3 4

very good

very bad

you drink and you indicate direction

1 2 3 4 never always


Brick

Interview

Prepare (background of interviewee, subject knowledge, professional appearance)

Access (person, location, time)

Topic list Timing Make a transcript Listen well, use follow-‐up questions Summarize the answers (as a check) Ask for further contacts, ideas, suggestions


Brick

Things you could read somewhere: One windmill is enough to power 300 households (But what size, for how long, where on the planet, etc) 5% population growth means doubling in 20 years (well, not quite, how about doubling every 14 years) 70% of the internet respondents have experienced crime (who are they, which crime, when, is this not a bit high) In the crisis every investor has lost 50% of his/her wealth (on average, exactly 50%, investor in what, what is wealth)

7-‐9-‐2011

Checking numbers and statistics


Things you could read somewhere: One windmill is enough to power 300 households (But what size, for how long, where on the planet, etc) 5% population growth means doubling in 20 years (well, not quite, how about doubling every 14 years) 70% of the internet respondents have experienced crime (who are they, which crime, when, is this not a bit high) In the crisis every investor has lost 50% of his/her wealth (on average, exactly 50%, investor in what, what is wealth)

These may be calculation or (more likely) copying accidents, but could also deliberately be put there to mislead!

7-‐9-‐2011

Checking numbers and statistics


2.2 Processing the data

(into numbers or categories)

Indicate relationships (between variables or categories)

Show overview and structure through: key numbers, graphs, tables, schemes (make them self-‐explanatory) Use of Excel

Clear and logical


2.3 Monitor progress and quality

Stay on track Adhere to your planning Be pragmatic, keep moving the project ahead Intervene/change if necessary Things do not always go as you plan them! Keep a record of changes and their justification


Phase 3: Finalizing the research


3.1 Interpret your data

3.2 Report your research (process and results)

3.1 Interpret your data

Interpret in light of your research question Formulate conclusions and recommendations Compare with other research Report new applications and insights Propose further research


Analytical thinking, Logic and coherency, Structured writing, Hard work, Concentration

Creativity,



Brick

The fun part: Reporting numbers in colourful graphs and tables. Such descriptive statistics are often useful

More advanced: cross-‐tables, correlation and regression The tricky part: What can you conclude from your sampled data. Need inferential statistics (confidence levels, accuracy)

Get good advice upfront: course, book, or prof. Software is great, if you understand what it does


Coding and structuring (search for relationships between concepts, explain categories in words, link to theory)

Present text fragments (quotes) Use schematical representations (diagram or table)

Use word processor (or qualitative analysis software such as Kwalitan, Kodani)

Motivate your choices, apply strict logic, demonstrate the arguments that lead to your conclusions


Brick

attitude


Before moving to writing your report, first a few words about the fourth part of the research competency: your attitude as a researcher Adapt behavior to research norms, professional ethics, and professional responsability

Neutrality, Critical mindset, High standards, Curiosity, Perseverance,

Preciseness

Respect

Neutrality?


High standards and critical mindset

Do not believe, until convinced One source is not enough Do not use, unless understand Check, check and double check Always consider alternatives Try to prove yourself wrong

responsible !


Creativity and hard work

7-‐9-‐2011

Creativity is a source of ideas and solutions, but takes an investment to reap the benefits


3.2 Report your research

Start from day one Make and discuss TOC (Table Of Contents) early Structure: Introduction/background, Method, Results, Discussion/conclusions/implications

Answer the research question! Clear and logical, Argued choices References Research should be reproducible based on report Target audience, use of appropriate language


Brick


7-‐9-‐2011

Only as good as your score on attitudes and skills: .

Neutrality Take some distance every now and then Preciseness Only write what is needed (no frills, appendix) Critical mindset If something appears simple, check for errors High standards Be extremely strict on yourself in every phase Curiosity Your thesis is a consequence, not a goal Perseverance When fed up, do not give up Analytical thinking Is every claim justified Continued


Brick


Logic and coherency The thesis should be fully self-‐explanatory Structured writing Lay-‐out matters (references, APA?) Creativity Give new ideas follow up Hard work Proper effort and no result is a result too Project planning Count on several times writing, start early Concentration Write in half-‐days, not hours Then:


Brick

A real project: production

Communication to MT and floor

With adaptations, series production

Both numbers and production concepts

Production data, floor lay out, staffing

Case study, secundary data

What is flexible and cost efficient?

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Kao, C., (2009). Efficiency measurement for parallel production systems. European Journal of Operational Research, 196 [3], pp. 1107-‐1112


A real project: production

Communication to MT and floor

With adaptations, series production

Both numbers and production concepts

Production data, floor lay out, staffing

Case study, secundary data

What is flexible and cost efficient?

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using


Your next project: Finding right job and

Write application letter(s)

Short list of positions and companies

Qualitative and quantitative comparison

Interviews, secundary data

Survey of jobs and industries

Which jobs fit my skills and interests

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

LaGesse, D., (2009). Turning Social Networking Into a Job Offer. U.S. News & World Report, 146 [4], pp. 44-‐45


Your next project: Finding right job and

Write application letter(s)

Short list of positions and companies

Qualitative and quantitative comparison

Interviews, secundary data

Survey of jobs and industries

Which jobs fit my skills and interests

7-‐9-‐2011


Approach

Gathering data

Analysis

Answer

Sharing/ using


Conclusion

This is just a refresher (to know what you do not know is a good start)

The details are important, use your books (and any good research advice you find at school or on-‐line)

Research is finding answers systematically (answers that come easily are suspicious)

BUT: If you master the attitudes and skills, succes will follow

These are applicable everywhere, and highly valued Learning is in doing, with the thesis as living proof


Any questions?

Thank you Wish you wisdom and luck

during graduation and thereafter!

[email protected]

7-‐9-‐2011

Research Refresher: A competent researcher!


refresher research methods 2011 (caw bal)

Education