ㅣ

.

l concept of rigorous reviews

guidelines

l

l introduction systematic reviews

stages

.

identifying evaluating interpreting

Reasons for Performing Systematic Reviews

• summarise existing evidence

• identify

• provide

• scientific value

• predefined search strategy

• completeness

The Importance of Systematic Reviews

.

identifying evaluating interpreting

Advantages and disadvantages

• provide information effects

phenomenon

• combine meta-analytic

•

.

Planning Conducting Reporting

The stages associated with planning the review are:

• need

• Development

•

• Selection

• assessment

• extraction monitoring

• synthesis

The stages associated with conducting the review are:

.

need for a systematic review

CRC [12] suggests the following checklist:

• objectives

• restrictions

• inclusion/exclusion criteria

• assess the quality

• extracted

• synthesised

combined

• conclusions flow evidence

.

need for a systematic review

From a more general viewpoint, Greenlaugh [9] suggests the following questions:

•

•

•

•

•

.

reduce the possibility researcher bias

most important activity research question.

The Research Question

In software engineering, questions can be adapted to software engineering issues as follows:

< Question Types >

• effect

•

• Identifying cost and risk factors

•

•

.

populationinterventionsoutcomes

< Population >

• role

• type

• application area

.

< Intervention >

• software technologies

•

< Outcomes >

• factors

•

populationinterventionsoutcomes

.

surrogate measures misleading

less robust.

Protocol Review

• critical element

•

.

review start

Identification of Research

• find primary studies

•

Generating a search strategy>

• iterative benefit

research question

.

review start

Generating a search strategy>

•

population, intervention, outcomes, study designs.

• synonyms, abbreviations, and alternative spellings.

•

.

Identification of Research

•

Generating a search strategy>

Initial searches electronic

databases

• Reference lists review articles

• Journals grey

literature conference proceedings

•

•

.

positive resultsnegative results.

Publication Bias

•

•

Documenting the Search

• transparent replicable

•

•

.

Documenting the Search

•

5. Conducting the review

• 5.1 Identification of Research – 5.1.1 Generating a search strategy

Baron-Cohen S, Jolliffe T, Mortimore C, Robertson M. Another advanced test of theory of mind: evidence from very high functioning adults with autism or asperger syndrome. Journal of Child Psychology and Psychiatry 1997;38:813–22. Baron-Cohen S, Ring HA, Wheelwright S, Bullmore ET, Brammer MJ, Simmons A, et al. Social intelligence in the normal and autistic brain: an fMRI study. European Journal of Neuroscience 1999;11:1891–8.

• 관련 논문의 Reference를 참조하여 중요 논문들을 찾음

5. Conducting the review

• 5.1 Identification of Research – 5.1.1 Generating a search strategy

• Journals (including company journals such as the IBM Journal of Research and Development), grey literature (i.e. technical reports, work in progress) and conference proceedings.

• Grey literature : 정식 시판되는 거시 아닌 기관에서 만든 보고서, 학술적인 기술보고서 등 Neuropsychologia Journal of Cognitive Neuroscience Journal of Child Psychology and Psychiatry European Journal of Neuroscience Journal of Child Psychology and Psychiatry

• Internet

5. Conducting the review

• 5.1 Identification of Research – 5.1.3 Documenting the Search

– Wikipedia

List of academic databases and search engines

.

Study selection criteria

•

• research question

•

Japanese or Chinese

papers are often difficult to access

• authors,

institutions, journals or year of publication

•

.

Study selection process

•

•

•

•

Reliability of inclusion decisions

•

.

Reliability of inclusion decisions

•

.

Quality Thresholds

• Study design

.

Quality Thresholds

•

•Table 5 disease condition

•

.

Using the Quality Instrument

Quality appraisal

synthesis of results

Limitations of Quality Assessment

• possible assume something wasn’t reported,

.

Data Extraction

objective of this stage data extraction forms

Contents of Data Collection Forms

.

Data Synthesis

Descriptive synthesis

Quantitative Synthesis

Quantitative data

Sample size

effect size

mean values confidence

interval

.

Presentation of Quantitative Results

presenting quantitative results forest plot

• means variance

.

•

•

size restriction.

.

Structure for systematic review

.

Peer Review

•

• Experts review

•

•

researchers and practitioners, it is worth organising a peer review.

•

. Final remarks

•