systematic review touseef
TRANSCRIPT
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 1/27
A Systematic Review on Software Measurement Programs
By
Touseef Tahir, Ali Jafar
Lahore
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 2/27
h Introduction to software measurement programs
and their problems
h
The research Questionsh Systematic Review
h Outcomes Of Systematic Review
h Conclusions and future work
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 3/27
h Measurement programs(understand, assess,control, improve)
h Problems in measurment programs
Expert judgement required.
Lack of guidelines for measurement activities. A clear measument plan
Clear aims and objectives
Guidlines for data collection
Analysis of results
Lack of understanding the importance.
Lack of management involvement.
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 4/27
h RQ_1a: How do Organizations use software
measurement programs?
h RQ_1b: What are the success factors insoftware measurement program?
h RQ_2: What are the models/frameworks,
and tools developed for measurement programs?
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 5/27
h Qualitative step
Systematic Review
RQ1 and RQ2
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 6/27
1. Planning the review
2. Conducting the review
3. Reporting the review
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 7/27
h Review Protocol
h Search Strategy
h Primary Search process
h Study selection criteria
h Exclusion criteria
h Inclusion criteria
h Quality assessment checklist h Data extraction strategy
h Synthesis of extracted data
h Primary study selection
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 8/27
h Review protocol consists of inclusion/
exclusion criteria, search keywords,
databases to be searched, qualityassessment checklist, data synthesis, data
extraction form and research questions.
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 9/27
h Identification of search keywords by analysing thecontext, objectives, relevant area of researchquestions.
h
Searched resources were analysed for furtheridentification of keywords, including the keywordssection of research resources.
h Identification of synonyms, alternatives andhypernyms for each key word.
h Boolean OR was used for synonyms, alternatives,and hypernyms.
h Boolean AND was used to make a search string andmake searching precise
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 10/27
h (metric OR measure OR measurement) AND(program OR plan OR process) AND (successOR important OR successful OR success story
OR good practices OR practices) AND (factorOR feature OR variable) AND (Software ORsoftware application OR software development life cycle OR software development process OR
software system OR software industry) AND(models OR guidelines OR practices) AND(framework OR structure infrastructure) AND(tool OR instrument OR mechanism OR device).
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 11/27
h The articles/papers that talk about goal
based MPs in software industry.
h The articles/papers that talk regarding GoalQuestion Metrics.
h Empirical studies regarding goal based MPs.
h General papers that directly related to thetopic as well as research question.
h The articles should be accessible in full text.
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 12/27
h Study containing irrelevant information to
the research questions.
h Studies in any language except English wereexcluded.
h Study with irrelevant material and without
validation was ex
cluded.
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 13/27
Type Definition
Bias To check the completeness of the results i.e. true results are presented, in
addition pros and cons of an object that was under study.
Internal
Validity
To determine the research and experimental design i.e. to analyse the
chances of errors in the results.
External
Validity
To determine the use of results in practice.
Generalization Do the results are generalizable?
Completeness Does the specific study provide pros as well as cons of understudied
object?
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 14/27
Common information Article Title, Author(s) Name(s), Journal/Conferences,
Proceedings/Conference. Search Keywords, Sources of Research Articles,
Publication Date
Study context Empirical, Academic
Research methodology Action Research, Experiment, Case Study, Survey
subjects Professional, Sampling criteria
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 16/27
Sr.
No
Journal Total Articles Articles on M.P
1 ACM Transactions on Software Engineering Methodology (TOSEM) 62 2
2 IEEE Transactions on Software Engineering (TSE) 61 2
3 IEEE Software 65 5
4 Springer Software Measurement Journals 788 3
5 Springer Annals 14 2
Sr.
No
Conference Proceedings Total Articles Articles on M.P
1 IEEE International Software Metrics Symposium 115 8
2 IEEE International Conference on Software Engineering 45 1
3 ACM International Conference on Software Engineering 21 2
4 IEEE Euro-micro Conference on Software Maintenance and
Reengineering
1 1
5 Digital Avionics Systems Conference 1 1
6 International Conference on Software Process and Product
Measurement (Mensura)
79 0
7 Empirical Software Engineering and measurement (ESEM) 195 0
8 IEEE Euromicro Conference on Software Engineering and Advance
Application (SEAA)
132 0
Total 1579 28
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 17/27
h RQ1 a Analysis
Extract goods from raw data
Classify the best practices Software process estimations, planning, and
improvements
Monitoring and control of organization business
goals
Organizational health
Reusability of measurement data and
experiences
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 18/27
RQ1 b Analysis
Well defined goals, questions and metrics.
The presence of a structure (well definedstructure, flow and connection between themeasurement activities) .
The well-defined tasks, activities for data
collection.
Traceability of the measurement goals within themeasurement program.
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 19/27
Traceability of the measurement goals
with respect to business goals.
Well-Defined way of data collection.
Well-Defined way of data analysis.
Tool support in data collection, storage and
analysis.
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 20/27
Understanding of the objectives of
measurement processes
Measures repository
Re-usability of measurement objects i.e.
goals, questions, metrics, analysis resultsof previous measurement processes
Communication and feedback
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 21/27
h RQ2 Analysis
Models
GQM
,GQIM
,GAM
,QIP,AM
I,M
IS-PyME
framework,MPSP,M2P,EACIF,MIM,M-
CMM,ISO/SPICE 15504.
Tools
PRIMER,Metri-Flame, GQM-PLAN Tool.
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 22/27
Structured definition of goals and question.
Traceability of the goals, question and measures.
Optimum set of measures.
Supporting re-usability of structured (goals, questions) and
measures. It can be easily automated according to the needs of
organization.
Prioritization of goals on the basis cost, frequency and usage of measures against the benefits.
Structure definition (of goals and question), optimization of measures and
prioritization of goals for successful measurement programs.
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 23/27
Decision
Making
Phase
Measures
Selection
Phase 7. Prioritization
Meeting 5a. Attribute
Selection
5b. MeasuresSelection
MeasurementRepository
CMMI, ISO
and Other
Standards
MeasuresSet, Cost
Question
Definition Phase
4a. Structured Question
Definition
4b. Identify Horizontal &
Vertical Dependencies
6a. Attribute MeasureMatrix Creation
6b. ScreeningProcess
Cost
3. Post Meeting
Analysis
1. Organizational
Perspective
Goal Definition
Phase 2a. Structured Goal
Definition Process
2b. Identify Sub-goals andDependencies
MeasurementData
Deciding on the OptimumMeasures Set
Goals Definition
Questions Definition
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 24/27
A Structured Goal BasedMeasurement Framework Enabling Traceability and
Prioritization
By
Touseef Tahir, Cigdem Gencel
8/3/2019 Systematic Review Touseef
http://slidepdf.com/reader/full/systematic-review-touseef 25/27
MPs are essential for quality improvement
Estimation, monitor, control , predictions and quality
improvement.
Success of MPs depends on well defined phases, procedures and
guidelines.
There is a need of well defined measurement models,
frameworks and tools to define, collect, analyse, store and reuse
software metrics/measures
There is need of sharing more success and failures of MPs.
Most of the models, frameworks and tools are an extension of
GQM but there are no ways defined for sharing of collected
measures, comparison of findings and guidelines for reusability
of collected data within or outside same MPs using
same/different models, frameworks or tools.