a systematic literature review on architectural … · a literature review study supports...
TRANSCRIPT
A SYSTEMATIC LITERATURE REVIEW ON ARCHITECTURAL PATTERNS
AND QUALITY ATTRIBUTES INTERACTION
Systematic Literature Review Protocol1
Version 1.7
1 Gianantonio Me, PhD Candidate at UCLM-Spain and VU-the Netherlands [email protected] [email protected]
slrProtocol_g.me / 2
Table of Contents
1 Abstract ............................................................................................................................... 3
2 RESEARCH DESIGN ............................................................................................................... 4
2.1 Background ....................................................................................................................................................... 4
2.2 Rationale for a literature review ....................................................................................................................... 4
2.2.1 Why are we performing a Systematic Literature Review? ....................................................................... 4
2.2.2 Why this literature review is important? .................................................................................................. 4
2.3 Research questions ........................................................................................................................................... 6
3 REVIEW PROTOCOL ............................................................................................................. 7
3.1 Pilot Study ......................................................................................................................................................... 7
3.1.1 Search Strings Building .............................................................................................................................. 7
3.2 SEARCH STRATEGY .......................................................................................................................................... 10
3.3 DATA SOURCES................................................................................................................................................ 10
3.4 SEARCH PROCESS ............................................................................................................................................ 11
3.4.1 Inclusion and Exclusion Criteria (Selection of Primary Studies) .............................................................. 11
3.4.2 Search Results’ Manager ......................................................................................................................... 12
3.4.3 List of included studies ............................................................................................................................ 12
slrProtocol_g.me / 3
1 Abstract
Background: Architectural patterns and styles represent common solutions to recurrent problems. They encompass architectural knowledge about how to achieve holistic system quality. The relation between patterns/styles and quality attributes has been regularly addressed in the literature. However, there is a lack of a consolidated and systematically built reference capturing this relation and eventually making it available for further reuse in the form of patterns-quality attributes knowledge. If captured, this knowledge can be used as an architectural decision framework where solutions (patterns) are strongly intertwined with quality (attributes). Such a framework should also contemplate variants and combinations of pattern. We decide to plan a Systematic Literature Review for depicting the state-of-the-art of Patterns and Quality Attributes Interaction. The research questions: This review aims to answer to:
a) RQ1- What type of relations exist between architectural patterns and quality attributes? b) RQ2- What types of approaches address the relations between architectural patterns and quality attributes? c) RQ3- What are the most important challenges for a quality-driven and pattern-based design?
The strategy: A preliminary set of twelve primary studies has been identified. The choice was based on previous knowledge. A search string has been tested. After capturing all the primary studies testing the same search string in different search engines, the search string will be applied extensively. First round was based only on Title and Abstract screening, second round on the whole reading. Study selection criteria: Inclusion and Exclusion criteria have been applied. Study selection procedures: For the studies that show uncertainty against the Inclusion/Exclusion criteria a review by different researchers has been planned. Study quality assessment checklists and procedures: Studies’ quality has been assessed on the basis of the coverage of knowledge elements reported for architecture patterns (e.g. the early work of Buschmann) and quality models (e.g. Standard ISO 25010:2011). Data extraction strategy: Textual analysis and structural coding (for understanding the type of connection between architectural patterns and quality attributes) have been applied; qualitative and quantitative analysis for collecting strengths and liabilities for each combination architectural pattern and quality attribute. Synthesis of the extracted data: Tables and narrative texts. Future Work Strategy: Relevance study in the industry Project timetable: June 2015-June 2016
slrProtocol_g.me / 4
2 RESEARCH DESIGN
2.1 Background
We developed a lightweight “theory”, literature based throughout a ground theory approach. The theory is based on the study of Harrison NB, Avgeriou P. Leveraging architecture patterns to satisfy quality attributes. In Software Architecture 2007 Jan 1 (pp. 263-270). Springer Berlin Heidelberg, plus all the references included. At this stage the theory has been developed around four main areas (Architectural Decision Making, Architectural Patterns, Quality Attributes Characterization and Patterns/Attributes interaction). A full version of the theory is beyond the scope of this SLR protocol.
2.2 Rationale for a literature review
2.2.1 Why are we performing a Systematic Literature Review?
According to Kitchenam2 there are five main reasons for undertaking a SLR:
To summarise the existing evidence concerning a treatment or technology e.g. to summarise the
empirical evidence of the benefits and limitations of a specific agile method.
To identify any gaps in current research in order to suggest areas for further investigation.
To provide a framework/background in order to appropriately position new research activities.
to examine the extent to which empirical evidence supports/contradicts theoretical hypotheses,
or even
to assist the generation of new hypotheses
The motivations of this literature review are:
Summarize: collect the evidence widespread in the literature about quality attributes and architectural
patterns with the aim of creating a catalogue/systematic repository of knowledge.
Examine: How the interaction between quality attributes and architectural patterns have been
depicted? Is the knowledge reported in the literature aligned with the early body of knowledge
depicted in the background section? How the interaction between quality attributes and architectural
patterns have been depicted?
Identify any gaps: for instance: can I know more on the variations/combinations of patterns and their
interactions with quality attributes? Is that knowledge available in the literature? Can I create a more
systematic body of knowledge?
2.2.2 Why this literature review is important?
A literature review study supports reorganization of the knowledge on architectural pattern and quality attributes.
The relevance of this literature review is that this study can provide answers to the future work planned by Harrison
and Avgeriou. Namely the following points shape the relevance of this study:
2 Kitchenham, Barbara. "Procedures for performing systematic reviews." Keele, UK, Keele University 33, no. 2004 (2004): 1-26.
slrProtocol_g.me / 5
Table 1-Importance for a literature review
Statement or characteristics of the literature so far3 Importance of a literature review
Early studies focus on few architecture patterns usually following the work of Buschmann
A literature review lets emerge others patterns, variants and combinations.
The number of quality attributes analyzed is not exaustive A literature review allows detection of quality characteristics and sub-characteristics according to, for instance, Standard ISO 25010:2011. In case of not contemplated quality attributes the same standard might be extended.
The interaction of the consequences of patterns has not been explored in detail.
A literature review can catch details about the consequences.
We intend to study which patterns are often used together. This helps identify potentially conflicting decisions, and help them make tradeoffs about which patterns to use.
A literature review can shed light on combinations of patterns and if those combinations alter what we already know about the quality attributes addressed by patterns.
Pattern variants have rich potential. Variants of patterns should be investigated to understand in more detail how individual variants affect the impact of generic architecture patterns on the quality attributes. Different pattern variants have somewhat different strengths and liabilities. This information can be used to help the architect choose among different variants of patterns.
A literature review support reorganization of variants of patterns.
3 Harrison, Neil B., and Paris Avgeriou. "Leveraging architecture patterns to satisfy quality attributes." In Software Architecture, pp. 263-270.
Springer Berlin Heidelberg, 2007.
slrProtocol_g.me / 6
2.3 Research questions
It is widely known that architectural patterns and quality attributes are not independent but there are significative
interactions4. Those interactions can be represented as knowledge elements which might be considered as
regularities. In this line of reasoning, for instance, Layered architecture presents a trade-off between performance
and modifiability, where the second quality attribute is better achieved5. Architects in search of assuring a high
modifiability for their system might take decisions on the basis of the regularity above, so doing by adopting a Layer
pattern. The knowledge on the interaction between patterns and quality attribute is a foundation for architectural
decisions6. In this line of reasoning, the motivation of this study aims to assess if that type of regularities are widely
accepted in the literature or there are substantial differences in evaluating which pattern is more adequate for
achieving specific quality attributes.
RQ1- What type of relations exist between architectural patterns and quality attributes? This research question has two goals. Firstly, it aims to explore the characterization of those relations (e.g., impact, dependencies, interaction, synergies or quantitative). Secondly, the type of relations can be evaluated and classified according to frequency of various patterns and QAs and related combinations.
RQ2- What types of approaches address the relations between architectural patterns and quality attributes? This research question aims to understand and classify the various methodologies, frameworks, models, etc. available in the literature that addresses the relation between pattern and QAs.
RQ3- What are the most important challenges for a quality-driven and pattern-based design? This research question aims to identify the most important challenges for building a theory of pattern-QAs interaction. We consider challenges as specific issues that emerge from the primary studies and for which better/explicit knowledge can help in addressing them better.
4 Harrison, Neil B., and Paris Avgeriou. "How do architecture patterns and tactics interact? A model and annotation." Journal of Systems and Software 83, no. 10
(2010): 1735-1758.
5 Buschmann, F., Ja¨kel, C., Meunier, R., Rohnert, H., and Stahl, M. 1996. Pattern-Oriented Software ArchitectureVA System of Patterns. Chichester, UK: John Wiley & Sons.
6 Not of course the only factor, see for instance Svahnberg, Mikael, and Claes Wohlin. "An investigation of a method for identifying a software architecture
candidate with respect to quality attributes."Empirical Software Engineering 10, no. 2 (2005): 149-181.
slrProtocol_g.me / 7
3 REVIEW PROTOCOL
3.1 Pilot Study
Piloting the review protocol is essential7. A set of 12 pilot-studies8 have been identified for two purposes. The pool of
papers includes key studies and at least one study on every single architectural pattern considered for the analysis.
In this way it is possible to assess if the simple term “architectural pattern(s)” can catch specific patterns (for
instance Layered) Firstly, we have been collecting keywords for shaping the search string from the following studies.
In case of authors’ keywords were not available we select keywords by reading the abstract. Secondly, the search
string has been tested on Google Scholar and other several search engines in order to verify if the pilot set-studies
have been detected.
3.1.1 Search Strings Building
Table 2-Search string
Software Architecture Quality
( Architecture Pattern AND ( Quality attributes
OR Architectural Pattern OR Quality characteristics
OR Architecture Style OR Quality
OR Architectural Style) OR Quality properties
OR No-Functional Requirement
OR No Functional Requirement
OR Quality dimensions)
7 Brereton, Pearl , Kitchenham, Barbara A., Budgen, David, Turner, Mark and Khalil, Mohamed. Lessons from applying the systematic literature
review process within the software engineering domain. JSS 80, 2007, pp 571-583. 8 This pilot should be not mistaken with the pilot set for Architectural Patterns and Quality Attributes submitted to WICSA 2016 as full paper
for both the conference and the workshop QRASA. The pilot here is aimed to test the search string .
slrProtocol_g.me / 8
Table 3-Pilot for testing the search string
Search string 1
Num Reference Author Keywords Keywords extracted from the
abstract
Scholar
Others
search
engines
Inclusion
Exclusion
Criteria test
1 Losavio, F., L. Chirinos, and M.
Pérez. "Attribute-Based
Techniques to Evaluate
Architectural Styles for Interactive
Systems." Journal of Object
Oriented Programming (2001).
architectural style,
architectural pattern,
attribute-based
evaluation, ABAS,
architectural design,
quality model,
interactive systems,
PAC, ISO 9126
- Found Found in
Scopus
INCLUDED
2 Bass, Len, and Bonnie E. John.
"Linking usability to software
architecture patterns through
general scenarios." Journal of
Systems and Software 66, no. 3
(2003): 187-197.
Usability;
Software architecture;
Software patterns;
Scenarios
- Found Found
with
Scopus
INCLUDED
3 Kim, Dae-Kyoo, Jungwoo Ryoo,
and Suntae Kim. "Building
Sustainable Software by
Preemptive Architectural Design
Using Tactic-Equipped
Patterns."Availability, Reliability
and Security (ARES), 2014 Ninth
International Conference on. IEEE,
2014.
- Found in
IEEE
INCLUDED
4 Svahnberg, Mikael, and Claes
Wohlin. "Consensus building when
comparing software
architectures." In Product Focused
Software Process Improvement,
pp. 436-452. Springer Berlin
Heidelberg, 2002.
- Found
with
Springer
Link
INCLUDED
5 Avgeriou, Paris, and Uwe Zdun.
"Architectural patterns revisited–a
pattern language." (2005).
Not available Quality attributes, architectural
patterns, software system
Found Found
with
Scopus
INCLUDED
6 Svahnberg, Mikael, and Claes
Wohlin. "An investigation of a
method for identifying a software
architecture candidate with
respect to quality
attributes."Empirical Software
Engineering 10, no. 2 (2005): 149-
181.
Software architectures,
quality attributes,
analytic hierarchy
process
- Found Found
with
SpringerL
ink
INCLUDED
7 Harrison, Neil B., Paris Avgeriou,
and Uwe Zdun. "On the impact of
fault tolerance tactics on
architecture
- - Found
with
ACM
INCLUDED
slrProtocol_g.me / 9
patterns." Proceedings of the 2nd
International Workshop on
Software Engineering for Resilient
Systems. ACM, 2010.
8 Harrison, Neil B., and Paris
Avgeriou. "How do architecture
patterns and tactics interact? A
model and annotation." Journal of
Systems and Software 83, no. 10
(2010): 1735-1758.
Software architecture
Patterns Quality
attributes Tactics
- Found found
with
Science
Direct)
INCLUDED
9 Kassab, Mohamad, Ghizlane El-
Boussaidi, and Hafedh Mili. "A
quantitative evaluation of the
impact of architectural patterns on
quality requirements." InSoftware
Engineering Research,
Management and Applications
2011, pp. 173-184. Springer Berlin
Heidelberg, 2012.
architectural patterns;
architectural tactics;
quality requirements;
architectural design
- Found Found
with
Springer
Link
INCLUDED
10 Silva, Francisco, Marcelo Lucena,
and Leonardo Lucena. "STREAM-
AP: A process to systematize
architectural patterns choice
based on NFR." In Twin Peaks of
Requirements and Architecture
(TwinPeaks), 2013 3rd
International Workshop on the,
pp. 27-34. IEEE, 2013.
Non-Functional
Requirements;
Software Architecture;
NFR Framework;
Architectural Pattern
- Found Found
with
Scopus
INCLUDED
11 Xu, Lihua, Hadar Ziv, Thomas A.
Alspaugh, and Debra J. Richardson.
"An architectural pattern for non-
functional dependability
requirements." Journal of Systems
and Software 79, no. 10 (2006):
1370-1378.
Software architecture;
Architectural patterns;
Aspects; Non-functional
requirements
- Found Found
with
Scienc
eDirect
INCLUDED
12 Seo, Chiyoung, et al. "A framework
for estimating the impact of a
distributed software system's
architectural style on its energy
consumption." Software
Architecture, 2008. WICSA 2008.
Seventh Working IEEE/IFIP
Conference on. IEEE, 2008.
- - Found
with IEEE
INCLUDED
After some attempts all 12 studies have been found (100%) with Search String 1.
slrProtocol_g.me / 10
3.2 SEARCH STRATEGY
The search string adopted:
(“architecture patterns” OR “architectural patterns” OR “architecture styles” OR “architectural styles”) AND ("quality
requirements" OR "quality attributes" OR "quality characteristics" OR "quality properties" OR "non functional
requirements" OR "non-functional requirements" OR “quality dimensions” )
This search string reflects two terminology problems:
1) patterns and style , often used in an interchangeable way and
2) is not available an unified terminology about “quality attributes”.9
At first, this search string gave back on Google Scholar 519010 results.
3.3 DATA SOURCES
ACM Digital Library 422 studies
IEEE 129 studies
SpringerLink 1395 studies
Scopus 499 studies
Web of Science 79 studies
Science Direct 418 studies
Table 4-Study Selection Rounds
Data Source Number of Studies
Round 1 Round 1b Round 2 Round 3 Round 4 Primary Studies
First Round Included (Title and abstract)
After Checking Duplicates*
Second Round Included (Skimming Reading)
Third Round Included (Whole reading)
Snowballing (Retrieval)**
ACM Digital Library
422 65 - - - - -
IEEE
129 49 - - - - -
SpringerLink
1395 71 - - - - -
Scopus
499 118 - - - - -
Web of Science
79 53
- - - - -
Science Direct 418 26 - - - - -
Whole Collection
2942* 382 283 160 88 11 99***
* It was possible to check automatically for duplicates only for IEEE, Scopus and Science Direct data. For the other three search engines the procedure has been done manually. ** We experienced a huge difference between the studies given by Google Scholar (5190 hits) and the other six search engines (2942 hits). In order to mitigate the risk of oversighting some important studies we performed a snowballing research by scanning all the references of the 99 primary studies. In this way we added 18 studies to the initial pool of primary studies. *** Included 12 studies of Pilot set; Excluded 1 study that has been used for building the “theory”, 12 studies are not available ( not available for free or not
available on internet).
9 Glinz, Martin. "On non-functional requirements." In Requirements Engineering Conference, 2007. RE'07. 15th IEEE International, pp. 21-26.
IEEE, 2007. 10
5190 6 November 2015
slrProtocol_g.me / 11
3.4 SEARCH PROCESS
3.4.1 Inclusion and Exclusion Criteria (Selection of Primary Studies)
Table 5-Inclusion and Exclusion criteria
Inclusion Criteria: Articles that satisfied the following inclusion criteria will be selected
N Description Rationale Example
I1 A study that offers knowledge elements on the interaction between at least one architectural patterns and at least one quality attribute.
We are interested in improving understanding on the interaction (type of interaction, dependencies etc.), between architectural patterns and quality attributes.
The Blackboard pattern has both a positive and negative impact on maintainability11 or “efficiency is both a strength and a liability in the Pipes and Filters pattern”12.
I2 A study that is carried out by either academics or practitioners
Interaction between architectural patterns and quality attributes is a key concern both for researchers than industries.
-
I3 A study that is written in English For practicability reasons, studies in any other languages than English were excluded.
-
EXCLUSION CRITERIA: studies that met the following criteria will be excluded:
n Description Rationale Example
E1 A study that does not provide directly and indirectly any description for the quality attributes taken in account
Description of quality attributes: in this SLR a description of a quality attribute has been considered as quality attribute characterization13. It means that a study should provide knowledge on the quality attribute in the form of quality attribute scenario. Quality attributes scenarios overcome the problems of non-operational definition and overlapping concerns 14 Directly: the quality attribute scenario can be explicitly depicted in the study Indirectly: quality attributes characterization can be referred in other studies or explained not explicitly as scenario.
“Reliability: Consistency: provide a mechanism (e.g. to replace a component interface); Attribute: presence of a mechanism; Metrics: Boolean; Goal: High” 15 In this case Reliability is directly described. “we choose to use one of the many different categorisations of quality attributes (see e.g., (McCall, 1994)), i.e., the ISO 9126 standard (ISO 9126).”16 In this second case quality attributes are indirectly described by quoting a quality model as reference. (In this case both studies do not meet the exclusion criteria. The absence of the elements described above brings to exclude the study)
E2 A study that does not provide any description directly and indirectly for the architectural patterns taken in account
Description of architectural pattern: As seen in the background section, a pattern can be described according to the context, problem and solution Directly: the architectural pattern has been described explicitly in the study, according the template Indirectly: some studies refer to the work of Buschmann, in this case the architectural pattern is implicitly described.
A direct description of an architectural pattern is “Model-View-Controller (MVC) is a widely known design pattern to integrate a user interface with the application domain. MVC was first introduced in Smalltalk’80 by Krasner and Pope [14]. Central to MVC is the separation of the representation of the application domain (the model) from the display of the application’s state (the view) and the user interaction processing (the controller).” 17 “In this study we use the following five
11 Harrison, Neil B., and Paris Avgeriou. "Leveraging architecture patterns to satisfy quality attributes." In Software Architecture, pp. 263-270. Springer Berlin Heidelberg, 2007. 12 Harrison, Neil B., and Paris Avgeriou. "Leveraging architecture patterns to satisfy quality attributes." In Software Architecture, pp. 263-270. Springer Berlin Heidelberg, 2007.
13 L. Bass, P. Clements, and R. Kazman (1998) Software Architecture in Practice, Addison Wesley Longman. 14 L. Bass, P. Clements, and R. Kazman (1998) Software Architecture in Practice, Addison Wesley Longman. 15 Losavio, Francisca, Nicole Levy, Parinaz Davari, and François Colonna. "Pattern-based architectural design driven by quality properties: a platform to model scientific calculation." In Software Architecture, pp. 94-112. Springer Berlin Heidelberg, 2005. 16 Svahnberg, Mikael, and Claes Wohlin. "An investigation of a method for identifying a software architecture candidate with respect to quality attributes."Empirical Software Engineering 10, no. 2 (2005): 149-181. 17 Syromiatnikov, Artem, and Danny Weyns. "A Journey through the Land of Model-View-Design Patterns." In Software Architecture (WICSA), 2014 IEEE/IFIP Conference on, pp. 21-30. IEEE, 2014.
slrProtocol_g.me / 12
architecture patterns of the eight patterns presented by (Buschmann et al., 1996), namely:[..]”18 it is an example of indirect description (In this case both studies do not meet the exclusion criteria. The absence of the elements described above brings to exclude the study)
E3 A study that does not focus on architectural patterns of applications
We are interested only in architectural patterns at application level, not for instance operative systems.
Mikrokernel Operative System 19
E4 A study that focuses on pre-pattern or anti-patterns
We focus only on architectural patterns. Anti-patterns represent bad design choice and they are out of scope for the purpose of this work.
For instance “Antipatterns are poor design choices that are conjectured to make objectoriented systems harder to maintain.”20
E5 A study that the analysis is at design or idiom level
We focus only on the abstraction level of architectural patterns. Design pattern and idiom patterns deal with problems after the overall system architecture has been specified.
For instance Abstract Factory, considered in Buschmann as a design pattern21
E6 A study that is not available, it is a book or it is a workshop note.
Self-explaining -
3.4.2 Search Results’ Manager
Mendeley and in one case (specifically with the results of Springer Link) a spreadsheet has been used.
3.4.3 List of included studies
Table 6- Studies count
Studies Numbers of studies
Total number of hits detected by the search string 2942
Pilot Studies 12 (Included in 2942)
Excluded by title and abstract -2560
Duplicates Detected -99
Not Available -12
Skimming Reading Excluded -111
Full Reading Excluded -72
Snowballing Included (retrieval) 11
Total of Primary Studies 99
18
Svahnberg, Mikael, and Claes Wohlin. "An investigation of a method for identifying a software architecture candidate with respect to quality attributes."Empirical Software Engineering 10, no. 2 (2005): 149-181. 19
Kuz, Ihor, Yan Liu, Ian Gorton, and Gernot Heiser. "camkes: A component model for secure microkernel-based embedded systems." Journal of Systems and Software 80, no. 5 (2007): 687-699 20 Khomh, Foutse, Massimiliano Di Penta, Yann-Gaël Guéhéneuc, and Giuliano Antoniol. "An exploratory study of the impact of antipatterns on class change-and fault-proneness." Empirical Software Engineering 17,
no. 3 (2012): 243-275.
21 Hsueh, Nien-Lin, Peng-Hua Chu, Jonathan Lee, and William Chu. "A quality verification model for design pattern." In Computer Software and
Applications Conference, 2007. COMPSAC 2007. 31st Annual International, vol. 1, pp. 531-534. IEEE, 2007. In Buschmann see for instance page
slrProtocol_g.me / 13
Table 7-Definitive List of Included Papers
Number Reference Status Note
0T Harrison NB, Avgeriou P. Leveraging architecture patterns to satisfy quality attributes. InSoftware Architecture 2007 Jan 1 (pp. 263-270). Springer Berlin Heidelberg.
- Background
1 Aarsten, Amund, Davide Brugali, and Giuseppe Menga. "Patterns for three-tier client/server applications." Proceedings of Pattern Languages of Programs (PLoP’96) (1996): 4-6.
Included Round 3
2 Stuurman, Sylvia, and Jan Van Katwijk. "Evaluation of software architectures for a control system: A case study." In Coordination Languages and Models, pp. 157-171. Springer Berlin Heidelberg, 1997.
Included Round 3
3 Grahn, Håkan, and Jan Bosch. "Some initial performance characteristics of three architectural styles." In Proceedings of the 1st international workshop on Software and performance, pp. 197-198. ACM, 1998.
Included Snowballing
4 Bosch, Jan, and Peter Molin. "Software architecture design: evaluation and transformation." In Engineering of Computer-Based Systems, 1999. Proceedings. ECBS'99. IEEE Conference and Workshop on, pp. 4-10. IEEE, 1999.
Included Round 3
5 Lundberg, Lars, Jan Bosch, Daniel Häggander, and Per-Olof Bengtsson. "Quality attributes in software architecture design." In Proceedings of the IASTED 3rd International Conference on Software Engineering and Applications, pp. 353-362. 1999.
Included Snowballing
6 Wen-Li Wang; Mei-Huei Tang; Mei-Hwa Chen, "Software architecture analysis-a case study," in Computer Software and Applications Conference, 1999. COMPSAC '99. Proceedings. The Twenty-Third Annual International , vol., no., pp.265-270, 1999
Included Round 3
7 Wang, Wen-Li, Ye Wu, and Mei-Hwa Chen. "An architecture-based software reliability model." In Dependable Computing, 1999. Proceedings. 1999 Pacific Rim International Symposium on, pp. 143-150. IEEE, 1999.
Included Round 3
8 Petriu, Dorina, Christiane Shousha, and Anant Jalnapurkar. "Architecture-based performance analysis applied to a telecommunication system."Software Engineering, IEEE Transactions on 26, no. 11 (2000): 1049-1065.
Included Round 3
9 Losavio, F., L. Chirinos, and M. Pérez. "Attribute-Based Techniques to Evaluate Architectural Styles for Interactive Systems." Journal of Object Oriented Programming (2001).
Included Pilot
10 Morisawa, Yoshitomi, and Koji Torii. "An architectural style of product lines for distributed processing systems, and practical selection method." ACM SIGSOFT Software Engineering Notes 26, no. 5 (2001): 11-20.
Included Round 3
11 Araujo, Ivan, and Michael Weiss. "Linking patterns and non-functional requirements." In PROCEEDINGS OF THE NINTH CONFERENCE ON PATTERN LANGUAGE OF PROGRAMS (PLOP 2002), SEPTEMBER 8–12, 2002. 2002.
Included Snowballing
12 Svahnberg, Mikael, and Claes Wohlin. "Consensus building when comparing software architectures." In Product Focused Software Process Improvement, pp. 436-452. Springer Berlin Heidelberg, 2002.
Included Pilot
13 Svahnberg, Mikael, Claes Wohlin, Lars Lundberg, and Michael Mattsson. "A method for understanding quality attributes in software architecture structures." In Proceedings of the 14th international conference on Software engineering and knowledge engineering, pp. 819-826. ACM, 2002.
Included Round 3
14 Bass, Len, and Bonnie E. John. "Linking usability to software architecture patterns through general scenarios." Journal of Systems and Software 66, no. 3 (2003): 187-197.
Included Pilot
15 Lopez, Marta. "Application of an evaluation framework for analyzing the architecture tradeoff analysis method SM." Journal of Systems and Software68, no. 3 (2003): 233-241.
Included Round 3
16 Silva, Otavio, Alessandro Garcia, and Carlos Lucena. "The reflective blackboard pattern: Architecting large multi-agent systems." In Software engineering for large-scale multi-agent systems, pp. 73-93. Springer Berlin Heidelberg, 2003.
Included Round 3
17 Weiss, Michael. "Pattern-driven design of agent systems: Approach and case study." In Advanced Information Systems Engineering, pp. 711-723. Springer Berlin Heidelberg, 2003.
Included Round 3
18 Wijnstra, Jan Gerben. "From problem to solution with quality attributes and design aspects." Journal of Systems and Software 66, no. 3 (2003): 199-211.
Included Round 3
19 Losavio, Francisca, Nicole Lévy, and Amar Ramdane-Cherif. "Architectural design for a wireless environment." In Embedded and Ubiquitous Computing, pp. 558-570. Springer
Included Round 3
slrProtocol_g.me / 14
Berlin Heidelberg, 2004.
20 Francois, Alexandre RJ. "A hybrid architectural style for distributed parallel processing of generic data streams." In Proceedings of the 26th International Conference on Software Engineering, pp. 367-376. IEEE Computer Society, 2004.
Included Round 3
21 Avgeriou, Paris, and Uwe Zdun. "Architectural patterns revisited–a pattern language." (2005).
Included Pilot
22 John, Bonnie E., Len Bass, Maria-Isabel Sanchez-Segura, and Rob J. Adams. "Bringing usability concerns to the design of software architecture." In Engineering Human Computer Interaction and Interactive Systems, pp. 1-19. Springer Berlin Heidelberg, 2005.
Included Round 3
23 Díaz-Pace, J. Andrés, and Marcelo R. Campo. "ArchMatE: from architectural styles to object-oriented models through exploratory tool support." In ACM SIGPLAN Notices, vol. 40, no. 10, pp. 117-132. ACM, 2005.
Included Round 3
24 Kolp, Manuel, T. Tung Do, Stéphane Faulkner, and TT Hang Hoang. "Architectural styles and patterns for multi-agent systems." In Design of Intelligent Multi-Agent Systems, pp. 103-132. Springer Berlin Heidelberg, 2005.
Included Round 3
25 Lee, Kwang Chun, Ho-Jin Choi, Dan Hyung Lee, and Sungwon Kang. "Quantitative measurement of quality attribute preferences using conjoint analysis." In Interactive Systems. Design, Specification, and Verification, pp. 213-224. Springer Berlin Heidelberg, 2005.
Included Round 3
26 Losavio, Francisca, Nicole Levy, Parinaz Davari, and François Colonna. "Pattern-based architectural design driven by quality properties: a platform to model scientific calculation." In Software Architecture, pp. 94-112. Springer Berlin Heidelberg, 2005.
Included Round 3
27 Niemelä, Eila, Jarmo Kalaoja, and Patricia Lago. "Toward an architectural knowledge base for wireless service engineering." Software Engineering, IEEE Transactions on 31, no. 5 (2005): 361-379.
Included Round 3
28 Reza, Hassan, Dan Jurgens, Jamie White, Jason Anderson, and Jay Peterson. "An architectural design selection tool based on design tactics, scenarios and nonfunctional requirements." In Electro Information Technology, 2005 IEEE International Conference on, pp. 6-pp. IEEE, 2005.
Included Round 3
29 Svahnberg, Mikael, and Claes Wohlin. "An investigation of a method for identifying a software architecture candidate with respect to quality attributes."Empirical Software Engineering 10, no. 2 (2005): 149-181.
Included Pilot
30 Wu, Chen, and Elizabeth Chang. "Comparison of web service architectures based on architecture quality properties." In Industrial Informatics, 2005. INDIN'05. 2005 3rd IEEE International Conference on, pp. 746-755. IEEE, 2005.
Included Round 3
31 Bellebia, D., and J. M. Douin. "Applying patterns to build a lightweight middleware for embedded systems." In Proceedings of the 2006 conference on Pattern languages of programs, p. 29. ACM, 2006.
Included Round 3
32 Bischofs, Ludger, Simon Giesecke, Michael Gottschalk, Wilhelm Hasselbring, Timo Warns, and Stefan Willer. "Comparative evaluation of dependability characteristics for peer-to-peer architectural styles by simulation." Journal of Systems and Software 79, no. 10 (2006): 1419-1432.
Included Round 3
33 Boucké, Nelis, and Tom Holvoet. "Relating architectural views with architectural concerns." In Proceedings of the 2006 international workshop on Early aspects at ICSE, pp. 11-18. ACM, 2006.
Included Round 3
34 Davidsson, Paul, Stefan Johansson, and Mikael Svahnberg. "Characterization and evaluation of multi-agent system architectural styles." In Software Engineering for Multi-Agent Systems IV, pp. 179-188. Springer Berlin Heidelberg, 2006.
Included Round 3
35 Hoareau, Didier, and Chouki Tibermacine. "Component deployment evolution driven by architecture patterns and resource requirements." Lecture notes in computer science 4344 (2006): 236.
Included Round 3
36 Morrison, Patrick, and Eduardo B. Fernandez. "Securing the Broker Pattern." In EuroPLoP, pp. 513-530. 2006.
Included Snowballing
37 Schmidt, Holger, and Ina Wentzlaff. "Preserving software quality characteristics from requirements analysis to architectural design." InSoftware Architecture, pp. 189-203. Springer Berlin Heidelberg, 2006.
Included Round 3
38 Wentzlaff, Ina, and Markus Specker. "Pattern-based development of user-friendly web applications." In Workshop proceedings of the sixth international conference on Web engineering, p. 2. ACM, 2006.
Included Round 3
39 Xu, Lihua, Hadar Ziv, Thomas A. Alspaugh, and Debra J. Richardson. "An architectural pattern for non-functional dependability requirements." Journal of Systems and
Included Pilot
slrProtocol_g.me / 15
Software 79, no. 10 (2006): 1370-1378.
40 Grau, Gemma, and Xavier Franch. "A goal-oriented approach for the generation and evaluation of alternative architectures." In Software Architecture, pp. 139-155. Springer Berlin Heidelberg, 2007.
Included Round 3
41 Harrison, Neil, and Paris Avgeriou. "Pattern-driven architectural partitioning: Balancing functional and non-functional requirements." In Digital Telecommunications, 2007. ICDT'07. Second International Conference on, pp. 21-21. IEEE, 2007.
Included Round 3
42 Pahl, Claus, Simon Giesecke, and Wilhelm Hasselbring. "An ontology-based approach for modelling architectural styles." In Software Architecture, pp. 60-75. Springer Berlin Heidelberg, 2007.
Included Round 3
43 Chen, Caixian, and Huijian Han. "The research on modern distance education system based on improved MVC pattern." In Computer Science and Software Engineering, 2008 International Conference on, vol. 5, pp. 462-465. IEEE, 2008.
Included Snowballing
44 Fernandez, Eduardo B., Mihai Fonoage, Michael VanHilst, and Mirela Marta. "The secure three-tier architecture pattern." In International Conference on Complex, Intelligent and Software Intensive Systems, pp. 555-560. IEEE, 2008.
Included Snowballing
45 Harirforoush, Maryam, Mirali Seyyedi, and Nooraldeen Mirzaee. "The evaluation of reliability based on the software architecture in neural networks." In Software Engineering Advances, 2008. ICSEA'08. The Third International Conference on, pp. 19-24. IEEE, 2008.
Included Round 3
46 Harrison, Neil B., and Paris Avgeriou. "Incorporating fault tolerance tactics in software architecture patterns." In Proceedings of the 2008 RISE/EFTS Joint International Workshop on Software Engineering for Resilient Systems, pp. 9-18. ACM, 2008.
Included Round 3
47 Harrison, Neil B., and Paris Avgeriou. "Analysis of architecture pattern usage in legacy system architecture documentation." In Software Architecture, 2008. WICSA 2008. Seventh Working IEEE/IFIP Conference on, pp. 147-156. IEEE, 2008.
Included Round 3
48 Mallet, Julien, and Siegfried Rouvrais. "Style-based model transformation for early extrafunctional analysis of distributed systems." In Quality of Software Architectures. Models and Architectures, pp. 55-70. Springer Berlin Heidelberg, 2008.
Included Round 3
49 Seffah, Ahmed, Taleb Mohamed, Halima Habieb-Mammar, and Alain Abran. "Reconciling usability and interactive system architecture using patterns."Journal of Systems and Software 81, no. 11 (2008): 1845-1852.
Included Round 3
50 Seo, Chiyoung, et al. "A framework for estimating the impact of a distributed software system's architectural style on its energy consumption." Software Architecture, 2008. WICSA 2008. Seventh Working IEEE/IFIP Conference on. IEEE, 2008.
Included Pilot
51 Fernandez, Eduardo B., and Jorge L. Ortega-Arjona. "The secure pipes and filters pattern." In Database and Expert Systems Application, 2009. DEXA'09. 20th International Workshop on, pp. 181-185. IEEE, 2009.
Included Round 3
52 John, Bonnie E., Len Bass, Elspeth Golden, and Pia Stoll. "A responsibility-based pattern language for usability-supporting architectural patterns." InProceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems, pp. 3-12. ACM, 2009.
Included Round 3
53 Moaven, Shahrouz, Ali Kamandi, Jafar Habibi, and Hamed Ahmadi. "Toward a Framework for Evaluating Heterogeneous Architecture Styles." InIntelligent Information and Database Systems, 2009. ACIIDS 2009. First Asian Conference on, pp. 155-160. IEEE, 2009.
Included Round 3
54 Mouratidis, Haralambos, and Paolo Giorgini. "Enhancing secure tropos to effectively deal with security requirements in the development of multiagent systems." In Safety and Security in Multiagent Systems, pp. 8-26. Springer Berlin Heidelberg, 2009.
Included Round 3
55 Ryoo, Jungwoo, Phil Laplante, and Rick Kazman. "In search of architectural patterns for software security." Computer 6 (2009): 98-100.
Included Snowballing
56 Babu, K., P. Govinda Rajulu, A. Ramamohana Reddy, and A. N. Kumari. "Selection of architecture styles using analytic network process for the optimization of software architecture." arXiv preprint arXiv:1005.4271 (2010).
Included Snowballing
57 Becker, Jörg, Martin Matzner, and Oliver Müller. "Comparing Architectural Styles for Service-Oriented Architectures–a REST vs. SOAP Case Study." In Information Systems Development, pp. 207-215. Springer US, 2010.
Included Round 3
58 Berrocal, Javier, José García-Alonso, and Juan Manuel Murillo. "Facilitating the selection of architectural patterns by means of a marked requirements model." In Software Architecture, pp. 384-391. Springer Berlin Heidelberg, 2010.
Included Round 3
59 Bode, Stephan, and Matthias Riebisch. "Impact evaluation for quality-oriented architectural decisions regarding evolvability." In Software Architecture, pp. 182-197. Springer Berlin Heidelberg, 2010.
Included Round 3
60 Galster, Matthias, Armin Eberlein, and Mahmood Moussavi. "Systematic selection of Included Round 3
slrProtocol_g.me / 16
software architecture styles." Software, IET 4, no. 5 (2010): 349-360.
61 Harrison, Neil B., Paris Avgeriou, and Uwe Zdun. "On the impact of fault tolerance tactics on architecture patterns." Proceedings of the 2nd International Workshop on Software Engineering for Resilient Systems. ACM, 2010.
Included Pilot
62 Harrison, Neil B., and Paris Avgeriou. "How do architecture patterns and tactics interact? A model and annotation." Journal of Systems and Software 83, no. 10 (2010): 1735-1758.
Included Pilot
63 Kumar, Kiran, and T. V. Prabhakar. "Pattern-oriented knowledge model for architecture design." In Proceedings of the 17th Conference on Pattern Languages of Programs, p. 23. ACM, 2010.
Included Round 3
64 Kumar, Kiran, and T. V. Prabhakar. "Design decision topology model for pattern relationship analysis." In Proceedings of the 1st Asian Conference on Pattern Languages of Programs, p. 3. ACM, 2010.
Included Round 3
65 Sharafi, Sayed Mehran, Golnaz Aghaee Ghazvini, and Sima Emadi. "An analytical model for performance evaluation of software architectural styles." In Software Technology and Engineering (ICSTE), 2010 2nd International Conference on, vol. 1, pp. V1-394. IEEE, 2010.
Included Round 3
66 Xu, Xiwei, Liming Zhu, Udo Kannengiesser, and Yan Liu. "An architectural style for process-intensive web information systems." In Web Information Systems Engineering–WISE 2010, pp. 534-547. Springer Berlin Heidelberg, 2010.
Included Round 3
67 Zheng, Jiang, and K. Eric Harper. "Concurrency design patterns, software quality attributes and their tactics." In Proceedings of the 3rd International Workshop on Multicore Software Engineering, pp. 40-47. ACM, 2010.
Included Round 3
68 Ameller, David, Oriol Collell, and Xavier Franch. "Reconciling the 3-layer Architectural Style with the Eclipse Plug-in-based Architecture." In Proceedings of the 1st Workshop on Developing Tools as Plug-ins, pp. 20-23. ACM, 2011.
Included Round 3
69 Banodha, Umesh, and Kanak Saxena. "Impact of Pipe and Filter Style on Medical Process Re-engineering." International Journal of Engineering Sciences 4 (2011): 398-409.
Included Snowballing
70 Pappu, Nagaraju, Satish Sukumar, and Feroz Sheikh. "A Supportability Framework." In Software Architecture (WICSA), 2011 9th Working IEEE/IFIP Conference on, pp. 137-146. IEEE, 2011.
Included Round 3
71 Reza, Hassan, and Kirk Ogaard. "Modeling of UAS Swarms Using Dynamic and Re-Configurable Software Architecture." In Systems Engineering (ICSEng), 2011 21st International Conference on, pp. 377-382. IEEE, 2011.
Included Round 3
72 Franco, Joao M., Raul Barbosa, and Mário Zenha-Rela. "Automated reliability prediction from formal architectural descriptions." In Software Architecture (WICSA) and European Conference on Software Architecture (ECSA), 2012 Joint Working IEEE/IFIP Conference on, pp. 302-309. IEEE, 2012.
Included Round 3
73 Garcia-Alonso, Jose, Javier Berrocal Olmeda, and Juan Manuel Murillo. "Architectural variability management in multi-layer web applications through feature models." In Proceedings of the 4th International Workshop on Feature-Oriented Software Development, pp. 29-36. ACM, 2012.
Included Round 3
74 Kassab, Mohamad, Ghizlane El-Boussaidi, and Hafedh Mili. "A quantitative evaluation of the impact of architectural patterns on quality requirements." InSoftware Engineering Research, Management and Applications 2011, pp. 173-184. Springer Berlin Heidelberg, 2012.
Included Pilot
75 Maciaszek, Leszek A. "An Architectural style for trustworthy adaptive service based applications." In Business System Management and Engineering, pp. 109-121. Springer Berlin Heidelberg, 2012.
Included Round 3
76 Mcheick, Hamid, Shalom Dodge, and Marcel Karam. "Service oriented specification and study of quality performance attribute." In Communications and Information Technology (ICCIT), 2012 International Conference on, pp. 80-84. IEEE, 2012.
Included Round 3
77 Yang, Hongji, Shang Zheng, William Cheng-Chung Chu, and Ching-Tsorng Tsai. "Linking functions and quality attributes for software evolution." InSoftware Engineering Conference (APSEC), 2012 19th Asia-Pacific, vol. 1, pp. 250-259. IEEE, 2012.
Included Round 3
78 Ameller D, Collell O, Franch X. The Three‐Layer architectural pattern applied to plug‐in‐based architectures: the Eclipse case. Software: Practice and Experience. 2013 Apr 1;43(4):391-402.
Included Round 3
79 Belle, Alvine Boaye, Ghizlane El-Boussaidi, Christian Desrosiers, and Hafedh Mili. "The layered architecture revisited: Is it an optimization problem?." In SEKE, pp. 344-349. 2013.
Included Round 3
80 Pruijt, Leo, Wiebe Wiersema, and Sjaak Brinkkemper. "A typology based approach to assign responsibilities to software layers." In Proceedings of the 20th Conference on Pattern Languages of Programs, p. 2. The Hillside Group, 2013.
Included Round 3
slrProtocol_g.me / 17
81 Silva, Francisco, Marcelo Lucena, and Leonardo Lucena. "STREAM-AP: A process to systematize architectural patterns choice based on NFR." In Twin Peaks of Requirements and Architecture (TwinPeaks), 2013 3rd International Workshop on the, pp. 27-34. IEEE, 2013.
Included Pilot
82 Solms, Fritz. "Experiences with using the systematic method for architecture recovery (SyMAR)." In Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference, pp. 170-178. ACM, 2013.
Included Round 3
83 Alebrahim, Azadeh, and Maritta Heisel. "Towards Developing Secure Software Using Problem-Oriented Security Patterns." In Availability, Reliability, and Security in Information Systems, pp. 45-62. Springer International Publishing, 2014.
Included Round 3
84 Belle, Alvine Boaye, Ghizlane El Boussaidi, and Hafedh Mili. "Recovering software layers from object oriented systems." In Evaluation of Novel Approaches to Software Engineering (ENASE), 2014 International Conference on, pp. 1-12. IEEE, 2014.
Included Round 3
85 Berrocal, Javier, José García-Alonso, and Juan Manuel Murillo. "Modeling business and requirements relationships for architectural pattern selection." In Software engineering research, management and applications, pp. 167-181. Springer International Publishing, 2014.
Included Round 3
86 Chen, Xiuhong, Wenqian Zhang, Peng Liang, and Keqing He. "A replicated experiment on architecture pattern recommendation based on quality requirements." In Software Engineering and Service Science (ICSESS), 2014 5th IEEE International Conference on, pp. 32-36. IEEE, 2014.
Included Round 3
87 Chong, Chun Yong, Sai Peck Lee, and Teck Chaw Ling. "Prioritizing and fulfilling quality attributes for virtual lab development through application of fuzzy analytic hierarchy process and software development guidelines."Malaysian Journal of Computer Science 27, no. 1 (2014).
Included Snowballing
88 Costa, Bruno, Paulo F. Pires, Flávia C. Delicato, and Paulo Merson. "Evaluating a Representational State Transfer (REST) Architecture: What is the Impact of REST in My Architecture?." In Software Architecture (WICSA), 2014 IEEE/IFIP Conference on, pp. 105-114. IEEE, 2014.
Included Round 3
89 Kim, Dae-Kyoo, Jungwoo Ryoo, and Suntae Kim. "Building Sustainable Software by Preemptive Architectural Design Using Tactic-Equipped Patterns."Availability, Reliability and Security (ARES), 2014 Ninth International Conference on. IEEE, 2014.
Included Pilot
90 Kosmajac, Dijana, Vladimir Vujovic, Milan Maksimovic, Nikola Davidovic, and Branko Perisic. "MasterBroker: REST oriented service broker." InIntelligent Engineering Systems (INES), 2014 18th International Conference on, pp. 227-232. IEEE, 2014.
Included Round 3
91 Parvizi-Mosaed, Alireza, Shahrouz Moaven, Jafar Habibi, and Abbas Heydarnoori. "Towards a Tactic-Based Evaluation of Self-Adaptive Software Architecture Availability." In SEKE, pp. 168-173. 2014.
Included Round 3
92 Philip, Milu Mary, and B. Vijayakumar. "Software Architectural Design for Image Retrieval System involving Data Streams and User Interactivity." InProceedings of the World Congress on Engineering and Computer Science, vol. 1. 2014.
Included Round 3
93 Syromiatnikov, Artem, and Danny Weyns. "A Journey through the Land of Model-View-Design Patterns." In Software Architecture (WICSA), 2014 IEEE/IFIP Conference on, pp. 21-30. IEEE, 2014.
Included Round 3
94 Tahmasebipour, Safieh, and Seyed Morteza Babamir. "Ranking of Common Architectural Styles Based on Availability, Security and Performance Quality Attributes." Journal of Computing and Security 1, no. 2 (2014).
Included Snowballing
95 Elahi, Abdolkarim, and Seyed Morteza Babamir. "Evaluating software architectural styles based on quality features through hierarchical analysis and Fuzzy Integral (FAHP)." In Information and Knowledge Technology (IKT), 2015 7th Conference on, pp. 1-6. IEEE, 2015.
Included Round 3
96 Grozev, Nikolay, and Rajkumar Buyya. "Performance modelling and simulation of three-tier applications in cloud and multi-cloud environments."The Computer Journal 58, no. 1 (2015): 1-22.
Included Round 3
97 Harper, Karl Eric, Jiang Zheng, Sam Ade Jacobs, Aldo Dagnino, Anton Jansen, Thomas Goldschmidt, and Adamantios Marinakis. "Industrial Analytics Pipelines." In Big Data Computing Service and Applications (BigDataService), 2015 IEEE First International Conference on, pp. 242-248. IEEE, 2015.
Included Round 3
98 Moaven, Shahrouz, Jafar Habibi, Razie Alidoosti, and Alireza Parvizi Mosaed. "Towards a Knowledge Based Approach to Style Driven Architecture Design." Procedia Computer Science 62 (2015): 236-244.
Included Round 3
slrProtocol_g.me / 18
99 Salama, Maria, and Rami Bahsoon. "Quality-Driven Architectural Patterns for Self-Aware Cloud-Based Software." In Cloud Computing (CLOUD), 2015 IEEE 8th International Conference on, pp. 844-851. IEEE, 2015.
Included Round 3
Use this references’ number for the rest of the protocol
slrProtocol_g.me / 19
3.5 ANALYSIS
3.6 Approaches and interaction types
Table 7-Approaches and types of interactions
STUDY APPROACH TYPE OF INTERACTION
1 Functionality Oriented Undetermined
2 Quality Driven Method Undetermined
3 Quantitative-Prediction-Formal Model Measurability
4 Design Method Fitness&Satisfaction
5 Design Method Trade-offs
6 Quantitative-Prediction-Formal Model Measurability
7 Quantitative-Prediction-Formal Model Measurability
8 Business Process-Real World Oriented Undetermined
9 Quantitative-Prediction-Formal Model Measurability
10 Quantitative-Prediction-Formal Model Measurability
11 Design Method Undetermined
12 Decision Making Fitness&Satisfaction
13 Views- Scenario Based Undetermined
14 Views- Scenario Based Scenario-Based
15 Quality Driven Method Trade-offs
16 Specific Domain Method Undetermined
17 Specific Domain Method Softgoals
18 Decision Making Problem Space-Solution Space Interaction
19 Quality Driven Method Undetermined
20 Evaluation Method Undetermined
21 Ontology-Pattern Language-Topology-Taxonomy Undetermined
22 Views- Scenario Based Undetermined
23 Evaluation Method Materialization
24 Specific Domain Method Business Process-Real World Oriented
25 Quantitative-Prediction-Formal Model Trade-offs
26 Quality Driven Method Undetermined
27 Knowledge Based Interaction as Knowledge
28 Views- Scenario Based Scenario-Based
29 Decision Making Undetermined
30 Quantitative-Prediction-Formal Model Measurability
31 Ontology-Pattern Language-Topology-Taxonomy Undetermined
32 Decision Making Undetermined
33 Views- Scenario Based views and viewpoint
34 Decision Making Trade-offs
35 Knowledge Based Undetermined
36 Pattern QA characterization Characterization
37 Design Method Capturing
38 Ontology-Pattern Language-Topology-Taxonomy Representability
39 Quantitative-Prediction-Formal Model Undetermined
slrProtocol_g.me / 20
40 Decision Making Actors and dependencies
41 Design Method Functional/Non Functional
42 Ontology-Pattern Language-Topology-Taxonomy Undetermined
43 Technical Method Undetermined
44 Pattern QA characterization Materialization
45 Quantitative-Prediction-Formal Model Undetermined
46 Decision Making Tactics
47 Knowledge Based Undetermined
48 Design Method Undetermined
49 Quality Driven Method Scenario-Based
50 Quantitative-Prediction-Formal Model Undetermined
51 Knowledge Based Interaction as Knowledge
52 Pattern QA characterization Characterization
53 Quantitative-Prediction-Formal Model Measurability
54 Specific Domain Method Transformation
55 Decision Making Tactics
56 Decision Making Fitness&Satisfaction
57 Decision Making Technical
58 Functionality Oriented Functional/Non Functional
59 Decision Making Fitness&Satisfaction
60 Decision Making Appropriateness
61 Decision Making Tactics
62 Decision Making Tactics
63 Knowledge Based Interaction as Knowledge
64 Decision Making Fitness&Satisfaction
65 Quantitative-Prediction-Formal Model Markov Model
66 Evaluation Method Undetermined
67 Decision Making Tactics
68 Views- Scenario Based views and viewpoint
69 Business Process-Real World Oriented Real World
70 Evaluation Method Undetermined
71 Quantitative-Prediction-Formal Model Fitness&Satisfaction
72 Quantitative-Prediction-Formal Model Markov Model
73 Technical Method Technical
74 Quantitative-Prediction-Formal Model Tactics
75 Pattern QA characterization Undetermined
76 Evaluation Method Undetermined
77 Functionality Oriented Undetermined
78 Knowledge Based Interaction as Knowledge
79 Evaluation Method Undetermined
80 Ontology-Pattern Language-Topology-Taxonomy Responsibilities
81 Design Method Undetermined
82 Specific Domain Method Undetermined
83 Pattern QA characterization Characterization
84 Specific Domain Method Undetermined
85 Business Process-Real World Oriented Relationship
86 Knowledge Based Tactics
87 Decision Making Fitness&Satisfaction
slrProtocol_g.me / 21
88 Evaluation Method Trade-offs
89 Decision Making Tactics
90 Pattern QA characterization Undetermined
91 Decision Making Tactics
92 Pattern QA characterization Undetermined
93 Ontology-Pattern Language-Topology-Taxonomy Undetermined
94 Decision Making Tactics
95 Decision Making Tactics
96 Quantitative-Prediction-Formal Model Measurability
97 Design Method Undetermined
98 Knowledge Based Interaction as Knowledge
99 Decision Making Tactics
Table 8-Frequency of type of interactions
Number of studies per type
Type of Interaction described
Total number of studies
35 Undetermined 35
12 Tactics 12
8 Measurability 8
7 Fitness & Satisfaction 7
6 Interaction as knowledge 5
5 Trade-offs 5
3 Scenario-based; Characterization of patterns with a QA 6
2 Functional-Non-functional; Markov Model; Views and Viewpoint; Materialization; Technical; Real world requirements (QAs)- Systems specification (Patterns);
12
1 Responsibilities; Appropriateness; Capturing; Actors and dependencies; Relationship; Representability; Softgoals; Problem space-Solution space interaction; Transformation
9
Table 9-Frequency of approaches
Type of Approaches Number of Studies Focus on
Decision-Making 22 How to support architectural decisions: e.g. hierarchies of QAs for prioritizing decisions
Quantitative-Prediction-Formal Model 16 Support of architectural choice with quantitative assessment of QAs
Design Method 8 Holistic method, focus on the process of designing systems architecture
Knowledge Based 8 Reusable and well-known knowledge on patterns and QAs
Evaluation Method 7 The focus is on the process of evaluating architecture
Pattern QA characterization 7 Patterns are characterized by a single QA ( e.g. Security Broker)
Ontology-Pattern Language-Topology-Taxonomy
6 The focus is on the description and definition both of patterns , or quality attributes (Taxonomies)
Specific Domain Method 6 Those studies focus on a specific context, e.g. multi-agent system
Views- Scenario Based 6 Those studies extract information on patterns-QAs interaction using scenarios as particular instance of the system
Quality Driven Method 5 Those studies consider the entire process of architecting as achieving quality
Business Process-Real World Oriented 3 Those studies explore how patterns and QAs can effectively address specific real world challenges
Functionality Oriented 3 Those studies explore the link between functionalities and quality
Technical Method 2 Those studies explore the patterns and QAs in terms of how to capture technological complexity
slrProtocol_g.me / 22
3.7 Patterns and Quality attributes frequency
Table 10-Pattern Frequency
Pattern Frequency
Layered 33
Pipes & Filters 31
Blackboard 20
MVC 19
Broker 15
Client Server 14
Microkernel 12
Combination 10
PAC 7
Peer-to-Peer 6
Batch-Sequential 5
C2 4
Fault-Tolerance 4
Publish Subscribe 4
Reflection 4
Multi Agent Systems 3
Repository 3
REST 3
Call and Return 2
Control Loop 2
Interpreter 2
Observer 2
Self-Adaptive Patterns 2
Shared Repository 2
SOA 2
Unrecognized 2
Abstract Data Type 1
Abstract Factory 1
Active Repository 1
Agent System Pattern 1
Asynchronous Processing 1
Builder 1
Concurrent Pipelines 1
Event-Based Implicit Invocation 1
Explicit Invocation 1
Half Sync/Half Async 1
Hub-and-Spoke 1
Implicit Invocation 1
Indirection/Binding 1
Interacting Process 1
Interceptor 1
slrProtocol_g.me / 23
Leaders/ Followers 1
Main/Subroutine 1
Message Queuing 1
Multi-Tier 1
N3-Tier 1
New Pattern 1
Object-Oriented 1
Parallel 1
Remote Procedure Calls 1
Rule Based System 1
SOAP 1
State Transition 1
Three-Tier 1
Virtual Machine 1
Table 11- Quality attributes
Qas Frequency
Efficiency 43
Performance 82
Availability 31
Scalability 32
Portability 32
Fault-Tolerance 5
Extensibility 16
Modifiability 44
Maintainability 60
Reliability 73
Flexibility 7
Usability 39
Security 71
Functionality 18
Reusability 37
Manageability 2
Safety 2
Testability 6
Simplicity 9
Interoperability 10
Integrability 17
Losely Coupling 2
Visibility 2
Composability 2
Dependability 1
Energy efficiency 6
Evolvability 13
Standardization 2
slrProtocol_g.me / 24
Configurability 7
Dynamic Configurability 5
Adaptability 8
Modularity 4
Greenability 1
Understability 5
Reactivity 1
Load Balancing 1
Fairness 1
Robustness 1
Changeability 1
Exchangeability 2
Analizability 1
Location Transparency 3
Not Recognizable 6
Table 12-Key
Not present in ISO 9126 nor in 25010:2011
Present in both standard
Present Only in 25010
Present Only in 9126
3.8 Change Log
Date Changes Author 21.02.2016 h03:18 AOE
Repaired list of primary studies ( two duplicates copied and pasted by mistake ) hits number 49 moved to 87 and 121 replaced
Gianantonio Me
21.02.2016 h04:41 AOE
Version Updated on-line 1.2 Gianantonio Me
20.03.2016 h22.02 AOE
Updated list of included studies, repaired minor inconsistiencies detected by WICSA reviewer 2 Gianantonio Me
02.05.2016 h05.56 Updated list of included studies, tables on results Gianantonio Me