visualization of risk - the open grouparchive.opengroup.org/public/member/proceedings/q... ·...

36
Fakultät für Informatik Technische Universität München Visualization of Risk Models, Methods and Tools Alexander M. Ernst Software Engineering for Business Information Systems (sebis) Ernst Denert Stiftungslehrstuhl Ernst Denert-Stiftungslehrstuhl Technische Universität München, Faculty for Informatics 1 wwwmatthes.in.tum.de 090205-Ernst-Visualization of Risk © sebis

Upload: others

Post on 24-May-2020

14 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Fakultät für Informatik Technische Universität München

Visualization of RiskModels, Methods and Tools

Alexander M. ErnstSoftware Engineering for Business Information Systems (sebis)Ernst Denert StiftungslehrstuhlErnst Denert-StiftungslehrstuhlTechnische Universität München, Faculty for Informatics

1

wwwmatthes.in.tum.de

090205-Ernst-Visualization of Risk © sebis

Page 2: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

What is does risk mean in this presentation?

Requirements for Risk Assessment Methodologies(Technical Guide The Open Group 2009)(Technical Guide, The Open Group 2009)

The probable frequency and probable magnitude of future loss.

Risk Taxonomy(Technical Standard, The Open Group 2009)

How often bad things happen, and how bad they are when they occur.

© sebis090205-Ernst-Visualization of Risk 2

Page 3: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualization of risk –What you are currently using

Emagined Security Dashboard: http://www.emagined.com/security_dashboard.php (2009-01-29)

Symantec IT Risk Management Report 2: Myths and Realities

© sebis090205-Ernst-Visualization of Risk 3

Symantec IT Risk Management Report 2: Myths and Realitieshttp://eval.symantec.com/mktginfo/enterprise/other_resources/b-it_risk_management_report_2_01-2008_12818026.en-us.pdf

Page 4: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualization of risk –What you could be using

© sebis090205-Ernst-Visualization of Risk 4

Page 5: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Lack of standardized viewpoints for managing the enterprise

Software Engineering: Established viewpoints forrecurring and known problemsrecurring and known problems

modularity, deployment, interaction, …

Enterprise Architectures: Emerging modelinglanguages and viewpoints, e.g.

ArchiMateArchiMate(http://www.archimate.com)System Cartography(http://www.systemcartography.info)

Many organization specific viewpoints:Many organization-specific viewpoints:rarely documentedvisibility limited to a single organizationy g g

© sebis090205-Ernst-Visualization of Risk 5

Page 6: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

What information is needed to manage the enterprise?

Specific examples for information models:~ 50 classes (vendor A)( )~ 54 classes (vendor B)~ 220 classes (vendor C)~ 470 classes (vendor D)At least twice as many associationsNumerous attributes per instance

© sebis090205-Ernst-Visualization of Risk

Numerous attributes per instance

6

Page 7: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

System Cartography – Where we came from,what we achieved and what we will doWhere we came from

Software Cartography develops models andSoftware Cartography develops models andmethods for describing, evaluating, and constructingapplication landscapes.

What we achievedDevelopment of the SyCaToolEnterprise Architecture Management Tool SurveyDevelopment of the EAM Pattern Catalog

What we will doEstablish a community for EAM PatternsS fSimulation of enterprise architecturesExtension of the project scope fromEnterprise Architectures to Systems of SystemsSystem Cartography

A li ti f S t C t h t i li i k

© sebis090205-Ernst-Visualization of Risk 7

Application of System Cartography to visualize risk

Page 8: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Agenda

Motivation and Introduction

Enterprise Architecture Management Patterns

System Cartography Tool (SyCaTool)

Visualizing Risks

Conclusion and OutlookConclusion and Outlook

© sebis090205-Ernst-Visualization of Risk 8

Page 9: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

EAM patterns document proven practice solutions for recurring problems in managing the EAAn enterprise architecture management pattern (EAM pattern) is

a general, reusable solution to a common problema general, reusable solution to a common problem in a given context identifies driving forces, k dknown usages, and consequences.

An EAM pattern takes a holistic perspective:It addresses concerns at the enterprise (systems of systems) level.It id i l t h i l d i f i b l dIt considers social, technical, and economic forces in a balanced manner.

It is discovered in working solutions rather than being invented or hoped for.g g pIt uses a clear, accessible, and informal language that allows practitioners to describe their knowledge and experience.

Pattern languages are a proven way to capture best practices and expert knowledge and to socialize it inside a group, department, entire company,or entire design disciplineor entire design discipline.

© sebis090205-Ernst-Visualization of Risk 9

Page 10: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

The EAM pattern catalog is made up of concerns, M-Patterns, V-Patterns and I-Patterns

Tailor the EAM to the specific situation (pains) of the enterprise and follow an incremental strategy based on EAM patterns representing proven practices.incremental strategy based on EAM patterns representing proven practices.

Systematically document the dependencies betweenindividual management concerns, Which concern is relevant for which stakeholder? Standard Conformity Management

Concern

methodology patterns (M-Pattern),Which activities are required to address a concern?

Concern Concern

viewpoint patterns (V-Pattern), andWhich viewpoints help stakeholders tocollaboratively perform the activities?

Architectural Solution and Technology Mapping 

Architectural Solution Definition

information model patterns (I-Pattern)Which information has to be available to generate a view?

Technology UsageTechnology and Connector Usage

Concern Concern

Draw attention to the consequences implied by a pattern (labor, required information, political resistance, …)

© sebis090205-Ernst-Visualization of Risk 10

Page 11: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Exemplary EAM Pattern for Standard Conformity Management – Standard Conformity Exception

© sebis090205-Ernst-Visualization of Risk 11

Page 12: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Overview about EAM patterns and how they are linked

Origin: Literature, experience from sebis research projects, structured interviews of 25 enterprise architects Selection based on relevance and adoption by an extensiveonline questionnaire

43 concerns, 20 M-Patterns, 53 V-Patterns, and 47 I-Patterns43 concerns, 20 M Patterns, 53 V Patterns, and 47 I Patterns

htt // t t h i f / iki

090205-Ernst-Visualization of Risk 12© sebis

http://www.systemcartography.info/eampc-wiki

Page 13: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Agenda

Motivation and Introduction

Enterprise Architecture Management Patterns

System Cartography Tool (SyCaTool)

Visualizing Risks

Conclusion and OutlookConclusion and Outlook

© sebis090205-Ernst-Visualization of Risk 13

Page 14: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Motivation for generating views forrisk managementReasons for generating views for risk management

Different stakeholder have different concernsDifferent stakeholder have different concernsCauses of risk change fast (real-time)

Obsolete before publishedI f ti i t il bl ti lInformation is not available timely

Inconsistent visualizations based on inconsistent dataManual creation of views

• is error prone and• requires high effort

View generation for risk management• must be stakeholder oriented• address concerns relevant to these stakeholders• needs to support multiple views of abstraction

needs to reuse existing information in repositories• needs to reuse existing information in repositories– try to find inconsistencies between different sources

• has to be timely

© sebis090205-Ernst-Visualization of Risk 14

Page 15: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

SyCaTool creates visualizationsbased on customizable layout rulesy

A Model of aSystem of Systems

A Software Mapareas, lines, layers,

SyCaTooly y

relevant elements, their properties, and

relationships between them

their properties (form, size, position, color, …) and

relationships between them

Information Modelclasses of elements,

Software Map Modelclasses of map elements, Selection,

Transformationpossible properties, andpossible relationships

possible properties, andpossible relationships

Transformation, and Layout Rules

A Meta ModelA Meta Modelclasses, properties, and

relationships

© sebis090205-Ernst-Visualization of Risk 15

B Data flow from A to BAB A based on BA

Page 16: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Screenshot SyCaTool rich client:Cluster map with two metrics

Color: Failure ProbabilitySi F il P tiSize: Failure Propagation

htt // t t h i f / t l

© sebis090205-Ernst-Visualization of Risk 16

http://www.systemcartography.info/sycatool

Page 17: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Agenda

Motivation and Introduction

Enterprise Architecture Management Patterns

System Cartography Tool (SyCaTool)

Visualizing Risks

Conclusion and OutlookConclusion and Outlook

© sebis090205-Ernst-Visualization of Risk 17

Page 18: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Modeling risks using the Open GroupFAIR risk taxonomy

Risk

Loss Event Frequency

Probable Loss Magnitude

Threat Event Frequency Vulnerability Primary Loss

FactorsSecondary

Loss Factors

Contact Action Control Strength

Threat Capability

Asset Loss Factors

Threat Loss Factors

Organizational Loss Factors

External Loss Factors

Included in the demonstration

© sebis090205-Ernst-Visualization of Risk 18

Not included of the demonstration

Page 19: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Using a Process Support Map as a base map for visualizing risk

Two-dimensional spaceX-Axis for business processesX-Axis for business processes

• layer 0 to 3• linear process• viewed as a value chain

Y-Axis for • organizational units• plants• target markets• target markets• products• …

Useful for e.g. risk analysis, benchmarks, consolidation projects, etc.

© sebis090205-Ernst-Visualization of Risk 19

Process Support Map (V-Pattern V-17) is part of the EAM pattern catalog

Page 20: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Information model used in demonstration of view generation for risk management

assetLossFactor (in $)threatLossFactor (in $) action (probability)

EAM Pattern CatalogB i P S (I 30)

action (probability)

EAM Pattern Catalogcontact (number of

© sebis090205-Ernst-Visualization of Risk 20

Business Process Support (I-30) Interfaces and Operations (I-64)incoming interconnections)

Page 21: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

FAIR risk taxonomy – SyCaTool demo

© sebis090205-Ernst-Visualization of Risk 21

Page 22: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualizing Risk for applications in respect to organizational units and processes

Risk

Loss Event Frequency

Threat Event

FrequencyVulnerabilit

y

Probable Loss

Magnitude

Primary Loss

Factors

Secondary Loss

Factors

© sebis090205-Ernst-Visualization of Risk 22

Contact Action Control Strength

Threat Capability

Asset Loss Factors

Threat Loss Factors

Organizational Loss Factors

External Loss

Factors

Page 23: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualizing Loss Event Frequency for applications in respect to organizational units and processes

Risk

Loss Event Frequency

Threat Event

FrequencyVulnerabilit

y

Probable Loss

Magnitude

Primary Loss

Factors

Secondary Loss

Factors

© sebis090205-Ernst-Visualization of Risk 23

Contact Action Control Strength

Threat Capability

Asset Loss Factors

Threat Loss Factors

Organizational Loss Factors

External Loss

Factors

Page 24: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualizing Threat Event Frequency for applications in respect to organizational units and processes

Risk

Loss Event Frequency

Threat Event

FrequencyVulnerabilit

y

Probable Loss

Magnitude

Primary Loss

Factors

Secondary Loss

Factors

© sebis090205-Ernst-Visualization of Risk 24

Contact Action Control Strength

Threat Capability

Asset Loss Factors

Threat Loss Factors

Organizational Loss Factors

External Loss

Factors

Page 25: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualizing Contact for applications in respect to organizational units and processes

Risk

Loss Event Frequency

Threat Event

FrequencyVulnerabilit

y

Probable Loss

Magnitude

Primary Loss

Factors

Secondary Loss

Factors

© sebis090205-Ernst-Visualization of Risk 25

Contact Action Control Strength

Threat Capability

Asset Loss Factors

Threat Loss Factors

Organizational Loss Factors

External Loss

Factors

Page 26: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualizing Action for applications in respect to organizational units and processes

Risk

Loss Event Frequency

Threat Event

FrequencyVulnerabilit

y

Probable Loss

Magnitude

Primary Loss

Factors

Secondary Loss

Factors

© sebis090205-Ernst-Visualization of Risk 26

Contact Action Control Strength

Threat Capability

Asset Loss Factors

Threat Loss Factors

Organizational Loss Factors

External Loss

Factors

Page 27: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualizing Probable Loss Magnitude for applications in respect to organizational units and processes

Risk

Loss Event Frequency

Threat Event

FrequencyVulnerabilit

y

Probable Loss

Magnitude

Primary Loss

Factors

Secondary Loss

Factors

© sebis090205-Ernst-Visualization of Risk 27

Contact Action Control Strength

Threat Capability

Asset Loss Factors

Threat Loss Factors

Organizational Loss Factors

External Loss

Factors

Page 28: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualizing Primary Loss Factors for applications in respect to organizational units and processes

Risk

Loss Event Frequency

Threat Event

FrequencyVulnerabilit

y

Probable Loss

Magnitude

Primary Loss

Factors

Secondary Loss

Factors

© sebis090205-Ernst-Visualization of Risk 28

Contact Action Control Strength

Threat Capability

Asset Loss Factors

Threat Loss Factors

Organizational Loss Factors

External Loss

Factors

Page 29: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualizing Asset Loss Factors for applications in respect to organizational units and processes

Risk

Loss Event Frequency

Threat Event

FrequencyVulnerabilit

y

Probable Loss

Magnitude

Primary Loss

Factors

Secondary Loss

Factors

© sebis090205-Ernst-Visualization of Risk 29

Contact Action Control Strength

Threat Capability

Asset Loss Factors

Threat Loss Factors

Organizational Loss Factors

External Loss

Factors

Page 30: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Visualizing Thread Loss Factors for applications in respect to organizational units and processes

Risk

Loss Event Frequency

Threat Event

FrequencyVulnerabilit

y

Probable Loss

Magnitude

Primary Loss

Factors

Secondary Loss

Factors

© sebis090205-Ernst-Visualization of Risk 30

Contact Action Control Strength

Threat Capability

Asset Loss Factors

Threat Loss Factors

Organizational Loss Factors

External Loss

Factors

Page 31: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Agenda

Motivation and Introduction

Enterprise Architecture Management Patterns

System Cartography Tool (SyCaTool)

Visualizing Risks

Conclusion and OutlookConclusion and Outlook

© sebis090205-Ernst-Visualization of Risk 31

Page 32: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Conclusion and outlook

Results of System Cartography project can be used to improve risk analysis described by FAIR risk taxonomydescribed by FAIR risk taxonomy

SyCaTool generates• customized visualizations and• supports multiple Stakeholder-oriented abstractions

Prototypic implementation showed the potential for visualizing risksEAM tt i i h t t di i t d lEAM patterns are a promising approach to capture, disseminate, and apply EAM knowledge

Utilization on risk management showed the same benefitsg

SyCaTool and EAM patterns should be used to further advance risk t timanagement practice

We are looking for people to support us extending theEAM Pattern Catalog concerning risk management

© sebis090205-Ernst-Visualization of Risk 32

EAM Pattern Catalog concerning risk management

Page 33: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Thank you for your attention!

More information aboutSystem Cartography www.systemcartography.infoEAM Pattern Catalog www.systemcartography.info/eampc-wikiSyCaTool www systemcartography info/sycatoolSyCaTool www.systemcartography.info/sycatool

© sebis090205-Ernst-Visualization of Risk 33

Page 34: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Backupp

© sebis090205-Ernst-Visualization of Risk 34

Page 35: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Business Application – Direct Attributes

assetLossFactor (in $)threatLossFactor (in $)threatLossFactor (in $)contact (numer of incomming interconnections)action (probability)( y)organizationalLossFactor (in $)externalLossFactor (in $)controlStrengththreatCapability

© sebis090205-Ernst-Visualization of Risk 35

Page 36: Visualization of Risk - The Open Grouparchive.opengroup.org/public/member/proceedings/q... · Visualization of Risk Models, Methods and Tools Alexander M. Ernst ... Software Map Model

Business Application – Derived Attributes

primaryLossFactor (in $) = assetLossFactor + threatLossFactorsecondaryLossFactor (in $) = organizationalLossFactor + externalLossFactorsecondaryLossFactor (in $) = organizationalLossFactor + externalLossFactorprobableLossMagnitude (in $) = primaryLossFactor + secondaryLossFactorcontact (count) = number of interconnections associated to the BA( )threatEventFrequency (weighted count) = contact * actionvulnerability = controlStrength and threatCapabilitylossEventFrequency (weighted count) = threatEventFrequency * vulnerabilityrisk ($ per time) = lossEventFrequency * probableLossMagnitude

© sebis090205-Ernst-Visualization of Risk 36