measuring human systems integration return on investment dr. tareq ahram, prof. waldemar karwowski...

MEASURING HUMAN SYSTEMS INTEGRATION RETURN ON INVESTMENT

MEASURING HUMAN SYSTEMS INTEGRATION RETURN ON INVESTMENT

Dr. Tareq Ahram, Prof. Waldemar Karwowski

The Institute for Advanced Systems Engineering

University of Central Florida Orlando, Florida

Spring,2009

IASE Proprietary InformationLimited Distribution

OverviewOverview

Definition and Description of Human Systems Integration (HSI)

Human Factors and Task Analysis

HSI Domains and building blocks

Benefits of HSI

HSI Return on Investment (ROI)

Conclusions

3

INCOSE Spring 09

Copyright © 2009 by Ahram and Karwowski.

HSI DefinedHSI Defined Human Systems Integration is defined as a process that optimizes the

human part of the total system equation by integrating human factors engineering, manpower, personnel, training, health, safety, survivability, and habitability considerations into the system acquisition process .

Hardware

Humans

Software

Systems Engineering

Integration

Human-Computer

Man-Machine

Ensuring Systems Design & Development Meet Human Performance Capability Early in Acquisition Process

4

INCOSE Spring 09


Human Factors is…

A branch of applied science aimed at matching system, machines and tasks with the abilities of their human operators.

The study, discovery, and application of information about human abilities, human limitations, and other human characteristics to the design of tools, devices, machines, systems, job tasks and environments for effective human performance.

-Alphonse ChapanisWhat HFEs need to do…

What they do bestKnow the USER!

5

INCOSE Spring 09


Task Analysis and Modeling in Activity Theory: Cognitive Analysis, Quantify Economic, Productivity & Injury Issues for Human Factors in Acquisition

Define Function

Define Root Cause

(Hazards)

Define HE&E Risks

(Mishaps)

Perform FunctionAllocation

Define Tasks

Define Human

Interface Elements

Risk Acceptable?

Develop Mitigation Strategies

Define Sub-Function

Perform Risk Assessment

Reassess Risks

Develop Risk Mitigation

PlanYes

No

Initiating Need/Data

Guidance from Risk

Matrix

Status: Provides comprehensive process overview of risk factors through all acquisition phases

6

INCOSE Spring 09


Health Hazards

Human FactorsEngineering

HumanSurvivability

Human Systems Integration (HSI)

Human Systems Integration DomainsHuman Systems Integration Domains

Number of personnel,both men and women,military and civilian,required to operate andmaintain the system

Aptitudes, experiences & other characteristics needed to achieve optimal system performance

Inherent ability of the system to be used, operated and maintained without accidental injury to personnel

Requisite knowledge, skills & abilities needed by available personnel to operate and maintain systems under operational conditions

Inherent conditions in the operation of a system that could cause death, injury, illness, disability or reduce job performance or personnel

Integration of human character-istics into system definition, design, development and evaluation to optimize performance of human-machine combinations

Characteristics of a system that can prevent damage; minimize medical injury if wounded; and reduce physical and mental fatigue.

Manpower Personnel System Safety Training

7

INCOSE Spring 09


HSI knowledge management components

Source: “Interactive Management of Human Factors Knowledge for Human Systems Integration”, Electronic Globalized Business and Sustainable Development through IT Management: Strategies and Perspectives, (IGI-Global). (Ahram, Karwowski and Andrzejczak, 2009)

8

INCOSE Spring 09


Systems Engineering and HSI “Pieces Fit Together”Systems Engineering and HSI “Pieces Fit Together”Systems Engineering ConsiderationsSystems Engineering Considerations

9

INCOSE Spring 09


HSI model as a framework for analysis and traceability

Source: Human Systems Integration: Development Based on SysML and the Rational Systems Platform. (Ahram et al. 2009)

10

INCOSE Spring 09


Benefits of HSIBenefits of HSI

The goal of human systems integration is to:

• Optimize total system performance,

• Accommodating the characteristics of the user

population that will operate, maintain, and support

the system,

• Minimize life-cycle costs.

11

INCOSE Spring 09


Source: A Total Ship-Crew Model to Achieve Human Systems Integration, Dr. Loretta DiDonato CDR Joseph B. Famme USN (ret.),LCDR Alan Nordholm USN, Senior Chief Alan Lemon

12

INCOSE Spring 09


Scenario & Instructor Control “Flooding”

Operator

Source: A Total Ship-Crew Model to Achieve Human Systems Integration, Dr. Loretta DiDonato CDR Joseph B. Famme USN (ret.),LCDR Alan Nordholm USN, Senior Chief Alan Lemon

13

INCOSE Spring 09


Integration of Human Performance Modeling in Telelogic Doors

A typical ENOVIA session with models and model preview

14

INCOSE Spring 09


CATIA session for designing modern car seats with position prediction based on human factors engineering and ergonomics guidelines

Source: Interactive Management of Human Factors Knowledge for Human Systems Integration,(Ahram, Karwowski & Andrzejczak, 2009)

15

INCOSE Spring 09

Copyright © 2009 by Ahram and Karwowski.Source: Interactive Management of Human Factors Knowledge for Human Systems Integration,(Ahram, Karwowski & Andrzejczak, 2009)

16

INCOSE Spring 09

Copyright © 2009 by Ahram and Karwowski. (Image source: HSI in Human Spaceflight , Susan D. Baggerman. March, 2007)

Lack of Human-Centered DesignExcessive Noise LevelsExcessive Noise Levels

Poor Usability of ProceduresPoor Usability of Procedures

Excessive Vibration and Stress LevelsExcessive Vibration and Stress Levels

Examples of Bad DesignsExamples of Bad Designs

17

INCOSE Spring 09


The tool box for the T-53 turbine engine (Huey & Iroquois) had 134 different tools.The tool KIT for the T-800 for the Comanche has only SIX tools instead of 134

Standard bolts throughout the engine provided the fix (some bolts “too” strong)

ResultsReduced workload for maintainerLess burden on the supply system Less training and inventory timeBetter combat readiness

18

INCOSE Spring 09


The Government Accountability Office (GAO) found that:

About 38 of 95 projects exceeded their original allocated budgets (extra

$295 billion), and an average delay of 21 months in project schedules (Taubman 2008).

Systems delivered almost two years late on average.

None of the systems that the GAO looked at had met all of the standards for best management practices during their development stages.

Major cause was the lack of human systems integration.

Importance of HSIImportance of HSI

Source: Taubman, Philip. (June 25, 2008) Top Engineers Shun Military; Concern Grow. The New York Times

19

INCOSE Spring 09


Importance of HSIImportance of HSIFailure to employ human systems integration within

the systems engineering process may result in:

Failure to meet desired system objectives,

Poor design,

Unnecessary burdens on the workers,

Negative impacts to the environment and

public health and safety.

Human Systems Integration Building BlocksHuman Systems Integration Building Blocks

1

6 5

47

3

2HSI process Requirements

Analysis

HSI Plan

HSI RisksHSI Metrics

Human Interfaces

HSI Strategy8Modeling

21

INCOSE Spring 09


Modeling of HSI Return on InvestmentModeling of HSI Return on Investment Starts with the identification of good HSI practices.

Including factors such as cost reduction, meeting project schedule, increased safety and improved overall system performance.

The expected result is a savings in both time and cost, with better system quality

and increased safety.

22

INCOSE Spring 09


The Multi-criteria Weighted Model To Estimate The Multi-criteria Weighted Model To Estimate HSI Return On InvestmentHSI Return On Investment

The Human System Integration Return on Investment (HSI-ROI) model was developed based on the multi-criteria weighted HSI performance measures.

In the multi-criteria weighted model we calculate the sum of weighted values of improved performance (cost savings) resulted from implementing HSI best practices.

23

INCOSE Spring 09


Multiply savings associated with each HSI performance measure (i.e. dollar value) (K ) by the weight of the respective performance measure, assigned by HSI professionals.


24

INCOSE Spring 09


Personnelk

Trainingk

Health&Safetyk

tyHabitabilik

itySurvivabilk

= Savings resulted from reducing workforce costs.

= Savings resulted from reducing training costs.

= Savings resulted from avoiding accidents and injuries.

= Savings resulted from increasing personnel habitability.

= Savings resulted from increasing workers/personnel survivability.

: Priority of HSI personnel performance measure

: Priority of HSI training performance measure : Priority of HSI safety and health performance measure

: Priority of HSI habitability performance measure

: Priority of HSI survivability performance measure

PersonnelW

TrainingW

HSW &

tyHabitabiliW

itySurvivabilW

...)()()([ && HSHSTrainingTrainingPersonnelPersonnel kWkWkWROIHSI

)]()(... itySurvivabilitySurvivabiltyHabitabilityHabitabili kWkW

25

INCOSE Spring 09


In order to achieve best performance, program managers seek to:

Minimize the dollar value spent on: training, manpower, maintenance personnel,

Maximizing: safety, habitability and human survivability by avoiding accidents and injuries.


26

INCOSE Spring 09


ChallengesChallenges Providing quantitative value-added positive

contribution, in terms of cost and schedule.

Providing tools and methods that can help program managers and systems designers with answers to questions crucial to successfully meeting this challenge.

27

INCOSE Spring 09


There is a need for more comprehensive HSI tools and techniques.

Poor guidance and understanding on what HSI methods and tools can provide.

Research in HSI indicates that employing best practices can shape better system decisions.

ChallengesChallenges

28

INCOSE Spring 09


Conclusions Conclusions The application of decision science into systems

engineering to evaluate HSI return on investment is a new contribution to the field of systems engineering.

The weighted multi-criteria model for leveraging the effect of multiple performance measures is anticipated to provide a better technique to quantify HSI-ROI for overall system performance.

29

INCOSE Spring 09


Thank you !

Questions ?

Contact Information:

[email protected]

30

INCOSE Spring 09


References Cited AF SAB 2005 “System-of-Systems Engineering for Air Force Capability Development”, SAB-TR-05-04

Air Force Science Advisory Board report (AF SAB-TR-04-04)

Ahram, T. Z., Karwowski, W. Andrzejczak, C., (2009) “Interactive Management of Human Factors Knowledge for Human

Systems Integration”, Electronic Globalized Business and Sustainable Development through IT Management: Strategies and

Perspectives, (IGI-Global).

Ahram, T. Z., Karwowski, W., Amaba, B., Obeid, P. (2009). “Human Systems Integration: Development Based on SysML and

the Rational Systems Platform”, Proceedings of the 2009 Industrial Engineering Research Conference, Miami, FL. USA.

Ahram, T. Z., Karwowski, W., (2009) “Measuring Human Systems Integration Return on Investment” The International

Council on Systems Engineering – INCOSE Spring 09 Conference: Virginia Modeling, Analysis and Simulation Center

(VMASC), Suffolk, VA. USA.

Booher, Harold, ed. (2003). Handbook of human systems integration. New Jersey: Wiley.

Chapanis, A. (1996). Human factors in systems engineering. Wiley Series in Systems Engineering and Management. Andrew

Sage, series editor. Hoboken, NJ: Wiley.

DiDonato L., Famme J., Nordholm . A. (2004). A Total Ship-Crew Model to Achieve Human Systems Integration, I/ITSEC

Dray, S. (1995). The importance of designing usable systems. Interactions 2 (1): 17–20.

INCOSE INSIGHT Volume 11 No. 2.

I/ITSEC

31

INCOSE Spring 09


References Cited Hardman, Nicholas, Colombi John, Jacques, David, and Hill,Ray, (2008). What Systems Engineers Need to Know About

Human Computer Interaction, INCOSE INSIGHT Volume 11 No. 2

Malone, T. B., and F. Carson. (2003). HSI top down requirements analysis. Naval Engineers Journal 115: 37-48.

Militello, L.G., C.O. Dominguez, G. Lintern, and G. Klein. Forthcoming. The cognitive systems engineering landscape.

Nielson, J., and R. L. Mack, eds. (1994). Usability inspection methods. New York: Wiley.

Taubman, Philip. (June 25, 2008) Top Engineers Shun Military; Concern Grow. The New York Times Website:

http://www.nytimes.com/2008/06/25/us/25engineer.html

Wickens, C., J. Lee, Y. Liu, and S. Gordon-Becker. (2004). An introduction to human factors engineering. 2nd ed. Upper

Saddle River, NJ: Prentice Hall.I/ITSEC

measuring human systems integration return on investment dr. tareq ahram, prof. waldemar karwowski...

Documents

performance of human

human characteristics

human abilities

human limitations

human operators

incose spring

effective human performance

health hazards human