aadescriptivedescriptiveclassificationforenduser-relevant...

1
A Descriptive Descriptive Descriptive Descriptive Descriptive Descriptive Descriptive Descriptive Classification Classification Classification Classification Classification Classification Classification Classification for for for for for for for for End End End End End End End End User User User User User User User User-Relevant Relevant Relevant Relevant Relevant Relevant Relevant Relevant Decisions Decisions Decisions Decisions Decisions Decisions Decisions Decisions of of of of of of of of Large Large Large Large Large Large Large Large- Scale Scale Scale Scale Scale Scale Scale Scale IT IT IT IT IT IT IT IT Projects Projects Projects Projects Projects Projects Projects Projects of of of of of of of of Large Large Large Large Large Large Large Large- Scale Scale Scale Scale Scale Scale Scale Scale IT IT IT IT IT IT IT IT Projects Projects Projects Projects Projects Projects Projects Projects Ulrike Ulrike Ulrike Ulrike Abelein, Abelein, Abelein, Abelein, Barbara Barbara Barbara Barbara Paech Paech Paech Paech Institute of Computer Science, University of Heidelberg, Germany {abelein,paech}@informatik.uni-heidelberg.de {abelein,paech}@informatik.uni-heidelberg.de Problem User participation and involvement in software development is essential for system success…. Improved quality due to more precise requirements Prevention of expensive features Positive attitude of users towards system + + + + …But many large-scale IT projects still use traditional development with low level of user participation and involvement Users do not feel integrated in project Users do not recognize the requirements Users have low motivation to participate + + + + - - - - - - Positive attitude of users towards system More effective use of system Users have low motivation to participate Frustration and inefficiency + + + + User-Developer Communication Methods for Large-Scale IT Projects - - - - End users Better understand decisions in the design What decisions made by IT project members are relevant to end users? All End Users Train developers on capturing decisions User-Developer Communication Methods for Large-Scale IT Projects B Use Cases for Descriptive Classification A and implementation phase Explicitly describe their notification preferences IT personnel Use the examples to understand the relevant to end users? End User Representatives Set up communications structures A B B implications of their decisions Use classification to categorize decisions for documentation Project managers Use checklist to identify important decisions + + User Req. Sys. Req. Decision + Rationale Repository Set up traceability of decisions to Notification Preferences + + C Use classification structure to track notification preferences Section presentations or workshops R = Responsible, A = Accountable Responsibility matrix R = Responsible, A = Approver Descriptive Classification of User-Relevant Decisions of decisions to end user representatives Define means of communication C R = Responsible, A = Accountable C = Consulted I = Informed Responsibility matrix R = Responsible, A = Approver C = Consulted, I = Informed Descriptive Classification of User-Relevant Decisions Reoccurring Topics License cost incl. tradeoff open source vs. proprietary 1 Sum Example of User-Relevant Decision Trigger Points Abstraction level Context Decision Implication CRM Flexibility of promotions for contracts, open source vs. proprietary software Staffing for tests 2 9 4 10 Timing (project and operations) Cost allocation (project and operations) Project level Organization/Skills* CRM telecommunication contract system Flexibility of promotions for contracts, i.e. adaptable from the business team or need to change system configuration Large implementation cost implications ERP system Adaptations of original template for some business units Changes in roll out alters the whole project plan Insurance industry Changes in project schedule Requires early communication to all Standard central processes 3 Access rights and 4 9 9 Responsibilities of users Task level Business processes Business process level Organization/Skills* (with seasonal business) Changes in project schedule Requires early communication to all stakeholder n/a Integrate content management system function within larger system Changed business process as user needed only to use one system instead of two n/a Automatic validation checks from legacy health care system cannot be End users now need to implement new process to check validity of input, e.g. Access rights and automation of approvals 4 Manual vs. automated 5 9 6 12 Features To-be activities Domain level Responsibilities of users Task level n/a health care system cannot be implemented in new system process to check validity of input, e.g. double entry CRM system in call center Automatic assignment of queues Employees no longer get to choose (even though it's a limited choice that is relevant for them and their motivation) Online system for sales in insurance No implementation of offline functionality system not usable as sales employees sometimes have no internet access Manual vs. automated activities 5 Unfeasible user requirements due to 6 4 5 4 User Interface Workflow of the system Interaction level Domain data sales in insurance sometimes have no internet access n/a SAP standard system did not allow 20-digites account numbers Dismissal of SAP for accounting system Travel booking system Decision on order of transactions, e.g. 1. flight, 2. hotel, 3. rental car Significant influence on rollback effort n/a Usage or non-usage of back-button in Different user experience complexity Support of end user devices 7 4 2 7 Technology System level User Interface Interaction level System Interfaces* n/a Usage or non-usage of back-button in browser Different user experience Call center Decide how many systems are used in parallel Call center employees need to know how many systems n/a No support of iPads due to usage of standard calendar package User cannot use iPads Total 81 Research Method – Expert Interview 12 semi-structured interviews with experts in large-scale IT projects No communication setup captures decisions of design and implementation Total 81 ~18 hours of interview time Transcribed 322 pages Coded with descriptive codes Majority of experts consider the classification valid and comprehensive Two new trigger points included (see *) 81 examples of user-relevant decisions collected

Upload: others

Post on 27-Sep-2020

16 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: AADescriptiveDescriptiveClassificationforEndUser-Relevant ...se.ifi.uni-heidelberg.de/fileadmin/pdf/publications/2013...AADescriptiveDescriptiveClassificationforEndUser-Relevant-RelevantRelevantDecisions

AAAAAAAA DescriptiveDescriptiveDescriptiveDescriptiveDescriptiveDescriptiveDescriptiveDescriptive ClassificationClassificationClassificationClassificationClassificationClassificationClassificationClassification forforforforforforforfor EndEndEndEndEndEndEndEnd UserUserUserUserUserUserUserUser--------RelevantRelevantRelevantRelevantRelevantRelevantRelevantRelevant DecisionsDecisionsDecisionsDecisionsDecisionsDecisionsDecisionsDecisionsofofofofofofofof LargeLargeLargeLargeLargeLargeLargeLarge--------ScaleScaleScaleScaleScaleScaleScaleScale ITITITITITITITIT ProjectsProjectsProjectsProjectsProjectsProjectsProjectsProjectsofofofofofofofof LargeLargeLargeLargeLargeLargeLargeLarge--------ScaleScaleScaleScaleScaleScaleScaleScale ITITITITITITITIT ProjectsProjectsProjectsProjectsProjectsProjectsProjectsProjectsUlrikeUlrikeUlrikeUlrike Abelein,Abelein,Abelein,Abelein, BarbaraBarbaraBarbaraBarbara PaechPaechPaechPaechInstitute of Computer Science, University of Heidelberg, Germany{abelein,paech}@informatik.uni-heidelberg.de{abelein,paech}@informatik.uni-heidelberg.de

Problem

User participation and involvement in software development is essential for system success….

• Improved quality due to more precise requirements

• Prevention of expensive features

• Positive attitude of users towards system

++

++

…But many large-scale IT projects still use traditional development with low level of user participation and involvement

• Users do not feel integrated in project

• Users do not recognize the requirements

• Users have low motivation to participate++++

------• Positive attitude of users towards system

• More effective use of system

• Users have low motivation to participate

• Frustration and inefficiency

++

++

++

User-Developer Communication Methods for Large-Scale IT Projects

----

End users

– Better understand decisions in the design

What decisions made by

IT project members are

relevant to end users?

All End UsersTrain developers on capturing decisions

User-Developer Communication Methods for Large-Scale IT Projects

B

Use Cases for Descriptive Classification

A

– Better understand decisions in the design

and implementation phase

– Explicitly describe their notification

preferences

IT personnel

– Use the examples to understand the

relevant to end users?

End User

Representatives

Set up communications structures

A

B

B

– Use the examples to understand the

implications of their decisions

– Use classification to categorize decisions

for documentation

Project managers

– Use checklist to identify important decisions

++User

Req.Sys.

Req.Decision +

Rationale

RepositorySet up traceability of decisions to

Notification

Preferences++

C

– Use classification structure to track

notification preferences

– Section presentations or workshops

R = Responsible, A = AccountableResponsibility matrixR = Responsible, A = Approver

Descriptive Classification of User-Relevant Decisions

Repositoryof decisions to end user representatives

Define means of communication

C

Responsibility matrix R = Responsible, A = AccountableC = Consulted I = InformedResponsibility matrix

R = Responsible, A = ApproverC = Consulted, I = InformedDescriptive Classification of User-Relevant Decisions

Reoccurring Topics

License cost incl. tradeoff

open source vs. proprietary

1

SumExample of User-Relevant DecisionTrigger PointsAbstraction level

Context Decision Implication

CRM Flexibility of promotions for contracts, open source vs. proprietary

software

Staffing for tests2

9

4

10Timing (project and

operations)

Cost allocation (project and operations)

Project level

Organization/Skills*

CRM telecommunication contract system

Flexibility of promotions for contracts, i.e. adaptable from the business team or need to change system configuration

Large implementation cost implications

ERP systemAdaptations of original template for some business units

Changes in roll out alters the whole project plan

Insurance industry Changes in project schedule Requires early communication to all

Standard central

processes

3

Access rights and

4

9

9Responsibilities of users Task level

Business processesBusiness process

level

Organization/Skills* (with seasonal business)

Changes in project schedule Requires early communication to all stakeholder

n/aIntegrate content management system function within larger system

Changed business process as user needed only to use one system instead of two

n/aAutomatic validation checks from legacy health care system cannot be

End users now need to implement new process to check validity of input, e.g.

Access rights and

automation of approvals4

Manual vs. automated 5

9

6

12Features

To-be activities

Domain level

Responsibilities of users Task level n/a health care system cannot be implemented in new system

process to check validity of input, e.g. double entry

CRM system in call center

Automatic assignment of queuesEmployees no longer get to choose (even though it's a limited choice that is relevant for them and their motivation)

Online system for sales in insurance

No implementation of offline functionality system not usable as sales employees sometimes have no internet access Manual vs. automated

activities

5

Unfeasible user

requirements due to

6

4

5

4User Interface

Workflow of the system

Interaction level

Domain data

sales in insurance sometimes have no internet access

n/aSAP standard system did not allow 20-digites account numbers

Dismissal of SAP for accounting system

Travel booking system

Decision on order of transactions, e.g. 1. flight, 2. hotel, 3. rental car

Significant influence on rollback effort

n/aUsage or non-usage of back-button in

Different user experience complexity

Support of end user

devices

7

4

2

7Technology System level

User InterfaceInteraction level

System Interfaces*

n/aUsage or non-usage of back-button in browser

Different user experience

Call centerDecide how many systems are used in parallel

Call center employees need to know how many systems

n/aNo support of iPads due to usage of standard calendar package

User cannot use iPads

Total 81

Research Method – Expert Interview

• 12 semi-structured interviews with experts in large-scale IT projects • No communication setup captures decisions of design and implementation

Total 81

• 12 semi-structured interviews with experts in large-scale IT projects

• ~18 hours of interview time

• Transcribed 322 pages

• Coded with descriptive codes

• No communication setup captures decisions of design and implementation

• Majority of experts consider the classification valid and comprehensive

• Two new trigger points included (see *)

• 81 examples of user-relevant decisions collected