whose test is it anyway - lw&cn v0.3
TRANSCRIPT
WHOSE TEST IS IT ANYWAY?
Lauren Wagstaff & Clinton Nobrega
Victoria Park Plaza London, UK
WEDS. AT 3.00 P.M.
SEPT . 21
BUSINESS ANALYSIS at Sheffield Hallam University
Sheffield Hallam's
TESTING APPROACH
WITH SPECIAL GUESTS
& OUR EXPERIENCE WHAT WORKS AND WHAT DOESN'T
KEYS TO SUCCESS!
WHOSE TEST IS IT ANYWAY? Featuring..
THEN
2 BA based in IT
No Requirements
No UAT
NOW
11 based centrally
Project funded only
Defined standards & methodology
Skills transfer
BA toolkit
NEXT
Restructure
Corporate projects & local initiatives
Demand for Continuous Improvement
2007
BUSINESS ANALYSIS at Sheffield Hallam University
2017
BUSINESS ANALYSIS at Sheffield Hallam University
NEXT
Validate
solution against
requirements
Cost/Benefits
analysis
Propose a
solution
Communicate
requirements
Analyse and
document
requirements
Gather
requirements
Define & scope
business area
Project Training
& documentation
Process
improvement
& redesign
Project
planning Project definition
& business case
Activity
based costing
Continuous
Improvement
initiatives
Knowledge
Transfer
training
Checkpoint
reports
Metrics
TESTING
BUSINESS ANALYSIS at Sheffield Hallam University
What is your current role?
A. Business Analyst
B. Programme/Project Manager
C. Programme/Project Support
D. Test Specialist
E. IT Specialist
F. Other
Business
Analys
t
Progr
amm
e/Pro
ject
Ma...
Progr
amm
e/Pro
ject
Sup...
Test Sp
ecialis
t
IT Sp
ecialis
t
Other
0% 0% 0%0%0%0%
BUSINESS ANALYSIS at Sheffield Hallam University
Have you been involved with testing?
A. Yes
B. No
YesNo
0%0%
BUSINESS ANALYSIS at Sheffield Hallam University
• Fundamental approach to all
work
• Logical and bespoke solution
to unique problem
• Each project is different and is
resourced in different ways
• The BAs in our team are
ALWAYS involved with testing
for a number of reasons
Sheffield Hallam's
TESTING APPROACH
Sheffield Hallam's
TESTING APPROACH
Write test scripts
Manage testing (incl. allocation)
Testing Manage defects
Training and engagement
SHU TESTING
CYCLE
Who should complete ?
A. Test team member
B. Business analyst
C. Users/ business area
D. IT
Test te
am m
e...
Business
analy
st
Users
/ busin
es... IT
0% 0%0%0%
Sheffield Hallam's
TESTING APPROACH
Write test scripts
Who should ?
A. Test team member
B. Business analyst
C. Users/ business area
D. IT
Test te
am m
e...
Business
analy
st
Users
/ busin
es... IT
0% 0%0%0%
Sheffield Hallam's
TESTING APPROACH
Manage testing (incl. allocation)
Who should carry out ?
A. Test team member
B. Business analyst
C. Users/ business area
D. IT
Test te
am m
e...
Business
analy
st
Users
/ busin
es... IT
0% 0%0%0%
Sheffield Hallam's
TESTING APPROACH
Testing
Who should identified through testing?
A. Test team member
B. Business analyst
C. Users/ business area
D. IT
Test te
am m
e...
Business
analy
st
Users
/ busin
es... IT
0% 0%0%0%
Sheffield Hallam's
TESTING APPROACH
Manage defects
1. What is the project?
2. What is the context of the project?
3. Who is available to work on the project?
Sheffield Hallam's
TESTING APPROACH
So how do we decide on an approach to testing?
OUR EXPERIENCE WHAT WORKS AND WHAT DOESN'T
THE ONE MAN BAND: EXTERNAL EXAMINERS
• 6 months, movement of Excel log to
corporate system
• Objective: consistent management &
increased accessibility
• Small change project, few
stakeholders
• One business user and BA involved
• Limited time available for testing
OUR EXPERIENCE WHAT WORKS AND WHAT DOESN'T
THE ONE MAN BAND: EXTERNAL EXAMINERS
OUR EXPERIENCE WHAT WORKS AND WHAT DOESN'T
• Simple and straightforward excel test
scripts
• Test scripts quick to produce and
change
• Detailed knowledge of requirements
by "testers"
• Easy to manage and assign test
incidents based on only 2 testers
• Risk - single point of contact
• Frequent changes to requirements
throughout testing process
• Test scripts not descriptive enough
• Not enough time dedicated to testing
• No formal feedback loop with
developers
THE PUB BAND: PAPERLIGHT
OUR EXPERIENCE WHAT WORKS AND WHAT DOESN'T
• Large change project, lots of
stakeholders
• 3 years, online application and
supporting back-office processing
(160 requirements)
• Dedicated test team managed writing
and management of tests
• BA = QA
THE PUB BAND: PAPERLIGHT
OUR EXPERIENCE WHAT WORKS AND WHAT DOESN'T
• Dedicated test team
• Process users run the tests
• Testing process easily managed
through test management software
(SpiraTeam)
• Large volume of requirements to test in
limited time
• Poor communication and visibility of
product delivery from IT
• Test team not involved with
requirements gathering
• More time required for liaison between
BA and test team
• Poor quality of testing from process
users
THE ROCK STARS: UPGRADE
OUR EXPERIENCE WHAT WORKS AND WHAT DOESN'T
• Business users conduct the testing
• Upgrade of Systems in Tuition
(SITS:Vision), University's Student
Management System
• Standard, established business
activity
• Managed by IT Project Office using
SpiraTeam
• BA Role: facilitation and training
THE ROCK STARS: UPGRADE
OUR EXPERIENCE WHAT WORKS AND WHAT DOESN'T
• Test leads in each business area
• Kick-off meetings and full training
given to all users involved in testing
process
• Continuous improvement of process
throughout testing cycle
• Managed through test management
software (SpiraTeam)
• Dedicated test and defect
management windows (4 weeks
each)
• Resource intensive - higher cost due to
number of staff involved
• No technical involvement in testing
Write test scripts
Manage testing (incl. allocation)
Testing Manage defects
Training and engagement
BEST PEOPLE
FOR JOB
OUR EXPERIENCE WHAT WORKS AND WHAT DOESN'T
oles and responsibilities are clear
nforce benefits of completing process successfully
lear communications at important milestones
mprovement of testing quality through use of review
meetings throughout process
raining and named point of contact for queries
ccountability and ownership
essons learnt and feedback
COMMUNICATION & ENGAGEMENT
KEYS TO SUCCESS!
R
E
C
I
T
A
L
KEYS TO SUCCESS!
Convention?
THANK YOU!
CLINTON NOBREGA
+44 114 225 4887
Secretary & Registrar's Directorate
Sheffield Hallam University
S1 1WB
LAUREN WAGSTAFF
+44 114 225 3778