indigocube - a peek at the future of software testing by polteq, ruud teunissen
DESCRIPTION
TRANSCRIPT
A Peek at the Future of Software TestingRuud Teunissen – Passionate software tester since 1989
“The best way to predict the future is to invent it” – Alan Kay
© 2014 2
St
ruct
ure
Pioneering
Structuring
Optimizing
Unstructured
Undisciplined
Flexible
Structured
Disciplined
Inflexible
Evolution
Time
© 2014 3
© 2014 4
© 2014 5
© 2014 6
St
ruct
ure
Pioneering
Structuring
Optimizing
Unstructured
Undisciplined
Flexible
Structured
Disciplined
Inflexible
Evolution of (software) testing
Time
© 2014 7
Pioneering
• Fully integrated in the development process
• Unknown, no buy-in, no budget, no process, no tools
• Struggling to get involved
• Only welcome in emergency situations
© 2014 8
Structuring
© 2014 9
• Defining the process
• Publishing
• Test automation
• Test Process Improvement models
Structuring
© 2014 10
Great!
• Dedicated, trained staff
• (Early) involvement
• Independent testing
• Risk based
• Testing Competence Center
• Recognized Role
Structuring
St
ruct
ure
© 2014 11
But…
• Template Zombies
• Process (Improvement) freaks
Structuring
St
ruct
ure
ProcessTheorySchedule
StrictIndependentDisciplineStructureStandards
© 2014 12
But…
• Template Zombies
• Process (Improvement) freaks
• Spreadsheet management
• Measure and metrics mania
• Complaining and blaming
Structuring
St
ruct
ure
© 2014 13
Optimizing
© 2014 14
Technology push Efficiency push
A Peek at the Future of IT
© 2014 15
A Peek at the Future of IT
• Architecture
– SOA, Virtualization, Web technology, Devices
© 2014 16
A Peek at the Future of IT
• Architecture
• Cloud
– *aaS
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing,
listening, analyzing, transmitting, learning,
controlling, purchasing, testing, alarming,
changing, updating, deleting, accessing, rejecting,
correcting, studying, booking, receiving, tracing,
protecting, deciding, managing, teaching,
facilitating, identifying, copying, removing,
demonstrating, checking, showing, selecting,
subscribing, unsubscribing, sharing, mailing,
communicating, reading, playing, working,
meeting, gambling, shopping, storing, cross
checking, retrieving, configuring, sketching,
saving, accelerating, enhancing, creating, growing,
checking in, checking out, finding out, reaching,
denying, talking, designing, making, verifying,
measuring
© 2014 17
• Architecture
• Cloud
• SoLoMo
A Peek at the Future of IT
© 2014 18
• Architecture
• Cloud
• SoLoMo
A Peek at the Future of IT
© 2014 19
• Architecture
• Cloud
• SoLoMo
A Peek at the Future of IT
© 2014 20
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
A Peek at the Future of IT
© 2014 21
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
A Peek at the Future of IT
© 2014 22
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
A Peek at the Future of IT
© 2014 23
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
A Peek at the Future of IT
© 2014 24
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
• DevOps
A Peek at the Future of IT
© 2014 25
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
• DevOps
• Continuous Delivery
A Peek at the Future of IT
© 2014 26
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
• DevOps
• Continuous Delivery
• … … … …
A Peek at the Future of IT
© 2014 27
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
• DevOps
• Continuous Delivery
• … … … …
A Peek at the Future of Software Testing
Optimizing
Today Tomorrow/Next
© 2014 28
A Peek at the Future of Software Testing
• Agile, Scrum
– Joint effort and success
– Early involvement and feedback
– Social skills required
– Test management role
© 2014 29
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
– Problem solving, (good) practice, heuristics, questioning
–People, skills, cooperation
– Exploratory
– Rapid Software Testing
The Seven Basic Principles of the Context-Driven School1.The value of any practice depends on its context.2.There are good practices in context, but there are no best practices.3.People, working together, are the most important part of any project’s context.4.Projects unfold over time in ways that are often not predictable.5.The product is a solution. If the problem isn’t solved, the product doesn’t work.6.Good software testing is a challenging intellectual process.7.Only through judgment and skill, exercised cooperatively throughout the entire project, are we able to do the right things at the right times to effectively test our products.
© 2014 30
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
– From complaining and blaming towards enabling
– Tactful leadership
© 2014 31
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
– Test in production
– Cloud testing (Iaas, Taas)
– Integration
© 2014 32
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
• Automation 2.0
– Automation of testing
– Architecture TestwareTest scriptsTest casesTest data
Registration Reporting
Test Automation
Software – Platform – Infrastructure
Test Automation Process & Organization
ProjectsChanges
PatchesFixes
System Under Test
Software – Service – Platform - Infrastructure
© 2014 33
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
• Automation 2.0
• Cloud Computing
– Testing in the Cloud (TaaS)
– Testing Cloud Services (SaaS)
© 2014 34
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
– Technical skills
– Multi dimensional
– Continuous integration
© 2014 35
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
• Outsourcing
– Scoping
– Agreements
– Management controls, metrics, health checks
test deliverables
test progress test process
product quality
© 2014 36
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
• Outsourcing
•
© 2014 37
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
• DevOps
• Continuous Delivery
• … … … …
A Peek at the Future of Software Testing
Optimizing
Today Tomorrow/Next
© 2014 38
TMapDevOpsCreativeTolerant
CMMI
Outsourcing
SaaS
BYODWaterfall
Telecom
Logistics
Reporting
CI
CD
SBTM
Vir
tu
al
iza
tio
n
IT-general
Networks
Infrastructure
PRINCE2
IREB
A Peek at the Future of Software Testing
© 2014 39
DistributedBusiness/RQMS
DevelopmentOperations
TechnicalAutomation
CloudSoLoMo
e.g. Security
CodingAutomation
TestingDevelopment
SocialTeam player
Communication
CraftsmanshipTesting
Test management
A Peek at the Future of Software Testing
© 2014 40
ProcessTheorySchedule
StrictIndependentDisciplineStructureStandards
PeopleSkills
ChangeLoose
Collaboration SolutionFlexibilityCreative
We’re Optimizing!
Optimizing
Today Tomorrow/Next
and
© 2014 41
Process
Theory
Schedule
Strict
Independent
Discipline
Structure
Standards
Creative
Flexibility
Solution
Collaboration
Loose
Change
Skills
People