virtualization: improve speed and increase quality
Post on 15-Jul-2015
288 Views
Preview:
TRANSCRIPT
W8
Test Techniques
10/15/2014 1:45:00 PM
Virtualization: Improve Speed
and Increase Quality
Presented by:
Clint Sprauve
HP
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Clint Sprauve
HP Clint Sprauve is the senior product marketing manager for HP Software Functional Testing. Previously, Clint was the director of product strategy for the Borland Solutions division of Micro Focus, where he created Borland’s mobile strategy for functional test automation. With more than twenty years of experience in the software development and quality assurance industry, Clint has served as the senior product marketing manager for the Silk Testing Solutions at Borland Software and Segue Software, and as a senior technical sales engineer for both companies. He has been an independent consultant, specializing in test management and test automation.
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Virtualization: Improve Speed, Increase Quality Clint Sprauve - HP Product Marketing Manager, Functional Testing
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 2
Today’s Agenda
• Industry TestingCchallenges
• Agile Testing Challenges
• Service Virtualization
• Network Virtualization
• Q&A
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 3
About HP Software
Top10 Software company
95% Customer satisfaction
7,000 technologists
driving innovation
#1 in each of our categories #2
Customers
50,000+
94% of Fortune 100
10+ years
delivering SaaS
Software
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 4
Surging application numbers
A tipping point for application delivery
2010 4 per app
2015 36 per app
2020 120 per app
“60% of on-line devices are now smartphones are tablets”
– Business Intelligence
“In 2016, total global mobile application revenue will reach estimated $46 billion.”
--ABI Research
2013
Number of releases per app per year
• Apps everywhere
• Accessed through multiple devices
• 30x increase in application releases
• Closed feedback loop with customers
• Focus on time-to-value and ROI
What we expect:
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 5
Composite applications?
Search
Product
Pay
Payment
Buy Ship
Shipping
Track
Track package Public cloud Traditional Managed cloud Composite
Business processes are often an integration of existing components and services
Example:
The online shopping process
Each of these steps are interconnected software components, also called services
Customer profiles
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 6
Delivering change continuously and fast is risky
Quality assurance by validation throughout the Application Lifecycle will address these risks
Q
The risks:
Change is constant
• New implementations • Support packs • Customizations
Speed impacts bottom line • Time to revenue • Cost of implementation
Interdependence increases business risk
• Apps are interdependent • Each change adds to risk
Composite application
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 7
The Internet of things
Smart thermostats Connected cars Activity trackers Smart outlets Parking sensors
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 8
The Internet of things
Things get interesting when these connected devices and services start creating
compound applications within their own verticals and across industries
Home Consumer
Buildings Infrastructure
Cities Industry
Transport Mobility
Health Body
Transportation and smart cities
In downtown San Francisco 20-30% of all traffic congestion is caused by people hunting for a parking spot. – San Francisco Municipal Transportation Agency
Healthcare and smart home
40 million adults age 65 and over will be living alone in the U.S., Canada and Europe – U.S. Department of Health
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 9
Streamlining development and operations: on-premise or in the cloud
Continuous delivery
Deploy test app
Run test cases
Test results
Dev-test with lab management automation 1
Provision dev and test
environments
Production patterns, snapshots, and monitors back to dev and test 3
Management, collaboration, risk management and security for the complete lifecycle 4
Provision and deploy to staging
Provision and deploy to prod
Automated deployment across development and operations
Monitor
2
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 11
The Agile Manifesto vs. the Enterprise Agile Manifesto
The Agile Manifesto
• Individuals & interactions over processes & tools
• Working software over comprehensive docs
• Customer collaboration over contract negotiation
• Responding to change over following a plan
The Enterprise Agile Manifesto
• Individuals & interactions with lean processes & tools
• Working software with essential docs
• Stakeholder collaboration with agile contracts
• Responding to change as intrinsic part of the plan
• Delivered agile architecture which reuses and evolves enterprise frameworks and patterns
http://agilemanifesto.org http://davidsprottsblog.blogspot.com/2012/10/agile-manifesto-for-enterprise.html
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 13
Advantages and disadvantages
Stubbing (mocking)
Reduces external dependencies
Promotes a test driven development approach
Allows some testing of code with limited functionality
Stubs have to be created from scratch
Doesn’t foster proper re-use (multiple developers using different versions of the stubs)
Real world test conditions are very difficult to recreate
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 14
Composite Application
API
Mobile App
Web browser
Application under test Existing infrastructure
The service virtualization concept
Virtual services are created to stand in for the real service when developers or testers need access
Mainframe
JDBC
SOAP
RFC/IDOC
MQ/CICS
Third party
SAP System
Existing database
Web service and legacy application
REST
Pay-per-transaction
SOAP REST JDBC MQ RFC CICS
Data
Perf.
Config
Service virtualization
Simulation
Under construction
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 15
For continuous development and quality
Service virtualization addresses the challenges
1. Composite applications and software re-use
2. Highly-visible demand for quality
3. Proliferation of mobility…
4. and cloud service integration
5. Release faster-test earlier: shift left testing (development and infrastructure testing)Service virtualization removes constraints and wait times frequently experienced by development and test teams needing to access components, architectures, databases, mainframes, and so on.
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 16
End-to-end system virtualization
Traditional test environment
End-to-end virtualization
+
Wifi 3g 2g LTE
Ne
two
rk
Services
ERP Virtual LDAP
3rd Party
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 18
Application Complexity
The average application connects to 38 discreet services
Mainframe
Storage
DB
Servers
Web
Services
App
Servers
Web
Servers
Load
Balancers
Mobile
Components
Major ISP
3rd Party
Cloud Services
Content
Delivery
Networks
Mobile Carriers
& ISPs Browser
s &
Devices
Customers
Employees
Private or Public
Cloud Services
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 20
It’s All About Bandwidth
Network Misconceptions
10Mbps 20Mbps 2Mbps 500kbps
Latency 25ms
Bandwidth
No Impact No Impact No Impact Some Impact
All Traffic Impacted
Packet Loss = Further Impact
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 21
It’s All About Bandwidth
Less Critical Due to 4G (5G, 6G …)
Network Misconceptions
Carrier Frequency: • Increased Interference 2G 3G 4G 5G … 20% of all 4G Transfers Drop to 3G or Lower
Cisco Mobile Forecast: • Mobile data traffic will grow 7-fold from 2013 to 2018
= compound annual growth rate of 50%
Ofcom: • Current UK Mobile Data capacity will be exhausted by
2018
Shannon-Hartley Theorem: • Every Mobile Cell can only support a maximum channel
capacity
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 22
It’s All About Bandwidth …
Less Critical Due to 4G (5G, 6G …)
It Doesn’t Make Much Difference …
Network Misconceptions
Web Users – Average Transaction Response Time (s)
20x to 35x slower
Baseline
London Web
Dublin Web
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 23
It’s All About Bandwidth …
Less Critical Due to 4G (5G, 6G …)
It Doesn’t Make Much Difference …
Network Misconceptions
Mobile Users – Average Transaction Response Time (s)
80x to 400x Slower
Functional Failures
Baseline
London 3G
Dublin 3G
London 2.5G
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 24
It’s All About Bandwidth …
Less Critical Due to 4G (5G, 6G …)
It Doesn’t Make Much Difference …
It’s Only About Performance …
Network Misconceptions
Load Test with NV Local Load Test
Transaction Time
Transaction Time VUsers VUsers
Capacity > 500+ Users Response < 10 seconds
Capacity < 200 Users Response > 40 seconds
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 25
It’s All About Bandwidth …
Less Critical Due to 4G (5G, 6G …)
It Doesn’t Make Much Difference …
It’s Only About Performance …
Network Misconceptions
No Network With Remote With Web With Mobile
Thread Count
No Network Remote Web Users
50% CPU Increase
22% Thread Count Increase
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 26
It’s All About Bandwidth …
Less Critical Due to 4G (5G, 6G …)
It Doesn’t Make Much Difference …
It’s Only About Performance …
NV is Only For Mobile …
Network Misconceptions
Remote Office Web Cloud Deployments All Other Connectivity (Wifi, Satellite, BT) Back-End Splits DCR … Wherever Applications Meet Networks
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 27
When to Use Network Virtualization
Development Manual, Unit Test, Emulators
Functional Test Desktop or On-Device – Manual or Mobile test automation
Load/Performance Test On premise or Cloud
Network/System Test WAN Acceleration, VDI
Service Virtualization End-to-End Lifecycle virtualization
Powerful combination!
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 28
Continuous Testing with Virtualization for Real World Conditions
The ideal Agile picture
Sprint 4 1 Sprint 3 Sprint 2 Sprint 1 Sprint 5
C1 C1
G1
C1
G1
C2
G2
C1
G1
C2
G2
C3
B1
C1
G1
C2
G2
C3
B1
G1
C2
Longevity testing (independent of sprint cycles)
Regression 1
Regression 2
Regression 3
CI CI CI CI CI
Regression 4
ET ET ET ET ET
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 29
Relentless automation – Agile sprint to enterprise release…
Shift left, then test continuously
Solving key testing challenges
Exploratory testing
Automated testing
Continuous integration
Regression testing
Longevity testing
Lack of the right test tools to create re-usable test sets
Difficulty in re-using and repeating tests across sprints / iterations
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 30
Continuous testing for faster app delivery
“Shift-left”
with confidence
• Improve development efficiency
• Reduce the test burden
• Accelerate application delivery
Validate Security
Summary - Continuous testing is more critical than ever
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Closing and questions
top related