cop test going the cloud versie 0.5

Together. Free your energies

Riding the test services wave, July 2010Remco Oostelaar

Version 0.5

Cloud Computing


Where are we standing with Cloud Computing

Source: Source: Gartner (August 2009)

© 2010 Capgemini. All rights reserved. 3

Cloud Computing; a testers point of view, Remco Oostelaar, July 2010


Let’s take a bit of a broad perspective


4© 2010 Capgemini. All rights reserved.

Source: Infinite “go to market” strategy NL, 2007

Generation

Z

Generation

Y

Generation

X

1960 1970 1980 1990 2000 2010 2020 2030 2040

• Also known as the multi-Task generation.

• 89% of this group are active online even at a young age and far more interactive than any previous generation.

• Early adopters for social media/ Networking

• The majority use social networks (86%)

Podcast (57%), Blogs (50%) and text messages (97%)

• 69% of this group shopped online and

65% banked online and read blogs (21%0


The IT.org challenge of the 21th century

85% in distributed computing environments, up to 85% of computing capacity sits idle.

1.5x explosion of information driving 54% growth in storage shipments every year.

70% on average is spent on maintaining current IT infrastructures versus adding new capabilities.

3.5% of lose in sale, due to supply chain inefficiencies. 75% of the customers are working to improve their Security



September 26, 2006Customer CIO, Fortune 1000 Company


Global Access to Services & Applications, Virtual and Transparent

Trends• Globalization of consumer services

(Complexity of the business chain)• Business distribution of products

and services and processes • Real time service• Transparency & traceability in

services and availability• Mobilization of everything• Business is demanding earlier Time

to Market (TTM).




Cloud Computing explained

NIST - Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction.

This Cloud model promotes availability and is composed of five essential characteristics, three service models, and four deployment models.



Gartner - A style of computing where massively scalable IT-related capabilities are provided ‘as a service’ across the Internet to multiple external customers.”

Forrester: A standardized IT capability (services, software, or infrastructure) delivered via Internet technologies in a pay-per-use, self-service way.

Cloud Computing for Dummies (published by Wiley): Cloud computing is the next stage in the evolution of the Internet. The Cloud in Cloud computing provides the means through which everything — from computing power to computing infrastructure, applications, business process to personal collaboration — can be delivered to you as a service wherever and whenever you need.


The 5 Attributes of Cloud Computing

1. It must be service based - and “ready to use”

2. Rapidly scalable - available on demand adding or removing resources as required

3. Shared – multiple customers sharing the same resources & underlying infrastructure

4. Pay per use – metered or measured service that can be provided through different pricing plans

5. Web enabled – connected using internet based technologies




Service models translation

Infrastruture

Applications

Business process

PaaS

DaaS

IaaS

Source: What is Cloud Computing, 2010 (Mark Skilton)

SaaS

Data

Amazon EC2

BT

Nirvanix

Google Apps

Mosso

Force.com

MS Azure

Google docs

Twitter

Sales Force




Types of Clouds examples

•Examples•F

acebook, Linkedin, Itunes

Public Cloud

(non IT)•E

xamples•Y

ahoo Mail, Google Apps

Public Cloud

(consumer)

•Example•P

ay per use, Gooroo

Public Cloud

(SME/Enterpice)

•Examples•T

rused SP/SI/Telco

Hybrid Clouds

•Examples•S

aaS, STaaS

Private Cloud

(external)

•Example•I

aas

Private Cloud

(internal)




Cost models and Pricing models



Business processCosting

FunctionPoints

Standard CostingUnit Costing

TraditionalLicensing

Funding Models

Traditional IT

Revenue Models

Per Transaction Charging

Per [Month] Subscription..

“Renting” Licenses

Number of Users / Service

Asset Ownership

Cloud Computing

OPEX = operating expense (Variable Costs to Buyer)

CAPEX = capital expenditure (Fixed Costs to Buyer)


Cloud architectural modelServiceCreation & Deployment

Service Request & Operations

Service Provider

ServiceDefinitionTools

ServicePublishingTools

ServiceFulfillment &ConfigurationTools

ServiceReporting &Analytics

ServicePlanning

Role-basedAccess

Operational Support Systems (OSS)

Business Support Systems (BSS)

Infrastructure Services

Software Platform Services

Application, Process and Information Services

End Users,Operators

ServiceCatalog

OperationalConsole

Standards Based Interfaces



Cloud Services

Cloud Platform

Service Integration

System Integration




How the Cloud is being adopted today

Business applications

Platforms

Business & Consumer Services

Integration

Business Tools

InfrastructureData

http://images.google.com/imgres?imgurl=http://blog.taragana.com/wp-content/uploads/2009/04/gmail.jpg&imgrefurl=http://blog.taragana.com/index.php/t/gmail/&usg=__KHQ_yKLFcr2Mued61u3AidIwEdI=&h=330&w=800&sz=82&hl=nl&start=1&um=1&itbs=1&tbnid=eUytLbPllKryLM:&tbnh=59&tbnw=143&prev=/images?q=gmail&imgsz=m&hl=nl&rlz=1I7GGLL_nl&sa=N&tbo=1&um=1

http://images.google.nl/imgres?imgurl=http://blog1.ebates.com/ebates/ebay.png&imgrefurl=http://blog1.ebates.com/ebates/2009/07/&usg=__7cvmf6JQ1sCx5P_9MNceF2M2lVQ=&h=333&w=800&sz=23&hl=nl&start=1&um=1&itbs=1&tbnid=5fKqyPgMVSXjEM:&tbnh=60&tbnw=143&prev=/images?q=ebay&um=1&hl=nl&sa=N&rlz=1I7GGLL_nl&tbs=isch:1

http://images.google.nl/imgres?imgurl=http://oem.readyphiladelphia.org/Customized/uploads/Uploaded%20Graphics/linkedin-logo.jpg&imgrefurl=http://oem.readyphiladelphia.org/Non-Profit&usg=__3RhoYvhwawqaS89TjypT8AxX41s=&h=249&w=580&sz=10&hl=nl&start=1&um=1&itbs=1&tbnid=4hR0Qrmw4MDOJM:&tbnh=58&tbnw=134&prev=/images?q=linkedin+logo&um=1&hl=nl&rlz=1I7GGLL_nl&tbs=isch:1

http://images.google.nl/imgres?imgurl=http://www.ashastd.org/images/facebook_logo.jpg&imgrefurl=http://www.ashastd.org/hpv/hpv_overview.cfm&usg=__dxi_3LSn7u9OhImhhhtFNyCAbks=&h=790&w=2100&sz=135&hl=nl&start=4&um=1&itbs=1&tbnid=WnsmOCuSOUlvmM:&tbnh=56&tbnw=150&prev=/images?q=facebook&um=1&hl=nl&rlz=1I7GGLL_nl&tbs=isch:1

http://www.zdnet.nl/zd_images/2009/22/bingLogo_lg.jpg

http://images.google.nl/imgres?imgurl=http://davesdesigns.co.za/socialbusiness/business/images/stories/logo_cloud9.gif&imgrefurl=http://davesdesigns.co.za/socialbusiness/business/index.php?option=com_content&view=article&id=4&Itemid=3&usg=__F1SEZH0L5MEQ3h1BDIOVrFITCw0=&h=480&w=640&sz=22&hl=nl&start=11&um=1&itbs=1&tbnid=xCGOwmXzDB0iDM:&tbnh=103&tbnw=137&prev=/images?q=cloud+9&um=1&hl=nl&sa=N&rlz=1I7GGLL_nl&tbs=isch:1

http://www.gyrodimensions.com/images/new_netsuite_logo.jpg

http://images.google.nl/imgres?imgurl=http://www.ssonetwork.com/uploadedImages/Online_Learning/Webinars/Oracle_logo_large.jpg&imgrefurl=http://www.ssonetwork.com/webinar_detail.aspx?id=4328&usg=__DgISoomYbep9A1-MzYmAXUqffvk=&h=194&w=397&sz=29&hl=nl&start=18&um=1&itbs=1&tbnid=Q_ger1rDGqccMM:&tbnh=61&tbnw=124&prev=/images?q=oracle+logo&um=1&hl=nl&sa=X&rlz=1I7GGLL_nl&tbs=isch:1

http://images.google.nl/imgres?imgurl=http://media.marketwire.com/attachments/200910/444357_538115_HostAnalyticsLogo.jpg&imgrefurl=http://www.marketwire.com/press-release/Aon-Consulting-Selects-Host-Analytics-Offer-Pensions-Benefits-Financial-Reporting-Budgeting-NYSE-AON-1118747.htm&usg=__fGtv_F9E-Wk_suvBPFGGDoOkobI=&h=79&w=280&sz=6&hl=nl&start=1&um=1&itbs=1&tbnid=JXcGoCu3ET4YXM:&tbnh=32&tbnw=114&prev=/images?q=host+analytics&um=1&hl=nl&rlz=1I7GGLL_nl&tbs=isch:1

http://images.google.nl/imgres?imgurl=http://www.enetrecruiter.com/userfiles/image/Taleo%20Logo.JPG&imgrefurl=http://www.enetrecruiter.com/tools.php&usg=__IiKEf5HpRitzFPy7UIoBK3WtYo0=&h=150&w=354&sz=29&hl=nl&start=10&um=1&itbs=1&tbnid=zqfXIoCf2JZAjM:&tbnh=51&tbnw=121&prev=/images?q=taleo&um=1&hl=nl&rlz=1I7GGLL_nl&tbs=isch:1

http://images.google.nl/imgres?imgurl=http://www.siia.net/codies/2009/finalists/logos/Boomi_blue_typeWEB.jpg&imgrefurl=http://www.siia.net/codies/2009/finalist_detail.asp?id=19&usg=__n2fw78qnYb82AJGW_-LPcYKGa2Q=&h=91&w=300&sz=7&hl=nl&start=1&um=1&itbs=1&tbnid=LnKbY-B-4wm3ZM:&tbnh=35&tbnw=116&prev=/images?q=boomi+logo&um=1&hl=nl&rlz=1I7GGLL_nl&tbs=isch:1

http://www.snaplogic.com/

http://images.google.nl/imgres?imgurl=http://www.ssonetwork.com/uploadedImages/Online_Learning/Webinars/Oracle_logo_large.jpg&imgrefurl=http://www.ssonetwork.com/webinar_detail.aspx?id=4328&usg=__DgISoomYbep9A1-MzYmAXUqffvk=&h=194&w=397&sz=29&hl=nl&start=18&um=1&itbs=1&tbnid=Q_ger1rDGqccMM:&tbnh=61&tbnw=124&prev=/images?q=oracle+logo&um=1&hl=nl&sa=X&rlz=1I7GGLL_nl&tbs=isch:1

http://go2.wordpress.com/?id=725X1342&site=mrwebservice.wordpress.com&url=http://www.strikeiron.com/&sref=http://www.google.nl/search?hl=nl&rlz=1I7GGLL_nl&q=Daas+cloud&meta=&aq=f&aqi=&aql=&oq=&gs_rfai=

http://go2.wordpress.com/?id=725X1342&site=mrwebservice.wordpress.com&url=http://www.jigsaw.com/&sref=http://www.google.nl/search?hl=nl&rlz=1I7GGLL_nl&q=Daas+cloud&meta=&aq=f&aqi=&aql=&oq=&gs_rfai=

http://go2.wordpress.com/?id=725X1342&site=mrwebservice.wordpress.com&url=http://www.postcodeanywhere.com/&sref=http://www.google.nl/search?hl=nl&rlz=1I7GGLL_nl&q=Daas+cloud&meta=&aq=f&aqi=&aql=&oq=&gs_rfai=

http://go2.wordpress.com/?id=725X1342&site=mrwebservice.wordpress.com&url=http://www.thewebservice.com/&sref=http://www.google.nl/search?hl=nl&rlz=1I7GGLL_nl&q=Daas+cloud&meta=&aq=f&aqi=&aql=&oq=&gs_rfai=

http://go2.wordpress.com/?id=725X1342&site=mrwebservice.wordpress.com&url=http://www.caspio.com/&sref=http://www.google.nl/search?hl=nl&rlz=1I7GGLL_nl&q=Daas+cloud&meta=&aq=f&aqi=&aql=&oq=&gs_rfai=

http://images.google.nl/imgres?imgurl=http://www.oecd.org/oecd/images/portal/cit_731/2/14/33727382SAS.jpg&imgrefurl=http://mybusinessblogging.com/ict-indonesia/page/2/&usg=__fEajLsPr0vMOxp5Z7Xw3yMeVxXE=&h=278&w=696&sz=29&hl=nl&start=6&um=1&itbs=1&tbnid=a_Bmo7WjqEIRsM:&tbnh=56&tbnw=139&prev=/images?q=Sas+logo&um=1&hl=nl&rlz=1I7GGLL_nl&tbs=isch:1

http://images.google.nl/imgres?imgurl=http://www.ebizq.net/z_images/logos/vitria_logo.gif&imgrefurl=http://www.ebizq.net/webinars/7876.html&usg=__-WAv9ayc7Spok5otsRSS6g6MfnQ=&h=58&w=128&sz=3&hl=nl&start=3&um=1&itbs=1&tbnid=4YQKOnA3rr80NM:&tbnh=41&tbnw=91&prev=/images?q=vitria+logo&um=1&hl=nl&rlz=1I7GGLL_nl&tbs=isch:1

http://images.google.nl/imgres?imgurl=http://cache0.techcrunch.com/wp-content/aster-logo.png&imgrefurl=http://www.techcrunch.com/2008/05/19/google-backers-back-aster-data-systems-its-all-about-the-clusters/?replytocom=2313126&usg=__VPgJJl4GbfAHglUk4pQleTFWpPQ=&h=121&w=170&sz=4&hl=nl&start=1&um=1&itbs=1&tbnid=SL1dICBex6rzaM:&tbnh=70&tbnw=99&prev=/images?q=aster+data+logo&um=1&hl=nl&sa=X&rlz=1I7GGLL_nl&tbs=isch:1


Testing-as-a-service, Cloud testing or is there more?

Cloud computing and testing


Trends in testing

The current keywords in the business are:• Business is demanding earlier Time to Market (TTM).• Traceability of the quality through the full process of software

development.• Lower cost of their IT and Flexibility within workforce• Increased complexity of the ICT ecosystem• Maximize consumer value




So how will Cloud Computing change testing?

1. Virtualization development and test environment

2. Platform-as-Service for development

3. New Cloud Testing service offerings• Testing Service Aggregator

4. Impact of Cloud Computing on the Quality requirements

5. Other new testing opportunities on technical or business areas.




New way’s of testing

© 2010 Capgemini. All rights reserved.

•Examples•S

OASTA, LoadStorm, Browsermob

Cloud Testing

•Example•U

ser testing.com

Crowd testing

•Examples•I

BM Rational, HP, Capgemini, Sogeti

Testing as service

(TaaS)

•Human resources based on SLA

•Sogeti, HP, IBM

Testing as service

(Fully on-demand sourcing)

•The future of testing; On-demand workforce & IT sources

•Examples•U

test

Testing as service

(based on Crowd sourcing)

17



Cloud testing

Cloud testing is a form of software testing in which Web applications that leverage Cloud computing environments (“Cloud”) seek to simulate real-world user traffic as a means of load testing and stress testing web sites.




Cloud testing providers

Companies are like SOASTA, LoadStorm, Browsermob are building their business on the philosophy “Let's run it again“

Main business area:• Performance testing• Stress/Endurance testing• Functional testing• Regression testing




Crowd sourcing / testing

Building a community that can be utilized to executed testing on a large scale with an actual income generation.




Two examples

Flash Mob testing is delivering testers from the Software Testing Club community. Customer needs to deliver a test environment for the test community to test.



User testing is specially focused on Usability testing. It gives you access to a large panel of users, on-demand.• The users are not usability experts

however real consumers.


Testing-as-a-service (TaaS)

Testing-as-a-service is the ability to test local or in Cloud-delivered system using testing software and services that are remotely hosted.

Within this you can see two key aspects:



End User

Developer


Testing as a Service offerings include, but are not restricted to:• Providing the entire range of automated testing services, both on-site

and offshore. • Delivering customer-focused test labs for automated testing • Building processes, procedures and methodology for, automated, testing • Providing expertise/hosting in key areas such as Testing Tools, Test

Methodology, Security Testing and Availability Testing.

Other possibilities are: • Hosting of specialized test infrastructure • Hosting of test tooling• Outsourcing of the test infrastructure to a third party hosting provider.



Testing Service to offer


TaaS (fixed cost)

Testing as service started with only delivering the resources to the customer that where related to fixed cost.• Hardware & software resources• Tool licenses etc.

This approach lowered the direct cost by reducing Capex.




Fully on-demand sourcing

The TaaS stream that is coming up which helps organizations to reduce Capex as well as Opex.

It’s based on helping the organization to:• Reduce capital and licensing expenses• Decrease operating and labor costs• Efficiently leverage your IT infrastructure• Shorten test provisioning cycle times.




HP Testing-as-a-Service

HP delivers application testing services in a highly available, consumable, pay-as-you-go model that provides flexibility in service and pricing.




Capgemini and HP




Testing-as-a-Service visualized

Cloud Platform (hybrid, Public)

Cloud Services

TaaS supplier

Test demand

Test Results

Cloud Test execution service

Cloud Test tooling service

Cloud Platform(privat)

Customer



The Cloud


Testing as service (Crowd sourcing)

A combination of TaaS and crowd testing. TaaS supplier delivers environment, tools etc.

Human resources will be requested from their community and will be paid based on the number of defects that they find.

Popular concept amongst gurus and those who’d like to think they can predict the future of online business models (example James Whittaker)




Two examples

uTest business model is pretty simple: clients post software to be tested and the community of testers at uTest will test the website.



Amazon Mechanical Turk is a marketplace for work that requires human intelligence. The Mechanical Turk web service enables companies to programmatically access this marketplace and a diverse, on-demand workforce.


Testing Service Aggregator

Supplier who combines a number of Cloud (and potentially non-Cloud) services to form a complete solution on behalf of a customer or customers.



Environment provider

Test management provider

Resource provider

Test level provider

Customer

Service integrator



Service Categories



Run Test Run

Advisory

Test Service integration

Capgemini

Services

Solution

Test Service enabling


CustomerSocial Network

New Media

SaaS

Cloud Computing

Mail

PaaS

Test environment

Analytics & Reporting

Email, PC, Phone

Track and record defects

System integration test

Acceptance testRegression test

Legacy app.

Websites

usability testingLoad, performance test

Disaster recovery testing


http://www.usertesting.com/Index.aspx


Testing-as-Service

TaaS(Fully on-demand sourcing)

TaaS (Crowd sourcing)

Cloud Testing Crowd sourcing (testing)

Cloud suppliers (testing)




Developing and testing in the Cloud will also makes it easier to maintain environment? So it will be cheaper to support Run & Maintain.

Rightshore? Let do it directly in the Clouds!

MMM.. Cloud application, let’s do a security test on your application and environment!

Data recovery? Please can you tell me more!

What is the performance is of the website from New York or Moscow? Let’s test it!

Where is my data? Uuh.. in the Clouds?

Waterfall… I want Cloudy!

Of the shelf application don’t need testing… isn’t or shall we include integration test

You are using Api’s of different companies within your application? Who are we going to test them?

Windows Azure; Developers will do the testing!

How to test a SaaS application

Testing tools into the Cloud

New quality requirements or only update


Remco Oostelaar

Test manager

Managing consultant: B63 TestForce Mobile: + 316 45690511

Papendorpseweg 100, 3528 BJ Utrecht, Netherlands

cop test going the cloud versie 0.5

Documents

cloud computing source

computing capacity

computing power

style of computing

technologies cloud

cloud model

cloud computingtogether

remco oostelaar version