tm report: testing platforms · arraytm report: testing platforms ... breakthroughs and...

Market Mover arraytM report:

Testing PlatformsBy theresa Lanowitz, Lisa Dronzek | June 5, 2012

© 2012 voke media, llc. All rights reserved. voke and vokeStream are trademarks of voke media, llc. and are registered in the U.S. All other trademarks are the property of their respective companies. Reproduction or distribution of this document except as expressly provided in writing by voke is strictly prohibited. Opinions reflect judgment at the time and are subject to change without notice. voke disclaims all warranties as to the accuracy, completeness or adequacy of information and shall have no liability for errors, omissions or inadequacies in the information contained or for interpretations thereof. Contact www.vokeinc.com for additional information.

voke research��

SUMMary ~The testing of software at every stage of the lifecycle and across all aspects of the supply chain is a standard and required practice. As software and platforms continue to increase in complexity and demand, testing is paramount.

Businesses must understand the risk posed by quality issues in the software in use. It is critical to deliver software that will not compromise business, safety, or security.

This Market Mover ArrayTM Report examines the current state of the software testing market and provides analysis of the vendors vying to move the testing market beyond the status quo through innovation, technology, and the conversation in the market.

taBLe of ContentS ~Market Mover array overview 2

Testing Market Overview • 2

State of the Testing Market • 4

Market Mover Array – Looking Forward 1 • 0

Market Mover Array Methodology 1 • 1

Market Mover Array: Testing Platforms 1 • 2

Market Mover array vendors 13

Coverity 1 • 5

Electric Cloud 1 • 9

Experitest 2 • 2

HP 2 • 4

IBM 2 • 9

Keynote DeviceAnywhere 3 • 2

Micro Focus 3 • 5

Microsoft 3 • 7

Parasoft 4 • 2

Perfecto Mobile 4 • 6

QMetry 4 • 9

QualiSystems 5 • 2

Replay Solutions 5 • 5

SmartBear 5 • 8

SOASTA 6 • 1

Spirent 6 • 5

TRICENTIS 6 • 8

Wind River 7 • 1

ZAP technologies.com 7 • 5

Market Mover arraytM report:

Testing PlatformsBy theresa Lanowitz, Lisa Dronzek | June 5, 2012

Market Mover array™ Report: Testing Platforms

June 5, 2012

© 2012 voke media, llc. All rights reserved. Reproduction and distribution prohibited.

2

Market Mover array overview Zero tolerance for errors. This is how software is viewed in the modern world where software is an on-demand commodity. With software always-on and expected to work as intended, a software failure may bring about catastrophic crises for its owner. The commoditization of software, along with the fact that it runs the business and is the differentiator, seems to be a paradox. Software is no paradox; its value is now inextricably linked to the brand of an organization. A software failure is a brand failure.

In the post-global financial crisis (GFC) environment, high profile software failures are occurring at an alarming rate. Executives from organizations of all sizes must publicly answer to the reasons for software failures. Testing is an integral part of the entire lifecycle and has moved from obscurity to prominence. Proper quality of software means production, or production-ready, software, but it also means known and assessed business risk.

The inextricable link of software and the brand has now made business leaders aware of the need for quality software with minimal business risk. The business of software must move from a singular focus on schedule to managing cost, quality, and schedule as it relates to business risk. Faster is not always better; organizations need to understand the risks associated with schedule demands.

Software and platforms continue to increase in complexity and demand. Businesses must understand the risk of the software in use. This means that the critical task of delivering software that will not compromise business, safety, or security is paramount and ongoing. The testing of software at every stage of the lifecycle across all aspects of the supply chain is a standard and required practice.

This Market Mover ArrayTM Report examines the current state of the software testing market and provides analysis of the vendors vying to move the market beyond the status quo through innovation, technology, and the conversation in the market.

teSting MaRket oveRview ~Since our last published report on the testing market in 2010 (see voke Market Mover ArrayTM Report: Testing Platforms – August 11, 2010) there has been a renaissance in the testing market by both the software vendors and the testing professionals themselves.

Testing professionals are far more visible, vocal, and confident than at any other time in the history of the market. This newfound confidence is based on the value delivered through their dedication to software excellence.

Testing professionals in proactive organizations have transformed themselves from being viewed as just necessary to release to roles of customer advocates and change agents.

Market Mover array™ Report: Testing Platforms 3

June 5, 2012


In the role of customer advocate, they help to identify the risks associated with each and every software release. These strategic efforts help to deliver higher quality software throughout the enterprise, manage relationships, and place laser focus on assessing the risk associated with every piece of software.

This rise of the testing professional is aided in part by the innovation in the market through the solutions and tools that vendors are delivering. One can almost make the classic “chicken and egg” argument about which came first—more vocal testing professionals or more sophisticated tools and solutions. Regardless of the answer, the innovation of tools and solutions over the past two years in the market is just as apparent as the more confident and strategic test professional.

Innovation in the testing market is being driven by eight key factors:

HP testing assets are an overwhelming market force. By HP testing assets we refer 1. to the breadth of testing artifacts (test cases, scripts, automation, et cetera) across all types of organizations using HP testing solutions. These assets protect HP’s market share and provide opportunity for vendors that create solutions leveraging these assets.

Lifecycle virtualization, the category that encompasses the benefits of virtualization 2. applied to the application lifecycle, is the engine that is delivering unprecedented breakthroughs and transforming modern testing tools to new levels of productivity. (See voke Category SnapshotTM Report: Lifecycle Virtualization – November 7, 2011.)

Development testing is used to prevent defects from leaving the development phase. 3. Preventing defects from leaving development makes software more predictable, traceable, visible, and transparent throughout the lifecycle. If software is more predictable, traceable, visible, and transparent, there is also better collaboration across the lifecycle as well.

Infrastructure test optimization (ITO), defined as the need to ensure that infrastructure 4. is not a bottleneck and that anything added to the infrastructure does not negatively affect the network or other connected elements, is driving the need for end-to-end quality. (See voke Category SnapshotTM Report: Infrastructure Test Optimization – January 12, 2012.)

Mobility and the need to ensure and deliver a quality experience in the world of on-5. demand software is critical for all organizations.

The cloud—its economics and scalability—is a powerful delivery platform, yet it must 6. meet the challenges of performance and security requirements.

Integration of testing products enables access to new, innovative solutions and 7. openness, enabling collaboration across organizations and supply chains.


June 5, 2012


4

Embedded software and the ongoing drive to convergence is a reality that 8. organizations need to understand and embrace. In this report we refer to convergence as a long-term trend in which embedded and infrastructure groups migrate to commercial tools with the ability to share best practices and specialized testing resources across the organization.

With innovation in the testing market being driven by these key factors, the market is undergoing a dramatic change. It is no longer sufficient to test just for functionality and performance. Today’s testing professional must work collaboratively across functional groups, with others in the supply chain, and throughout the lifecycle to ultimately be able to identify the risk to the business associated with software quality issues.

Vendors of all sizes are having an impact on technology and innovation while shaping the discussion about what software testing means. As we identified in our 2010 report, the testing market is no longer solely defined by the need to test business applications. This statement carries even more heft in 2012. In 2012, we see vendors tackling testing problems on new platforms, innovating to focus on the total value of software, placing value on testing in every phase of the lifecycle, and working together to solve big, ongoing, classic computing problems.

The testing market of the future will not have one dominant vendor; rather the market will be defined by software from testing vendors that is open and integrated with a wide variety of tooling options. This new view is being driven by on-demand software. Organizations can no longer dictate where, when, or how software is used. Workers are mobile, customers are global, and every individual has a preference as to how they want to consume software. Testers must be able to plan for and execute as many combinations and permutations of software and hardware as possible to predict the outcome of software usage.

Test professionals will drive software vendors to innovate. Software vendors that ignore the needs of customers will quickly face obsolescence. Test professionals are leading the way to the future and will demand that tools keep pace with their business needs.

State of the teSting MaRket ~The software testing market is currently in a renaissance, both in terms of freshly energized testing professionals and innovation from vendors. At this time in the market, we see the challenge to the market leaders coming from:

Innovative vendors tackling emerging technology such as cloud, mobile, device �software, and infrastructure.

Innovations delivering simple solutions to classic and age-old problems leveraging the �power of virtualization.

Vendors that are solving the problems inherent in entrenched testing tools. �


June 5, 2012


The following sections describe the state of the testing market in mid-2012.

hp testing assets

The majority of the global testing intellectual property to date is housed in the HP testing platform. All vendors must deal with this significant and undeniable presence in the market— the assets or artifacts housed in HP solutions. Every vendor, including HP, must figure out ways to use, manage, or import those assets. These HP testing assets are a force that will be with the market for years.

HP is the undisputed market share leader of traditional testing tools focused on testing business applications. However, HP faces significant competition from smaller vendors with competitively priced solutions and a focus on customer satisfaction. These smaller vendors are not likely to penetrate HP’s dominance at the enterprise level; however, project level adoption will begin to slowly erode HP’s market share.

HP faces challenges from Microsoft with its modern, innovative testing solution that enables manual testers to be highly productive while using virtualization technology. Microsoft offers an attractive enterprise alternative to the HP install base, especially those in .NET environments.

Providing a new solution to an established tool is a sign of the times. There is a new breed of vendor in the market with innovative approaches to dealing with the HP assets.

TRICENTIS, with its TOSCA Testsuite, offers new solutions to solve the test �automation problem by eliminating script and maintenance issues and enables test coverage of each single test case to be measurable, making software test automation more affordable and manageable.

SmartBear focuses on ease of use and affordability to deliver test automation �alternatives to HP QTP and integration of test assets with HP QC for developers and testers on a variety of platforms.

Lifecycle virtualization

The use of lifecycle virtualization helps manage the classic cost, quality, schedule triangle and enables a faster time to market with fewer defects. The return on investment (ROI) of these solutions is quick and easily measured.

Microsoft makes use of virtualization technology throughout its Visual Studio line. �Microsoft was the first testing vendor to integrate virtual lab management (VLM)1 into its product offering.

1 Virtual Lab Management enables anyone to access a virtual equivalent of any environment on demand at any time without the need to wait for a physical machine setup or additional hardware.


June 5, 2012


6

Replay Solutions (Replay) uses defect virtualization � 2 to enable users to identify elusive defects.

Parasoft is delivering innovation by including service virtualization � 3 in its portfolio of products for the testing market with its Parasoft Virtualize.

HP introduced HP Service Virtualization as an integrated part of its HP ALM and testing �product line.

IBM acquired Green Hat in early 2012 and now includes service virtualization as part of �its testing offerings.

SmartBear provides service virtualization as part of its soapUI product. �

QualiSystems and Spirent offer VLM solutions to deliver test labs throughout the �supply chain of infrastructure testing.

Micro Focus with its Borland solutions offers integration to VLM solutions with Silk �Central.

Device virtualization � 4 is part of solutions from Electric Cloud, Experitest, Keynote DeviceAnywhere, Perfecto Mobile, SOASTA, and Wind River.

Electric Cloud utilizes lifecycle virtualization for managing virtualized cloud platforms � 5.

Development testing

Development testing is placing a focus on testing and quality from the beginning of the lifecycle and augmenting traditional QA testing.

Coverity brings clarity and focus to the development testing category. By delivering �solutions for the development phase of the lifecycle, Coverity is championing the notion of quality earlier in the lifecycle and throughout complex supply chains.

Parasoft offers solutions in development testing as part of an integrated end-to-end �testing offering and its historic focus on Automated Defect Prevention to identify and remove defects as early in the lifecycle as possible.

Microsoft provides a developer unit testing framework with advanced capabilities. �

SmartBear provides peer code review with an audit trail for compliance. �

2 Defect virtualization gives development and test teams the ability to capture the environment in which a defect occurs and easily replay and recreate the scenario to resolve the issue.3 Service virtualization enables development and test teams access to unavailable or limited services in a virtualized environment.4 Device virtualization enables development and test organizations the ability to take advantage of virtualization and simulation to allow physical devices and boards to be virtually deployed for testing.5 Virtualized cloud platforms are a logical extension of virtual lab management and enable rapid and inexpensive creation of production-like cloud environments for development and testing purposes.


June 5, 2012


infrastructure test optimization (ito)

Infrastructure testing must be embraced and understood. Infrastructure test optimization (ITO) is assurance that the infrastructure on which software must run on is not a bottleneck and that anything added to the infrastructure does not have a negative impact on the network or other connected elements. Applications cannot be tested in isolation, and the same holds true for the network and infrastructure on which the applications are meant to be deployed and run. Organizations must take a holistic end-to-end approach to testing all parts of the application, infrastructure, and the supply chain.

Spirent offers an entire solution for end-to-end testing based on ITO that includes �development testing, test automation, manual testing, realism in test labs, and a professional services offering.

QualiSystems offers end-to-end lab management and test automation solutions for �infrastructure testing.

Mobility

Mobility is a necessity, not a luxury. The explosion of mobile testing companies with a focus on the enterprise instead of consumer apps is a clear indicator of the enterprise need to deliver quality software to a plethora of mobile devices. Enterprises must keep up with customer adoption of new and leading-edge devices; therefore, it is mandatory that traditional testing vendors partner with one or more of the mobile testing vendors.

The mobile testing vendors are at a critical point; acquisition by the traditional testing vendors will ultimately occur, but for now innovation must be allowed to flourish. Keynote’s acquisition of DeviceAnywhere is a signal in the testing market that a shift of vendors is occurring. The testing market is not just business as usual, and Keynote DeviceAnywhere is proving this with its intense focus on the mobile market.

We see innovation in mobile testing occurring from Experitest, Keynote DeviceAnywhere, Parasoft, Perfecto Mobile, SOASTA, Replay, and ZAP technologies.com (ZAP).

Cloud

Testing solutions are taking advantage of the economics of the cloud to deliver differentiated solutions.

QMetry offers integration with traditional testing frameworks and leverages the �economics of the cloud to make software testing, particularly test management, affordable and easy to use.

SOASTA has fully embraced the cloud as its delivery platform and differentiator in the �market.


June 5, 2012


8

HP offers its market-leading load testing solution, LoadRunner, in the cloud and uses �this offering to negate issues of cost associated with owning a traditional on-premise solution.

Perfecto Mobile provides virtualization of handsets over a cloud infrastructure to enable �distributed teams to test on platforms around the globe.

Keynote DeviceAnywhere offers a cloud-based Software as a Service (SaaS) solution �for mobile app testing.

Micro Focus offers SilkPerformer CloudBurst, enabling performance teams to take �advantage of the power of the cloud.

SmartBear provides cloud-generated load testing for Web applications and APIs. �

Spirent offers a cloud computing testing methodology to test the performance, �availability, security, and scalability of the cloud infrastructure where business-critical applications reside.

integration

The integration of products in the testing market and across the lifecycle is a significant factor shaping the current and future testing market. The testing market of the future will not be dominated by a single vendor; rather the market will have many providers that are integrated with a variety of tools and offerings. Going forward, integration will be one of the defining and qualifying characteristics of a solution.

HP, because of its install base, is integrated with virtually all complementary software. �This integration with the current market leader is essential for new vendors to gain any traction in the market.

Electric Cloud offers integrations with traditional testing tools, defect tracking systems, �development testing solutions, cloud, and virtualization technologies. Electric Cloud offers more than 100 unique integrations of its tools with complementary solutions, making it an attractive vendor to include in an overall quality workbench.

Coverity has made integrations a key element of its market strategy. With integrations �with HP and Wind River, Coverity is focused on delivering its development testing solutions to both the enterprise and embedded markets.

Parasoft offers a comprehensive and thorough list of integrations with both traditional �enterprise and embedded solutions such as integrated development environments (IDEs), IDEs with project import support, host compilers, target compilers, build management systems, and software configuration management (SCM) solutions.

QMetry offers integrations with a variety of products in the ALM market. These �integrations facilitate the testing process and provide insight into metrics such as the percentage of requirements covered by test cases at any point during the cycle.


June 5, 2012


Mobile vendors Experitest, Keynote DeviceAnywhere, Perfecto Mobile, and ZAP offer �integration with a wide variety of frameworks for traditional testing products. The high quantity of integrations offers choice in the increasingly competitive mobile testing area.

SmartBear integrates across a wide variety of application lifecycle management (ALM), �software configuration management (SCM), soapUI, and defect tracking solutions to make its affordable solution adoptable and known.

SOASTA integrates with development platforms on the ALM side to deliver testing �earlier in the development cycle, as well as with leading application performance management (APM) solutions to collect deep performance metrics to include in performance testing at deployment and production.

Spirent continues to increase the number of vendors it interoperates with by creating �integrations based on industry standards and specifications. This is an area where integration is crucial because no single vendor will offer all of the solutions necessary for network and infrastructure testing.

Qualisystems integrates with test equipment vendors such as Ixia, Spirent, Shenick, �BreakingPoint, ONPATH, MRV, and APCON.

Wind River continues to integrate in both the embedded and enterprise market. �Integrations with HP and IBM are more evidence that convergence is upon the market.

embedded

Embedded software testing is critical and convergence is real.

Wind River delivers solutions to the embedded testing market and solves the problem �of time by giving testing teams a tool to thoroughly test the increased volume of complex software in embedded devices. Wind River integrates with enterprise testing vendors HP and IBM to facilitate convergence between the enterprise and the embedded software teams. Additionally, Wind River has expanded its portfolio to address the growing popularity of Android devices. The company introduced automated testing software that helps improve software quality and stability to verify compliance for any Android-based device.

Parasoft provides quality solutions to embedded teams that require the utmost from �their testing efforts. Parasoft products for the embedded market integrate with a comprehensive set of vendors to deliver quality where quality matters.

Market Summary

The testing market will continue to innovate and use new delivery models such as the cloud and SaaS to encourage adoption of new technologies. We expect to see a wave of acquisition and consolidation in the next 18 months. Once the market consolidates, traditional vendors must foster innovation in the acquisitions and allow it to continue.


June 5, 2012


10

Just as important as technology is the market conversation. The conversation must be vigorous, robust, and without fail understand the importance testing plays not only in the quality of software but in the brand promise attached to every business. The market is in need of a vendor with clear thought leadership willing to define the next chapter of software testing. Without that voice and thought leadership, the testing market will succumb to exclusionary movements and lose its way.

Testing is critical to each and every phase of the software lifecycle and cannot be excluded, ignored, or relegated to a second tier status. Testing and its overall role in quality is essential to business. While technology is important to testers, the fundamental conversation in the market must shift to how testing delivers real business value. Ultimately, software must achieve business objectives and goals while delivering the brand promise.

MaRket MoveR aRRay – Looking foRwaRD ~The voke Market Mover Array series is a new and unique way of examining and evaluating vendors in a market. Analysis that is based primarily on market share is indicative of what has already happened in a market and well known by market participants. voke believes that analysis of where the market is headed, or needs to be headed, provokes the insight for the future. Making predictions and providing analysis of where the market will go provides a valuable new perspective. Innovation is required to deliver what is necessary for the future, and adept marketing is essential to change the point of view. While market share is important, it is not the defining component in voke’s analysis. Instead, this report focuses on the current and future state of the market, and analyzes vendors based on innovation and technology, as well as marketing ability. These factors are critical to moving markets beyond the status quo.

Innovation can occur inside any organization, large or small. When a market has reached a point of needing new technology to deliver solutions to new problems, innovation will be sparked. In this report, we look at vendors in the testing market that are delivering innovative technology. And, because innovation can occur in any size organization, some of the vendors we discuss do not have significant market share, but, do have significant innovation. The market needs such innovation to move forward.

As history has repeatedly shown, innovation and technology must always be accompanied by marketing. In this report, we examine how testing vendors are shaping the conversation in the market through marketing efforts. The critical nature of software and the impact it has on the success of business is advancing the testing initiative from the practitioner to the executive. Marketing is a critical element of how the vendor and its products are perceived and ultimately purchased and used. Testing is a critical element to quality and cannot be overlooked or abandoned by vendors leading the market conversation.


June 5, 2012


MaRket MoveR aRRay MethoDoLogy ~The voke Market Mover Array is research designed to identify notable vendors in a particular market and is a core piece of voke’s research taxonomy. voke brings independence and uniqueness to viewing markets in a dynamic and forward-moving state.

The voke Market Mover Array is plotted against two axes: “Innovation and Technology” and “Marketing Ability.” Each of these axes contains seven components against which the represented vendors were rated.

The Innovation and Technology components are:

Product �

Technology �

Ease of use �

Product works as advertised �

New technology solving a classic problem �

Easy solution to complex problems �

Integration �

The Marketing Ability components are:

Product offerings �

Pricing �

Positioning �

Promotion �

Thought leadership �

Execution �

Executive leadership �

The result of each vendor rating was charted and placed into one of four bands on voke’s Market Mover Array: Testing Platforms (Figure 1).

The four bands of the Market Mover Array are:

transformational — vendors that are changing the tone and direction of the market. These vendors may include newer entrants to the market that have either innovative technology or the ability to take a long view of the market and articulate it. These vendors are typically challenging the pivotal vendors to innovate either in terms of technology or marketing acumen.


June 5, 2012


12

pivotal — vendors that have the potential to disrupt the market. Vendors with significant market share are under immense pressure to maintain status in the market through innovation or thought leadership. New and emerging vendors with compelling technology are vying for broader market awareness and solidifying their marketing voice.

influential — innovative vendors forging a new path in the market. Influential vendors may include vendors of importance that are making an impact on the market and are viewed as compelling alternatives, or that fill specialized needs in the market.

Rival — vendors with potential to challenge the market leaders. Rivals may include emerging vendors delivering innovation, or established vendors at a crossroads and in the process of reinventing their products or positioning.

MaRket MoveR aRRay: teSting pLatfoRMS ~The Market Mover Array: Testing Platforms chart below identifies vendors with solutions in one or more categories of the rapidly expanding testing market.

figure 1: voke 2012 Market Mover arraytM Chart: testing platforms


June 5, 2012


Market Mover array vendorsThink about the needs of your organization. What type of application, service, device, or hardware do you need to test? How do you want to test it? Where in the lifecycle do you want to test? How frequently do you want to test? What are your organizational constraints? Where is the software being used? How is the software being used? Who is using the software? How is software controlling the hardware? How critical is the software? What are the implications and cost of a software failure? How do you know where to start with quality? Is the software used in a regulated industry? Does the software have compliance guidelines? What software problems are you experiencing?

All of these questions and answers are unique to each and every organization. The testing market is ripe with areas of innovation that are necessary for the new types of applications, software, products, devices, and services that must be tested today.

Use this report to understand the solutions available in the market and determine if you need to expand or update your existing toolset to achieve your quality objectives.

The Market Mover Array: Testing Platforms includes analysis of the following 19 vendors:

HP and IBM — market share and revenue leaders with comprehensive solutions and �professional services organizations

Microsoft — delivering a modern testing solution to enhance the productivity of manual �testers and forge productivity across the lifecycle

Coverity — placing an emphasis on quality and testing earlier in the lifecycle while �empowering and holding developers accountable for quality of source code and security vulnerabilities during the development process

Electric Cloud and Replay — delivering complementary solutions that help manage the �cost, quality, schedule triangle through the use of lifecycle virtualization

Parasoft — focusing on quality throughout the lifecycle through defect prevention and �meeting time-to-market pressures through lifecycle virtualization

QMetry — delivering value through the economics of the cloud and innovating on new �delivery models

Experitest, Keynote DeviceAnywhere, Perfecto Mobile, and ZAP — delivering solutions �for mobile testing

SOASTA – leveraging cloud computing to deliver scalability for the consumerization of �Web and mobile platforms

Micro Focus — challenging the traditional testing vendors with scalable solutions �

QualiSystems and Spirent — delivering end-to-end testing solutions for infrastructure �testing


June 5, 2012


14

SmartBear and TRICENTIS — delivering new solutions for affordable and manageable �automation

Wind River — delivering commercial testing solutions for the embedded device �software market

An in-depth analysis of each of the 2012 Market Mover vendors follows this Overview.


June 5, 2012


eLeCtRiC CLoUD ~Market Mover Rating: pivotal

Consider this vendor if your organization is:

Managing the proverbial cost, quality, schedule triangle �

Seeking greater levels of test automation �

In need of integrated builds and build verification testing �

Seeking a commercial solution to the build-test-deploy aspect of software delivery �

In need of continuous integration and deployment solutions to speed time to market �and reduce risk in deployed software

overview

Electric Cloud helps organizations deliver quality software earlier in the lifecycle to reduce risks to schedule and budget. Through the use of commercial continuous integration and deployment solutions such as Electric Cloud’s, the build-test-deploy process of software engineering is automated and integrated incrementally. The ongoing integration removes the risk of critical defects identified late in the lifecycle due to integration issues prior to deployment.

Each and every company, regardless of vertical market, is a software company. Independent software vendors (ISVs) follow processes and effectively use commercial tools throughout the lifecycle to deliver quality products. With software as a driving force of every business, software engineering best practices such as continuous integration must be adopted by organizations of all types. Embracing the practices of ISVs will remove manual, error prone tasks prior to deployment and deliver greater customer satisfaction.

Solutions

Electric Cloud’s philosophy of software testing is that development and QA teams must automate as much as possible to eliminate manual and error-prone activities. In an era of complex systems across an expanding array of platforms, Electric Cloud delivers quality feedback earlier in the lifecycle through parallel testing and continuous integration. This view suggests that continuous integration of software is something that every organization needs to embrace to meet time to market and quality expectations.

The Electric Cloud product lineup is simple and uncluttered, yet powerful.


June 5, 2012


20

The Electric Cloud testing platform consists of:

ElectricCommander — automates and accelerates the application development and �delivery process by automating the build-test-deploy tasks

ElectricAccelerator — accelerates build speed by executing parallel builds across a �cluster of servers

Every software engineering team is different and chooses different tooling for its software lifecycle. Continuous integration solutions must be able to effectively build, test, and deploy software created with a variety of tooling options. This is where Electric Cloud excels in the market. Electric Cloud offers more than 100 unique integrations of its tools to complementary solutions in the following areas:

Traditional functional testing tools �

Code analysis �

Defect tracking �

Lifecycle virtualization �

Electric Cloud’s solutions are part of the lifecycle virtualization category and offer a solution for virtualized cloud platforms. Electric Cloud offers a way to manage and control virtualized cloud platforms to prevent sprawl and provide summaries on a dashboard. These attributes contribute complementary functionality to a virtualized cloud platform and further enhance Electric Cloud’s value proposition.

The ubiquity of Electric Cloud’s integration and support with complementary lifecycle tools make its solutions an attractive alternative to in-house or open source solutions. Electric Cloud accelerates testing cycles by enabling parallel test execution simultaneously across multiple platforms. By automating and accelerating the build-test-deploy process, Electric Cloud enables organizations to deliver higher quality software with a more predictable time to market.

analysis

Electric Cloud provides a solution that each and every software engineering team can benefit from. To be successful, enterprise software organizations must adopt the best practices of commercial ISVs. Continuous integration and the automation of the build-test-deploy process is something commercial software companies regularly embrace.

Removing broken builds throughout the software lifecycle is crucial to achieving the cost, quality, schedule triangle.

Adopting continuous integration and parallel testing solutions saves the enterprise precious resources and eliminates friction between the development and QA teams by providing


June 5, 2012


feedback earlier in the lifecycle. Without proof of test readiness, the testing cycle is either incomplete or slowed. A commercially viable solution such as Electric Cloud is easy to insert in the software engineering workflow and delivers fast and visible ROI.

Electric Cloud’s singular focus on the build-test-deploy process provides a critical element in the software lifecycle. The Electric Cloud solution provides value to every major stakeholder in the application lifecycle, especially the line of business. The line of business can have far greater trust and reduced risk in its software if the software engineering process includes a continuous integration solution.

Electric Cloud must continue with its competitive advantage of integrating with a wide variety of lifecycle solutions. Since Electric Cloud’s primary competition comes from in-house solutions, it is incumbent upon Electric Cloud to continue with market education, especially to the enterprise where continuous integration is still a significant challenge.

Software is inextricably linked to the brand of an organization. IT organizations must meet the demands of the line of business and deliver valuable software with known and assessed risk. Electric Cloud is a vendor with a proven track record of eliminating issues known to delay time to market and affect quality and budget. Electric Cloud’s solutions fit easily into the software engineering process of any organization. Electric Cloud’s crowning jewel of integration will continue to be its clear market advantage. Organizations of all types will benefit from powerful continuous integration solutions to make releasing software more predictable and less stressful.

Contact Information

® Moving markets beyond the status quo!

Corporate headquartersvoke, inc. 2248 Meridian Boulevard Suite HMinden, NV 89423 USA

Phone: +1-866-895-9045 Web: www.vokeinc.com Blog: www.voke.blogspot.com

aBoUt voke ~voke, founded in 2006, is a modern independent technology analyst firm focused on the edge of innovation. voke’s primary coverage area is the application lifecycle and its global transformation, including virtualization, cloud computing, embedded systems, mobile and device software.

voke provides data and analysis for the economy of innovation. Companies of all sizes, financial firms, and venture capital organizations turn to voke to harness strategic advice, independent and impartial market observations and analysis to move markets beyond the status quo. Please visit www.vokeinc.com to become a research client.

tm report: testing platforms · arraytm report: testing platforms ... breakthroughs and...

Documents