PowerPoint Presentation
PROJECT PRESENTATION
Prof: Daniel Amyot
Presented ByANVESH ALUWALAGURPREET SINGH DHADDA
Evaluation of Load Testing ToolsWebLOAD Professional Vs NeoLoad 3.1AgendaBusiness contextOur Goal in the projectLoad TestingMethodologyList of CriteriaDescription to WebLOAD Professional & NeoLoad 3.1Final Recommendation
Our Business ContextCompany: weexcel Inc.Developers: 25QA Testers: 4
The company planned to launch an web application and they want to Load Test the application before deploymentThe company needs a recommendation of the tool that meets the maximum goals set by the companyOur one and only GoalRecommend the tool that best serves the organizations purpose to test their web applications before deployment
Intro to Load TestingAlthough both Load Testing and Performance Testing seem similar, their goals are different.Load testing operates at a predefined load level, usually the highest load that the system can accept while still functioning properly.On the other hand, performance testing uses load testing techniques and tools for measurement and benchmarking purposes and uses various load levels.We can generally call the Load Testing as the subset of Performance testing.Load TestingLoad Tests determine the applications behavior under load, up to and including its limits (not just at its limits).
Load tests specifically refer to the load size (number of concurrent users) and related values.
MethodologyWe compare two tools: WebLOAD Professional & NeoLoad 3.1We use an E-Commerce website for creating the test process.It will be a quantitative analysis.Each criteria will have a specific range.Both the tools will be marked for each criteria within the specific range.The tool which scores high overall will be recommended. CriteriaMinimal criteria
Scope for automation.Detect performance bottlenecks.Display response times under variable loads.Must support HTTP/S, SOAP and TCP/IP Internet protocols.MS Windows compatible.Criteria(Contd.)Good to have criteria
Cost and License.Ease of use.Steadiness of the tool.Documentation available for the tool.Variety of reports provided by the tool.Support scripting for scenario generation.Customer support.Reputation of the tool in market.
Range for each criteriaCRITERIARANGEScope for automation0-10Detect performance bottlenecks0-10Display response times under variable loads0-10Must support HTTP/S, SOAP and TCP/IP Internet protocols0-10MS Windows compatible0-10Cost and License0-5Ease of use0-10Steadiness of the tool0-5Quality of reports provided by the tool0-10Support scripting for scenario generation0-5Customer support0-5Documentation available for the tool.0-5Reputation of the tool in market0-5TOTAL100WebLOAD ProfessionalThis tool is from the family of Radview
Testing process:Creating and editing scriptsCreating and running Load TestsAnalyzing Load Test results
Scripts can be added in JavaScript languageAlso provides script correlation, script validations and script parameterizationScreenshotsCreating agenda
ScreenshotsRunning Test
13ScreenshotsAnalyzing results
NeoLoad 3.1This tool is from NeotysTesting process:Record -Capture a scenarioDesign -Graphical interface -Defining dynamic parameters -Defining logical options(delay, loops, try catch, etc) -Checking the virtual users
NeoLoad 3.1Testing process(contd.)Monitors -Create monitoring machine(select OS, Databases and Web EJB Architecture) -Select performance counters System(CPU User, CPU system, CPU idle, etc.) Memory(memory used, memory free)Runtime -Select load generator -Select durationAnalyze results
Screenshotscreating scenario
Screenshots...runtime
Screenshotsanalysis
Marking of tools on each criteriaScope for automation: The test cases should run automatically after defined time intervals. WebLOAD: This tool supports automation of test cases NeoLoad: Even this tool supports automation of running test cases by specifying the time interval in the duration policy
Detect performance bottlenecks: should specify an alert message when the system is in critical stage WebLOAD: Gives a detail report of the errors NeoLoad: Gives a quick alert message and details regarding that error
Marking of tools on each criteriaDisplay response times under variable loads WebLOAD: The reports generated specify clearly the response times for different loads NeoLoad: We can track the response times at every instance during the run time of the test process
Must support HTTP/S, SOAP and TCP/IP Internet protocols WebLOAD: Wide range of protocols are supported NeoLoad: Wide range of protocols are supportedMarking of tools on each criteriaMS Windows compatible: The tool must mainly support MS Windows OS but support for other platforms is considered as an advantage. WebLOAD: Supports MS Windows OS NeoLoad: Supports Linux, Solaris, IBM AIX, HP-UX and VMWare other than MS Windows OS
Cost and License: The competitive price matters a lot in evaluation. WebLOAD: Cost is over $5000 for 100 virtual users NeoLoad: Cost is cheaper when compared to WebLOAD
Marking of tools on each criteriaEase of use: Usability is important. The tool should be easy to learn for the testers. WebLOAD: Little tricky to create the script parameters and validations NeoLoad: Self-explanatory and easy to use
Steadiness of the tool: The tool should not crash or hang up in between. WebLOAD: Little bit slow in runtime NeoLoad: Runs perfect on threshold loads too
Marking of tools on each criteriaQuality of reports provided by the tool: At the end, the reports on the test should be precise and of variety of representation types WebLOAD: Need not be a performance analyst in order to examine the test results. NeoLoad: Provides enough charts to represent the results efficiently
Support scripting for scenario generation WebLOAD: This supports scripting NeoLoad: This is only GUI based
Marking of tools on each criteriaCustomer support WebLOAD: The Radview team provides excellent service NeoLoad: The Neotys team are equally helpful
Documentation for the tool WebLOAD: Precise documentation available NeoLoad: Well formatted documentation is available
Reputation of the tool in market WebLOAD: Captured 3% of the market share NeoLoad: New tool, but good competitor for WebLOAD. Final marking of the toolsCRITERIARANGEWebLOADNeoLoadScope for automation0-101010Detect performance bottlenecks0-101010Display response times under variable loads0-10910Must support HTTP/S, SOAP and TCP/IP Internet protocols0-101010MS Windows compatible0-10910Cost and License0-535Ease of use0-10710Steadiness of the tool0-535Quality of reports provided by the tool0-101010Support scripting for scenario generation0-550Customer support0-555Documentation available for the tool.0-544Reputation of the tool in market0-554TOTAL1009093Final RecommendationAfter the quantitative analysis of both the tools we recommend NeoLoad 3.1 and the detailed results and evaluation to choose this tool will be explained in the final report.
Thank U for kind attention