performance and automation testing using apache jmeter for agile environment
DESCRIPTION
Jmeter, a powerful performance testing tool from the Apache Jakarta project, can be used to simulate a heavy load on a server, network or object .This helps to test the strength or to analyze overall performance of the system under different load conditions. It has a Full multithreading framework which allows concurrent sampling by many threads and simultaneous sampling of different functions by separate thread groups. It can test servers eg. Web Server – HTTP, HTTPS, Web Services – SOAP, JUnits, Database via JDBC. Jmeter based tests can be integrated into scheduled builds using build tool like Apache Ant . JMeter and Flex BlazeDS Application Performance Testing can be used in a scenario where the front end is developed using flex, the flex remote objects communicate in the flex AMF format. We can leverage JMeter for such scenario where an AMF message can ride over http and a web application can be tested for performance testing and load testing. Take away for the audience :- Examples which illustrate how to use Jmeter in load testing and automation testing.TRANSCRIPT
Contents
• Performance testing• Agile methodology• Automated testing• JMeter
2/20/2010 First Draft 2
What are the pain points ?
19%
18%
17%
16%
16%
14% Reliability issues: connection drop issuesover a period of time.
Load test at module level.
Scalability in terms of Number of usershandled by the system.
Quick comparison of Performance testresults across OS Platforms.
Load test at the functional level.
PSR testing for Quick POCs. (Based on survey conducted at BMC Software)
PROCESS
• Write code( 1- 6 months)• Compile code• Send it to QA (or Production ?)• Performance Regression• PANIC !
No Performance Testing !
A BETTER WAY
• Write code• CI compiles code and runs test• Send it to QA ( or Production?)• Performance Regression• PANIC !
No Performance Testing !
A BETTER WAY 2.0
• Performance test artifacts as soon as they pass Unit and Functional testing
• Fast feedback for developers
• No Surprises
Warm Up
• Performance testing• Agile methodology• Automated testing
2/20/2010 First Draft 7
It’s your turn
• Performance testing• Agile methodology• Automated testing
2/20/2010 First Draft 8
• To determine how fast some aspect of a system performs under a particular workload .
2/20/2010 First Draft 9
Performance testing
2/20/2010 First Draft 10
“ What cannot be measured, cannot be improved.”
Performance Testing
JMeter
• What is JMeter• Who can use JMeter• Where can we use JMeter• When can we use JMeter• Why to use JMeter• How to use JMeter
2/20/2010 First Draft 12
JMeter
• What is JMeter– Background– History
2/20/2010 First Draft 13
JMeter• Who can use JMeter
– Dev and QA
Using open source tools for performance testing Presenter: Goranka Bjedov
JMeter• Where can we use JMeter
2/20/2010 First Draft 15
JMeter• When can we use JMeter
- Know how the system responds to work load- Pound system with simultaneous requests
- Performance- Scalability- Reliability
– PSR tests on the quick POCs.– Use in AGILE– Use other tools that complement JMeter, e.g.
Perfmon
2/20/2010 First Draft 16
Why JMeter
• Catch performance regressions quickly• Simplify the hunting of bugs• Code with confidence• Know the performance cost of features• Go home on time
It’s Demo Time
• JMeter and JUnit• JMeter and database query testing• JMeter and Web based Flex Performance
testing
2/20/2010 First Draft 18
Performance Testing of Flex Web Application
• AMF - Action Message Format (AMF) binary format used to serialize ActionScript objects
• To performance test flex web app, need to generate required amf file first.
Distributed Testing
It’s your turn
• Performance testing• Agile methodology• Automated testing
2/20/2010 First Draft 21
Automated Testing
1. Integration with CI tools- Ant Target
- HTML Report Generation
Comparisons, Alternatives, Conclusions
• Shortcomings of JMeter• Conclusions
2/20/2010 First Draft 23
Resources
• Apache JMeter Home
– http://jakarta.apache.org/jmeter/
• Google TechTalk- Using open source tools for performance testing
2/20/2010 First Draft 24
Questions
2/20/2010 First Draft 25
2/20/2010 First Draft 26
Sameer Naik - [email protected]
Prasad Nirantar – [email protected]
Contact Details