how to simplify load testing: jmeter and beyond

23
How to Simplify Load Testing: JMeter and Beyond New York, 28th of June, 2016 by Andrey Pokhilko, BlazeMeter Inc.

Upload: andrey-pokhilko

Post on 07-Jan-2017

340 views

Category:

Internet


1 download

TRANSCRIPT

Page 1: How to Simplify Load Testing: JMeter and Beyond

How to Simplify Load Testing:

JMeter and Beyond

New York, 28th of June, 2016

by Andrey Pokhilko, BlazeMeter Inc.

Page 2: How to Simplify Load Testing: JMeter and Beyond

Part 1News From the JMeter World

Page 3: How to Simplify Load Testing: JMeter and Beyond

JMeter 3.0 ReleaseTruly major, Java 7Keyboard shortcutsHTTP protocol support improvedJSON ExtractorMany other things (see article + webinar)

Page 4: How to Simplify Load Testing: JMeter and Beyond

Plugins ManagerInstall, upgrade, uninstall (including core items)60+ plugins in catalogNo unused stuff anymoreFaster JMeter startupFrequent plugin releasesIndependent plugin vendors

Page 5: How to Simplify Load Testing: JMeter and Beyond

Step-by-Step Debugger for JMeterReveals true execution flowBreakpoints!Shows intermediate state“Evaluate expression”Available through Plugins Managerhttps://github.com/Blazemeter/jmeter-debugger

Page 6: How to Simplify Load Testing: JMeter and Beyond

Any Questions on the JMeter Part?

Page 7: How to Simplify Load Testing: JMeter and Beyond

Part 2What is better than JMeter?

Page 8: How to Simplify Load Testing: JMeter and Beyond

Zoom-out Look at the Process

Page 9: How to Simplify Load Testing: JMeter and Beyond

Load Generating

Zoom-out Look at the Process

Parallel Tasks

Post-ProcessingPreparations

Restart Server

Shuffle CSV

Generate CSV from DB

Check Service is Alive

Collect Logs

Profile Memory

Snapshot Thread Dumps

Track Live Results

Check Stop Criteria

Send Alerts

Analyze Results

Compare to Baseline

Collect Artifacts

Page 10: How to Simplify Load Testing: JMeter and Beyond

DevOps Style for ToolsWeb 2.0

In the cloudVisualCollaborative

Command-LineCome to the Dark SideSimple and efficientInherent automation

Page 11: How to Simplify Load Testing: JMeter and Beyond

Codename: TaurusEnable DevOps styleNot to replace JMeter, but to add features on top of itDemocratize the tools space

http://gettaurus.org

Page 12: How to Simplify Load Testing: JMeter and Beyond

In a NutshellText-based configuration file formatExecuted by command-line toolThat wraps existing load generating tools And connects to Web 2.0 services

bztYAML JSON

JMeterJMeterJMeter ScalingReporting

Page 13: How to Simplify Load Testing: JMeter and Beyond

Minimalistic Config SyntaxVery easy to startInstalls tools itselfWorking test is as simple as:

---execution:- scenario: requests: - http://blazedemo.com/

Page 14: How to Simplify Load Testing: JMeter and Beyond

Minimalistic Config SyntaxGradually improvingVCS-friendlySupports all aspects of the process---execution:- scenario: requests: - http://blazedemo.com/

VS

Page 15: How to Simplify Load Testing: JMeter and Beyond

Supported Generators: 9 and counting...JMeterGatlingGrinderSiegeApache Benchmark

Selenium (pure!)Locust TsungPBench

Page 16: How to Simplify Load Testing: JMeter and Beyond

Supports Your Own Generator ToolCustom protocolEncryptionVery complex logicIf you’re ready for it...

Taurus is built with such cases in mind!

Page 17: How to Simplify Load Testing: JMeter and Beyond

“Pure” Selenium SupportExecutes existing Java or PythonVirtual Display support for headless environmentsEnables real-browser load tests

Page 18: How to Simplify Load Testing: JMeter and Beyond

Supports Multiple Tests at OnceValue of multi-execution configsAll the JMXses at onceHeterogeneous testsTrick with Selenium concurrency

Page 19: How to Simplify Load Testing: JMeter and Beyond

Operational EfficiencyMultiple config filesPersonal configCommand-line overrides and aliasesArtifact approach

It’s all waiting for you to enjoy!

Page 20: How to Simplify Load Testing: JMeter and Beyond

Reporting ServicesNo lost reports anymoreProfessional featuresInteractiveCollaborative

Page 21: How to Simplify Load Testing: JMeter and Beyond

Scaling Service

Page 22: How to Simplify Load Testing: JMeter and Beyond

Jenkins-FriendlyFits into Jenkins by designShips special features for JenkinsReporting and scaling apply

Page 23: How to Simplify Load Testing: JMeter and Beyond

Any Questions on the Taurus Part?

http://gettaurus.org/