how to simplify load testing: jmeter and beyond

How to Simplify Load Testing:

JMeter and Beyond

New York, 28th of June, 2016

by Andrey Pokhilko, BlazeMeter Inc.

Part 1News From the JMeter World

JMeter 3.0 ReleaseTruly major, Java 7Keyboard shortcutsHTTP protocol support improvedJSON ExtractorMany other things (see article + webinar)

Plugins ManagerInstall, upgrade, uninstall (including core items)60+ plugins in catalogNo unused stuff anymoreFaster JMeter startupFrequent plugin releasesIndependent plugin vendors

Step-by-Step Debugger for JMeterReveals true execution flowBreakpoints!Shows intermediate state“Evaluate expression”Available through Plugins Managerhttps://github.com/Blazemeter/jmeter-debugger

Any Questions on the JMeter Part?

Part 2What is better than JMeter?

Zoom-out Look at the Process

Load Generating

Zoom-out Look at the Process

Parallel Tasks

Post-ProcessingPreparations

Restart Server

Shuffle CSV

Generate CSV from DB

Check Service is Alive

Collect Logs

Profile Memory

Snapshot Thread Dumps

Track Live Results

Check Stop Criteria

Send Alerts

Analyze Results

Compare to Baseline

Collect Artifacts

DevOps Style for ToolsWeb 2.0

In the cloudVisualCollaborative

Command-LineCome to the Dark SideSimple and efficientInherent automation

Codename: TaurusEnable DevOps styleNot to replace JMeter, but to add features on top of itDemocratize the tools space

http://gettaurus.org

In a NutshellText-based configuration file formatExecuted by command-line toolThat wraps existing load generating tools And connects to Web 2.0 services

bztYAML JSON

JMeterJMeterJMeter ScalingReporting

Minimalistic Config SyntaxVery easy to startInstalls tools itselfWorking test is as simple as:

---execution:- scenario: requests: - http://blazedemo.com/

Minimalistic Config SyntaxGradually improvingVCS-friendlySupports all aspects of the process---execution:- scenario: requests: - http://blazedemo.com/

VS

Supported Generators: 9 and counting...JMeterGatlingGrinderSiegeApache Benchmark

Selenium (pure!)Locust TsungPBench

Supports Your Own Generator ToolCustom protocolEncryptionVery complex logicIf you’re ready for it...

Taurus is built with such cases in mind!

“Pure” Selenium SupportExecutes existing Java or PythonVirtual Display support for headless environmentsEnables real-browser load tests

Supports Multiple Tests at OnceValue of multi-execution configsAll the JMXses at onceHeterogeneous testsTrick with Selenium concurrency

Operational EfficiencyMultiple config filesPersonal configCommand-line overrides and aliasesArtifact approach

It’s all waiting for you to enjoy!

Reporting ServicesNo lost reports anymoreProfessional featuresInteractiveCollaborative

Scaling Service

Jenkins-FriendlyFits into Jenkins by designShips special features for JenkinsReporting and scaling apply

Any Questions on the Taurus Part?

http://gettaurus.org/