every system test department should have a test developer - nordstrom - eurostar 2012

18
Kristoffer Nordström, Electric Cloud Why every system test department should have a test developer (… or two) www.eurostarconferences.com @esconfs #esconfs

Upload: eurostar-conference

Post on 14-Dec-2014

33 views

Category:

Documents


0 download

DESCRIPTION

EuroSTAR Software Testing Conference 2012 presentation on systems testing

TRANSCRIPT

Page 1: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Kristoffer Nordström, Electric Cloud

Why every system test department should

have a test developer (… or two)

www.eurostarconferences.com

@esconfs #esconfs

Page 2: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Copyright © 2012 Electric Cloud, Inc. All rights reserved.

Why every system test department should

have a test developer (… or two)

Kristoffer Nordström (@kristoffer_nord)

2012-09-12

[email protected]

Page 3: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

…so that testers can focus on quality human testing

Test Developer who loves to automate testing

WhoAmI

Cert. Scrum Master

Agile freak Test automation

Developer

Tester

TestDeveloper Leanfrastructure

UIQ Technology

Softhouse AB Svenska Antennspecialisten

Embedded platforms

Team Lead

Non-functional testing Test automation

Test tools

Automated GUI Testing

Aut. dev. testing

Charging systems

NFNT Testing

Automated GUI Testing

Test data Automated Installation

System testing

Exploratory testing Northern Test Consulting Electric Cloud

Page 4: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

What is a test developer?

Page 5: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Challenges

Test departments with only testers

Agile pace of delivery

Scripted manual test cases

Where to get development skills from

Page 6: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012
Page 7: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Potential benefits

Dedicated man hours

Test automation

Reproduce complicated bugs

Compile open-source tools

Non-functional testing

Page 8: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Data diggers

Page 9: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Watch dogs

Page 10: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Thanks to Luva@Ericsson Karlskrona

for permission

Dashboards

Page 11: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Automatic provisioning

Copy new binaries, testdata etc.

Reset application

configuration

Reset Database

PXE boot - install OS

Page 12: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Overriding System Calls

Test Case Production Code

Glibc::readdir()

SystemCall::getdents()

Virtual File System

LD_PRELOAD::Override_readdir()

Loadable Kernel Module::Override_getdents()

Page 13: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Potential risks

Less manual testing

”Team within the team”

Not working focused enough

Ends up doing test

automation for the dev teams

Risk of department relying to

much on one team/person

Hard to keep up quality

when working as solo

developer

Page 14: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Where do I find one?

Hire your own

Train your own

Train from developer

Train from tester

Page 15: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

How to boost them?

Page 16: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Role Description

[Testing]

• Exploratory Testing

• Write good test cases

• Non-functional Testing

• Test automation

• Break software

• Risk analysis

[Development]

• Programming language(s)

• Scripting language(s)

• Good OS knowledge

• SOLID programming

• Design patterns

• Debugging techniques

[Personal]

• Problem solving

• Communicator

• Passion for learning

• Tight partnership with developers

• Serves the test team

Page 17: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Role description

Potential risks

Potential benefits

All in all: A test developer helps your test department run just a little bit more smoothly

Page 18: Every System Test Department Should Have a Test Developer - Nordstrom - EuroSTAR 2012

Copyright © 2012 Electric Cloud, Inc. All rights reserved.

Thank you @kristoffer_nord