1

SERIOUS ABOUT SOFTWARE

Developing the Test Organization TUT 25.10.2010

2

GLOBAL & REGIONAL HEADQUARTERS

Beijing, China Tampere, Finland San Jose, USA

PROFESSIONALS ~ 1,400

TOP 5 CLIENTS Ericsson Nokia IBM PayPal Microsoft

BACKGROUND

› Deep technology & industry expertise with strong focus on user experience

› Globally integrated delivery models in the US, Europe & Asia

› Scalable & cost effective offshore resources in China

› Created by former executives from IBM and Nokia

› Diverse global management team

VISION

PROVIDE ADVANCED PRODUCT ENGINEERING AND R&D CO-CREATION SOLUTIONS TO THE WORLD’S LEADING TECHNOLOGY INNOVATORS

Key Type of Center Focus Area Resources

Global Development Center Larger scale, secure lab spaces, long term dedicated teams > 100 professionals

Advanced Research & Design Center Design, engineering staff Specialist & Seniors

Client Solution Center Requirements gathering, executive briefing Consults & Architects

Sales Office

•North America •Headquarters: San Jose, CA

San Jose, CA Washington DC

Boston, MA Chicago, IL Dallas, TX Los Angeles, CA

•Europe •Headquarters: Tampere, Finland & Stockholm, Sweden

Oulu, FIN Tampere, FIN

Gothenburg, SWE Helsinki, FIN Kuopio, FIN Lahti, FIN Malmö, SWE Salo, FIN Stockholm, SWE

•Asia •Headquarters: Beijing, China

Beijing, CHN Chengdu, CHN Dhaka, BGD Hangzhou, CHN Taipei, TWN

Shanghai, CHN Tokyo, JPN

QA, Testing & Globalization

• QA Consulting

• Process Development

• Test Architecture

• Test Outsourcing

• Internationalization

• Localization

4

Test & Measurement Systems

• Test & Measurement Systems

• Test Frameworks

• Test Automation

• Test Infrastructure

5

Skill profile

6

Personal skills

Testing skills

SW engineering

skills

Domain expertise

Towards Expertise

• Learn the basic principles and techniques of

testing.

• Learn to use them in different domains.

• Agile methods don’t say much about testing.

• Negative testing, non-functional testing and

test automation are coming more important

than ever.

• Learn risk management.

• Supply information to stakeholders.

7

Testing Career Paths

Technical

• Senior Specialist

• Specialist

• Senior Engineer

• Engineer

Speciality

• Sw security testing

• Performance testing

• Test automation

• Test management

• Risk management

8

Testing Career Paths

• Management path:

• Director

• QA Manager

• Test Manager

• Team Leader

9

Management

• Set general objectives for the test

organization.

• Explain testing to your managers and

customers.

• Tell your team the project objectives and

align the test activities accordingly.

• Use metrics for reporting, but also ask

questions from your team.

10

Management

• Let a tester be a tester, reward ingenuity.

• Independent thinkers are sometimes hard

to manage.

• Find the ways to collaborate with project

stakeholders.

• Beware of the quality guillotine!

• Diversity of the test team and test effort is

the key to success.

11

Management

• Work together with your team.

• Be flexible and ready for changes.

• Follow what is happening at the testing

community.

• Follow new information system &

development trends, tools and methods.

• Use a reference model to develop the

organization.

12

Customers

• Testing has one or more customers

(internal or external) and it’s a service.

• Develop services for your customers:

• Review service

• Internal training

• Agile testing team

• Defect management

• Performance evaluation

• Risk management

13

Metrics

• Test organization should have a couple of

metrics which are used in every project:

• Normal project metrics (e.g. effort, costs)

• Size (e.g. LOC, number of requirements, use

case, user stories, components)

• Test cases (ok / not ok / na)

• Defects

• Support for estimations

• Data should come out automatically from

used tools.

14

Certifications

• Customers can demand certified project

personnel.

• ISEB/ISTQB testing certifications

• Examples of others:

• CISSP computer security certification

• SSBB Six Sigma Black Belt

15

Towards TotalQA

• Activities are divided to 3 levels of actions: Preventive,

Detective and Corrective actions

• Actions may be applied in all phases of product life cycle

• Any software development model can be used: waterfall,

iterative or incremental.

16

Standards, regulations, methodology

ISO 9001 Quality management systems – Requirements

ISO 13485 Medical devices -- Quality management systems -- Requirements for regulatory

purposes

ISO 14971 Medical devices -- Application of risk management to medical devices

IEC 60601 Medical Electrical Equipment

IEC 62083 Medical Electrical Equipment - Requirements for the Safety of Radiotherapy

Treatment Planning Systems FDA part 8.20

AQAP 2110 NATO quality assurance requirements for design, development and production

CAPA Corrective and Preventive Actions

CMMi Capability Maturity Model Integration

FMEA Failure Mode and Effect Analysis

FTA Fault Tree Analysis

Six Sigma risk management method

TMap Test Management approach

TPI Test Process Improvement

17

18