managing test suites for services

Managing test suites for services

Kathrin Kaschner

208.10.2010 http://service-technology.org

Black Box Testing

specification

test case

serviceimplementation

generate

308.10.2010 http://service-technology.org

Service Oriented Computing

– implements an encapsulated, self-contained functionality

– loosely-coupled– geographic distributed

– communication via message exchange– stateful

Service:

B

D

A

C

408.10.2010 http://service-technology.org

Modeling Communication

specification

BA

login

rejectaccept

cc

bt

cod

ω

508.10.2010 http://service-technology.org

implementation

Modeling Communication

login

rejectaccept

cc

bt

cod

ω

login

rejectaccept

cc

bt

cod

ω

specification

608.10.2010 http://service-technology.org

Modeling Communication

no deadlocks

the model describes the set of all partner services implicitly

login

rejectaccept

cc

bt

cod

ω

specification

708.10.2010 http://service-technology.org

Test Case = Partner Service

a possible partner service

login

rejectaccept

ω

cc

How to find partners

systematically?

✔✔

login

rejectaccept

cc

bt

cod

ω

specification

808.10.2010 http://service-technology.org

Operating Guidelines

–characterizes all partner services

–edges:? = receive message! = send message

–annotated states

908.10.2010 http://service-technology.org

Operating Guidelines

login

rejectaccept

ω

cc

✔✔

1008.10.2010 http://service-technology.org

specification

test case

serviceimplementation

generate

Black Box Testing

1108.10.2010 http://service-technology.org

Black Box Testing

(1)

(2) abstracttest case

specification

formal specificati

on(open net)

operating guideline

test case

implementation

(3) (4)

(5)

1208.10.2010 http://service-technology.org

- new functionalities are not taken into account by the existing test suite- existing test cases can become invalid

login

rejectaccept

cc

bt

cod

ωvoucher

Development of a new version

1308.10.2010 http://service-technology.org

login

rejectaccept

ω

cc

✘✘

login

rejectaccept

cc

bt

cod

ωvoucher

Development of a new version

1408.10.2010 http://service-technology.org

1) Making the test suite conclusive

– invalid test cases are removed from the test suite

matching with the new operating guideline

login

rejectaccept

cc

bt

cod

ωvoucher

Updating the test suite

1508.10.2010 http://service-technology.org

2) Making the test suite complete– add test cases for the new functionalities set operations for operating guidelines

OG OGnew

Updating the test suite

new test cases

1608.10.2010 http://service-technology.org

Future Work

– OGnew\OG can be only represented as an extended

annotated automaton

test case selection is NP-complete

good heuristics are neededOG OGnew

new test cases