cdat fit11 final

8/3/2019 Cdat Fit11 Final

1/21

A Cluster-based Architecture for DistributedAutomated Testing

Mr Dassen SATHANLecturer, University of MauritiusMauritiusB.Eng(UoM),MSc(UK)


2/21

FIT Conference 2011- Islamabad 2

Overview

Introduction Related works

Proposed framework

Components of proposed framework

Flowchart of overall operation Pseudocode

Results

Conclusions


3/21


Introduction

What is Software Testing? The process of operating software under controlled conditions with the

intent of identifying bugs and getting them fixed.

Levels of testing : Unit , Module, Sub-system, System

What is Automated software Testing? Use of software tools to generate test cases, execute tests and generate

report.

Why Automated software testing? 40% to 60% of entire software development time spent on testing.

Increased functionality & complexity.


4/21


Distributed Automated Testing

Distributed Automated Testing involves distributingautomated tests across several machines, executing thetests in parallel and aggregating the results


5/21


Why Distributed Testing

Less time and money: Automated tests can be executedover and over again.

More accuracy: Automated tests carry out the same steps

accurately every time.

Increased test coverage: The depth and scope of testcoverage is increased.

High Capability- Concurrency testing, stress test,Performance testing.


6/21

FIT Conference 2011- Islamabad

Agent Based Distributed Automated Testing

AGDAT is composed of the following agents: Test master Agent: Deploy and schedule test tasks.

Test results integration Agent: Collect and integrate the test log

Test execution Agent: Execute test scripts and send results.

6


7/21

FIT Conference 2011- Islamabad7

Multi Agent Framework

Multi Agent System is based on distributing a taskamong several agents.

The distributor agent gets as input the program to betested, specification about the number of testing agents and

the permitted time to complete the testing processes. Basedon these specifications, the distributor selects the testingagents and assigns the tasks to them.

Each testing agent can manage and control itself on a local

dimension and interact directly with its clones to exchange,provide and receive services, data and knowledge.

The cloning agents execute the test cases andreturn it to the testing agents.


8/21


Multi agent Framework

Registration,prediction

Clone identification

Clone Registration

Test casegenerator

Test caseexecution

Individual Test Report

inputs

Clone Specification

Clone Specification

Distributoragent

testingagent

cloneagents


9/21


Distributed Automated Regression Testing

Each application has a suite of distributed tests.

Each test undergoes pre processing, execution and postprocessing phases to compute the results

9


10/21


Evaluation

10

AGDAT MAS DART

Architecture Agent Agent Client-

Server

Framework Hybrid Hybrid Hybrid

Platform Win, Linux,

Mac

Win, Linux Linux

Expansion Yes Yes Yes

Test Language Java Java C

Ease of use No Yes No


11/21


Cluster-Based framework

A computer cluster is

a group of linked

computers, working

together closely thus

in many respects

forming a singlecomputer.

Create tests

View Results

Test/Results DB

Retrieve

Test/Results

Store

Test/Results

Allocate Tests

Failure Report

Test Results

Cluster Node

Base NodeGUI


12/21


Architecture of proposed framework

12

Base Node Cluster Nodes

Test Creation

Test Distribution

Node Manager

Result Reporting

Status Checking

Test Execution

Cluster Head

Test Distribution

Node Manager

Result Reporting

Test Execution


13/21


Base Node/Cluster Head

Test creation: The test creation component provides a graphicaluser interface (GUI) through which the user creates the test tasks.

Test distribution: The test distribution component allocates testtasks among nodes across the network.

Node Manager: The node manager constantly monitors thenetwork, and when it finds that a node has failed or no longerresponds, it inform the supervisor node about the failure.

Result reporting: When the test tasks have been executed at thecluster nodes, the results are sent back to the cluster heads whichforward it to the base node ;where the result reporting componentputs in a suitable format to be presented to the user.


14/21


Cluster Nodes

Status checking

The status checking component runs on the cluster nodes to registera particular node to the server, by checking the nodes status (readyor inuse) and resources availability (internet connectivity) to executetests.

Test execution

The test execution component executes the tests at cluster nodes. Itapplies the test data in the test cases to the application under test(website), gets the response and sends it to the server.

14


15/21


Overall operation

15


16/21


Hierarchical Cluster Formation

Hierarchy is formed by merging available nodes s1Sn to a groupbased on a cost function.

The cost function find the set {si, sj} which is the cheapest to merge.

Pseudocode:

1. Compute the proximity matrix containing the distance between eachpair of nodes. Treat each as a cluster.

2.

Find the most similar pair of clusters using the proximity matrix.Merge these two clusters into one cluster. Update the proximity matrixto reflect this merge operation

3. If all patterns in one cluster, top, else repeat step 2.

16


17/21


Test distribution

for (int i = 0; i < listofavailableclients.count(), i++){

Create a new Listoftest

Create a database connection and get list of test next to execute

GetNodeStatus

if node = ready

{

Form clusters

Get a row from the test cases

Create a thread for executing test casesExecute test cases

}

Assumption : Test cases are stored in excel file and have more or less the

same number of test scenarios.17


18/21


Results

With a cluster-based framework, test execution is faster

0

5

10

15

20

25

5 10 20 30 40 50 60 70

Testexecutiontime

inmins

No. of test cases

Client-server(3clients)

Cluster-based(7clients)


19/21


Conclusion

19

Cluster based Framework handle effectively test case management, testdistribution , test execution and result reporting.

Fault tolerance for the time being is only a message sent to Base nodeabout a node failure and the user has to re-allocate the test.

Test case allocation is done manually since the excel files are createdseparately. An improvement would be to split test cases based on theperformance of the nodes.


20/21


References

[1]LKDT: A Keyword - Driven Based Distributed Test Framework, Jie Hui, LanYuqing, Luo Pei, Guo Shuhang, Gao Jing, 2008 International Conference onComputer Science and Software Engineering.

[2]DiPerf: An automated DIstributed PERformance testing Framework, IoanRaicu, Catalin Dumitrescu, Matei Ripeanu, Ian Foster.

[3]DART: Distributed Automated Regression Testing for Large-Scale NetworkApplications, Brent N. Chun, OPODIS 2004, Springer-Verlag.

[4]Evolution of Agent Oriented Distributed Model for Software Testing, A

Layered Approach, Dhavachelvan Ponnurangam , Uma Anbarasan, 2004.

[5]Agent-based Distributed Automated Testing Executing Framework,Gao Jing,Lan Yuqing,IEEE 2009.

20


21/21


THANK YOU

QUESTIONS & SUGGESTIONS

21

cdat fit11 final

Documents