Download - Automated Testing & Test Tools
1
Automated Testing & Test Tools
Apirada Thadadech
Apirada Thadadech
2
Contents
The Benefits of Automation and Tools
Test Tools
Software Test Automation
Random Testing: Monkeys and Gorillas
Realities of Using Test Tools and
Automation
Apirada Thadadech
3
The Benefits of Automation and Tools
•The code test fix loop get repeat several times before the software is released.
•Might need Many time to run the tests and check the bugs that found in previous test runs were indeed fixed and no new bugs.
Software test tool and automation can help to solve those problem
Apirada Thadadech
4
The principle attributes of tools and automation:
Speed. Might average test case every 5 seconds.
Efficience. During running test case by test tool, have time
for test planning and thinking up new test.
Accuracy and Precision. A test tool will perform the
same test and check the result perfectly.
Relentlessness. Test tools and automation never tire or
give up
Apirada Thadadech
5
reminder
Software test tools are not a substitute for
software testers, but they just help software
testers perform their jobs better.
Apirada Thadadech
6
Test Tools
Test tool work as Black- box testing. They could
perform software tests without having to set up a real-
real scenario, they don’t need to understand how the
tool works.
Test tool could be set up the monitor and modify the
raw communications that occurs among those million
computers(testing networking software)
Test tool could be set up to monitor and modify the
raw communications that occurs among those million
computer seem white-box skills and knowledge of the
low-level protocol to effectively use the tool.
Apirada Thadadech
7
Types of test tool
InvasiveInvasive
A tool is used only to
monitor and examine
the software without
modifying
Non-invasiveNon-invasive
A tool modifies the
program code or
manipulates the
operating environment
Apirada Thadadech
8
Test Tool Type
Viewers and Monitors Test tool allow tester to see
details of software’s operation that they wouldn’t normally
be able to see.
Drivers are tools used to control and operate the software
being tested, such as batch file, software that testing
requires large amounts of data to be entered for test.
Stubs is like driver, but stubs are essentially the opposite
of driver in that they don’t control operate the software
being tested. Such as sent data to printer, you can test it is
to enter data, print it and look at the result paper printout.
Apirada Thadadech
9
Viewers and Monitors
Computer #1 Computer #2
Software under test Software under test
Communications line
Computer #3
Viewer test tool
Tapped line
Apirada Thadadech
10
Stress and Load Tools
Stress ToolStress Tool is The Stress
program allows you to
individually set the
amounts of memory. Disk
space, files and other
resources available to the
software running on the
machine.
Load ToolLoad Tool is similar to stress tool
but it run on Web servers to
load them down by simulating
a set number of connections.
Such as it check that 10.000
simultaneous users and 1
million hits a day can be
handled without showing
response times.
There are problems about available memory and disk space when the system run many programs in the same time, such as running word processing and copy file to fill up….and so on.
Apirada Thadadech
11
Software Test Automation
Software test automation is software that
could be combined, started, and run with
little or no intervention from tester.
Apirada Thadadech
12
Types of automation Macro recording and payback
Programmed Macros
Fully Programmable Automated Testing
Tools
Apirada Thadadech
13
Macro recording and payback The Most basic type of test automation is
recording your keyboard and mouse actions
as you run your tests for first time and then
playing them back when you need to run
them again
Apirada Thadadech
14
The Option in Macro recording and playback Name Name : Macro name provides a way to identify it later. RepetitionsRepetitions: Great way to find bugs. You can set the number of
times the macro will repeat or loop when it runs. TriggerTrigger : you can set how the macro is started, can be by a hot
key. What’s capturedWhat’s captured: you can select to capture as ketstrokes or
mouse action. Play back speedPlay back speed: it can set play back from 20 % slower to 500% Playback positionPlayback position: determines when mouse movements and
clicks should be absolute or relative to a certain window onescreen
Apirada Thadadech
15
Note:Note:
Recording and playing back macros is a
popular means to automate simple testing
tasks. Its also a good place to start for
testers learning how to automate their.
Apirada Thadadech
16
Programmed Macros
Programmed macros are a step up in
evolution from the simple record and
playback variety.
Apirada Thadadech
17
Simple macro program
1: calculator test #2
2: <<execute:c\windows\calc.exe-->>
3: <<lookfor : calculator –secs: 5 -- >>
4: 123 – 100 =
5: << prompt : the answer should be 23 >>
6: << close: calculator>>
A Simple Macro that performs a test on the Windows Calculator
Apirada Thadadech
18
Random Testing: Monkeys and Gorillas
Test Monkey :
The idea that you had a million
monkeys typing on a million
keyboards for a million years.
The use of test monkey to simulate how your customers will use your software in no way insinuates that computer users are related to apes.
Apirada Thadadech
19
Test monkeys
Dump monkeys
Semi-Smart monkeys
Smart Monkeys
Apirada Thadadech
20
Dump Monkeys
A dump monkey doesn’t know anything
about the software being tested; it just
clicks or types randomly.
1: randomize timer
2: for I = 1 to 10000
3: play “{click “+str$(int(RND*640))+”, “+STR$(RND*480))+”}”
4: play CHR$ (RND*256)
5: Next i
Apirada Thadadech
21
Remember
The monkey is doing absolutely no
verification. It just clicks and types
until one of two things happens-
either it finishes its loop or the
software or the operating system
crashes.
Apirada Thadadech
22
Note
If you don’t believe that a dumb
monkey can possibly find a serious bug, try
running one on your favorite computer
game or multimedia program.
Apirada Thadadech
23
It doesn’t seem to make sense that
simple random clicking and typing could
find a bug, but it does for a couple
reasons:
Given enough time and attempts.
With its continuous repetition and use.
Apirada Thadadech
24
Semi-Smart Monkeys
Apirada Thadadech
25
Realities of Using Test Tools and Automation
•The Software changes. Specifications are never fixed.
•There’s no substitute for the human eye and intuition.
•Verification is hard to do
•It is easy to rely on automation too much.
•Don’t spend so much time working on tools and automation that you fail to test the software.
•If you’re writing macros, developing a tool, or programming a monkey, you are doing development work.
•Some tools are invasive and can cause the software being tested to improperly fail.