istqb glossary russian v2 1

Upload: garrydirak

Post on 02-Mar-2016

113 views

Category:

Documents


3 download

TRANSCRIPT

  • ,

    2.1 ( 1 2010 )

    Glossary Working Party

    International Software Testing Qualifications Board

    : Erik van Veenendaal ()

    : ()

    :

    .

  • Rex Black () Enst Dring () Sigrid Eldh () Isabel Evans () Simon Frankish () David Fuller () Annu George () Dorothy Graham () Mats Grindal () Matthias Hamburg () Julian Harty () David Hayman () Bernard Homes () Ian Howles () Juha Itkonen () Paul Jorgensen () Vipul Kocher () Fernando Lamas de Oliveira () Tilo Linz () Gustavo Marquez Sosa () Don Mills () Peter Morgan () Thomas Muller () Avi Ofer ()

    Dale Perry () Horst Pohlmann () Meile Posthuma () Erkki Poyhonen () Maaret Pyhajarvi () Andy Redwood () Stuart Reid () Piet de Roo () Steve Sampson () Shane Saunders () Hans Schaefer () Jurrien Seubers () Dave Sherratt () Mike Smith () Andreas Spillner () Lucjan Stapp () Richard Taylor () Geoff Thompson () Stephanie Ulrich () Matti Vuori () Gearrel Welvaart () Paul Weymouth () Pete Williams ()

    () () () () () ()

  • 1.3, 31 2007

    : - action word driven testing - bug tracking tool - coverage measurement tool - modeling tool - monkey testing - scripted testing - specification-based technique - stress testing tool - structure-based technique - unit test framework - white box technique

    : - basic block - control flow graph - defect management tool - independence of testing - project risk - risk-based testing - test comparator - test process

    2.0, 2 2007

    : - attack - buffer - buffer overflow - bug taxonomy - classification tree - control flow analysis - continuous representation - cost of quality - defect based technique - defect based test design technique - defect taxonomy - error seeding tool - Failure Mode, Effect and Criticality Analysis (FMECA) - false-fail result - false-pass result - false-negative result - false-positive result - fault attack - fault seeding - fault seeding tool - hazard analysis - hyperlink - hyperlink tool - load profile - operational acceptance testing - operational profile - orthogonal array - orthogonal array testing - pairwise testing - performance profiling - pointer - procedure testing - process improvement - production acceptance testing - qualification

    : - bebugging - error seeding - Failure Mode and Effect Analysis (FMEA) - Fault Tree Analysis (FTA) - modified multiple condition testing - process cycle test - root cause - specification-based technique - stress testing - test charter

  • - reliability growth model - retrospective meeting - risk level - risk type - root cause analysis - safety critical system - software attack - Software Failure Mode and Effect Analysis (SFMEA) - Software Failure Mode Effect and Criticality Analysis (SFMECA) - Software Fault Tree Analysis (SFTA) - software life cycle - staged representation - system of systems - test design - test estimation - test implementation - Test Maturity Model Integration (TMMi) - test progress report - test rig - test schedule - test session - wild pointer

    2.0 , 4 2008

    .

    2.1, 1 2010

    : accuracy testing - acting (IDEAL) - agile manifesto - agile software development - assessment report - assessor - balanced scorecard - call graph - causal analysis - cause-effect diagram - change management - charter - checklist-based testing - clear box testing - codependent behavior - content-based model - corporate dashboard - critical success factor - critical testing processes - CTP - dashboard - dd-path - Deming cycle - diagnosing (IDEAL) - EFQM excellence model - emotional intelligence - establishing (IDEAL)

    : - attack - buffer overflow - control flow analysis - cyclomatic complexity - desk checking - entry point - exit point - Failure Mode, Effects, and Criticality Analysis (FMECA) - invalid testing - memory leak - modeling tool - monkey testing - operational acceptance testing - performance testing tool - risk-based testing - risk type - scribe - Software Failure Mode, Effects, and Criticality Analysis (SFMECA) - static analysis - static testing - system of systems - test estimation - use case - use case testing

  • - extreme programming - fishbone diagram - Goal Question Metric - GQM - hyperlink test tool - IDEAL - indicator - initiating (IDEAL) - Ishikawa diagram - lead assessor - learning (IDEAL) - lifecycle model - load testing tool - manufacturing-based quality - maturity level - maturity model - Mean Time Between Failures - Mean Time To Repair - mind-map - MTBF - MTTR - Pareto analysis - post-project meeting - process assessment - process model - product-based quality - project retrospective - quality gate - Rational Unified Process - risk category - RUP - scorecard - SCRUM - session-based test management - session-based testing - Software Process Improvement - SPI - standard - STEP - structure-based test design technique - suitability testing - SUMI - Systematic Test and Evaluation Process - test deliverable - test improvement plan - Test Process Group - test process improvement manifesto - test process improver - Total Quality Management - TPG - TQM - transactional analysis - transcendent-based quality - user-based quality - value-based quality

  • - WBS - Work Breakdown Structure

    2.1 , 31 2012

    .

  • ....................................................................................................................................... 8 1............................................................................................................................................ 8 2. .................................................................................................................................................. 8 3. ...................................................................................................................... 8 4. . .................................................................................................................... 9 5. .............................................................................................................................. 9 6. ................................................................................................................................. 10

    .............................................................................................................................................. 10 .............................................................................................................................................. 13 .............................................................................................................................................. 14 .............................................................................................................................................. 16 .............................................................................................................................................. 17 .............................................................................................................................................. 18 ............................................................................................................................................. 18 .............................................................................................................................................. 18 .............................................................................................................................................. 19 .............................................................................................................................................. 25 .............................................................................................................................................. 27 ............................................................................................................................................. 27 .............................................................................................................................................. 32 .............................................................................................................................................. 33 .............................................................................................................................................. 35 .............................................................................................................................................. 42 .............................................................................................................................................. 44 .............................................................................................................................................. 49 .............................................................................................................................................. 59 ............................................................................................................................................. 61 .............................................................................................................................................. 61 .............................................................................................................................................. 62 ............................................................................................................................................. 62 .............................................................................................................................................. 63 .............................................................................................................................................. 64

    () ............................................................................................................ 65 ( ) ........................................................... 67

  • ,

    ,

    ,

    . , -,

    .

    : , , , ,

    , , , , , , , , ,

    .

    BS 7925-1 1998 .

    Information Systems Examination Board (ISEB)

    (Foundation), (Practitioner) .

    ,

    , ,

    ,

    .

    .

    International Software Testing

    Qualifications Board (ISTQB).

    1. ,

    , , ,

    ; ,

    , ,

    . ,

    .

    2. , ,

    .

    3. .

    -

    .

    .

    .

    , . ,

    . .

  • , ,

    .

    4. . .

    , , ,

    . IEC ISO

    .

    - BS 7925-2:1998 Software Component Testing

    - DO-178B:1992 Software Considerations in Airborne Systems and Equipment Certification, Requirements

    and Technical Concepts for Aviation (RTCA SC167)

    - IEEE 610.12:1990 Standard Glossary of Software Engineering Terminology

    - IEEE 829:1998 Standard for Software Test Documentation

    - IEEE 1008:1993 Standard for Software Unit Testing

    - IEEE 1012:1986 Standard for Verification and Validation Plans

    - IEEE 1028:1997 Standard for Software Reviews and Audits

    - IEEE 1044:1993 Standard Classification for Software Anomalies

    - IEEE 1219:1998 Software Maintenance

    - ISO/IEC 2382-1:1993. Data processing - Vocabulary - Part 1: Fundamental terms

    - ISO 9000:2000 Quality Management Systems Fundamentals and Vocabulary ( 9000-2001

    )

    - ISO/IEC 9126-1:2001 Software Engineering Software Product Quality Part 1: Quality characteristics and

    sub-characteristics ( 9126. . .

    )

    - ISO/IEC 12207:1995. Information Technology Software Life Cycle Processes. ( 12207-99.

    . )

    - ISO/IEC 14598-1:1996. Information Technology Software Product Evaluation - Part 1: General Overview

    5.

    :

    - CMM CMMI -;

    - TMap, TPA TPI Sogeti Nederland BV;

    - TMM ;

    - TMMi TMMi Foundation.

  • 6. CASE (CASE): Computer Aided Software Engineering (

    ). CAST (CAST): Computer Aided Software Testing (

    ). . . COTS (COTS): Commercial Off-The-Shelf software (

    ). . LCSAJ (LCSAJ): ,

    ( ): 1. , 2. , 3. , .

    Rational Unified Process (Rational Unified Process):

    , : , , ,

    RUP (RUP): . Rational Unified Process. SUMI (SUMI): . V- (V-model): ,

    . V- .

    (abstract test case): . . (test execution automation):

    (, /) , , .

    (test automation):

    , , , , .

    (scripted testing): ,

    . (automated testware): ,

    , , .

  • (test script): ().

    (path sensitizing):

    . (decision): ,

    . . - (alpha testing):

    / , . - .

    (impact analysis): ,

    . (boundary value analysis): ,

    . . .

    (FTA) (Fault Tree Analysis (FTA)): ,

    (). , , .

    (mutation analysis):

    , .

    (Pareto analysis): ,

    , . , (80%) (20%)

    (root cause analysis): ,

    . , .

    (coverage analysis):

    . , , , .

    (data flow analysis): ,

    . (control flow analysis): ,

    ( ) .

  • , , .

    - (cause-effect analysis): . -

    . (risk analysis):

    . (hazard analysis): ,

    . , . . .

    (testability review):

    , , . [TMap]

    (TPA) (Test Point Analysis (TPA)):

    , . [TMap] (FMEA) (Failure Mode and Effect Analysis (FMEA)):

    . . , (FMECA)

    , (FMECA) (Failure Mode, Effect and Criticality Analysis

    (FMECA)): FMEA; FMEA, , . , , . . .

    , (Software Failure Mode

    Effect, and Criticality Analysis (SFMECA)): . , (FMECA).

    (FA) (Function Point Analysis (FPA)): ,

    . . , .

    (Software Failure Mode and Effect

    Analysis (SFMEA)): . (FMEA) (Software Fault Tree Analysis (SFTA)): .

    (FTA) (analyzer): . . (code analyzer): . .

  • (analyzability): , .[ISO 9126] . .

    (test evaluation report): ,

    . .

    (anomaly): , ,

    , , , .., - . ( ) , , , [IEEE1044] . , , , , , , , .

    (mind-map): , , ,

    , . , , , , , , .

    (attack): , ,

    . . .

    (fault attack): . . (TPA): . . : , . [IEEE 610] (audit):

    , , / , , , : 1. ; 2. , ; 3. . [IEEE 1028]

    (configuration auditing):

    , . [IEEE 610]

    (test basis): ,

    . , . , . [TMap]

  • (baseline): , , , . [ IEEE 610]

    (basic block):

    , . : .

    (basis test set):

    , 100% .

    (safety):

    , , , . [ISO 9126]

    - (beta testing): /

    / , / -. - .

    (buffer): ,

    , , , , . [ IEEE 610]

    (validation): ,

    . [ISO 9000]

    (lead assessor): , . ,

    CMMi TMMi, .

    (test leader): . (verification):

    , . [ISO 9000] (vertical traceability):

    .

  • (branch): , , , , , case, jump, go to, if then-else.

    (milestone): ,

    () . (interoperability):

    [ISO 9126] . .

    (test reproduceability): , ,

    . (recoverability):

    , . [ISO 9126] . .

    (bottom-up testing):

    , . , . . .

    (input): ( ), . (input value): . . . (intake test): " " ,

    . . . " ".

    (test input): ,

    . , .

    (random testing): ,

    , - . , .

    (test execution): ,

    . (feasible path): ,

    , . (executable statement): ,

    , , .

  • (output value): . . (output): ( ),

    .

    (agile software development):

    , , .

    (agile testing): ,

    , (XP), . . .

    (hyperlink): -, -. (master test plan): ,

    . . . (horizontal traceability):

    (, , , ).

    (off-the-shelf software): ,

    , .. , .

    (TPG): . . (boundary value): ,

    , , .

    (call graph):

    . (control flow graph):

    () . (test schedule): , ,

    / , . (change control board): . .

  • (configuration control board (CCB)): ,

    , . [IEEE 610]

    (Test Process Group): ( ),

    , , . [ CMMI]

    (dirty testing): C. .

    ( IDEAL) (acting (IDEAL)): IDEAL,

    . : , \ , . . IDEAL.

    (classification tree): ,

    , . . .

    (defect): ,

    , . , , .

    ( IDEAL) (diagnosing (IDEAL)): IDEAL,

    , . : , . . IDEAL.

    c (Ishikawa diagram): . - . - (cause-effect graph):

    / () (), .

    (state diagram): , ,

    , , . [IEEE 610]

    - (fishbone diagram): . - . (wild pointer): , , ,

    . . .

  • (dynamic analysis): , , . [IEEE 610]

    (dynamic comparison): ,

    , .

    (dynamic testing): ,

    , . (domain): , /

    . (availability):

    . . [IEEE 610] (driver): ,

    , / . [TMap]

    (daily build): , ( )

    , , .

    (lifecycle model): . [CMMI]

    . . (software life cycle): ,

    , . : , , , , , , , , . .

    (blocked test case): ,

    .

  • (test closure): , , . , . . .

    (stub): .

    , . [IEEE 610]

    (specified input): ,

    . (bespoke software, custom software):

    , . - .

    (replaceability):

    [ISO 9126] . : .

    (frozen test basis): ,

    . . .

    (test recording): . . (security): ,

    , , . . .

    (cyclomatic number): . . (maturity):

    (1) . . ,

    (2) . [ISO 9126] . .

    (configuration identification): ,

    . [IEEE 610]

    (changeability):

    . [ISO 9126]. . .

  • (measurement):

    . [ISO 14598] (instrumenter): . (isolation testing):

    , .

    (learnability):

    . [ISO 9126] . . ( IDEAL) (Learning (IDEAL)): IDEAL, ,

    . : , . . IDEAL.

    (concrete test case): . . (simulator): , ,

    , . [IEEE 610, DO178b] . .

    (simulation):

    . [ISO 2382/1] (indicator): ,

    . [ISO 14598] (performance indicator):

    / , . , . [CMMI]

    (test performance indicator):

    / , , , .

    ( IDEAL) (Initiating (IDEAL)): IDEAL,

    . : , . . IDEAL.

    (incremental development model):

    , , . . ( ) V- , .

  • (incremental testing): , , .

    (inspector): . . (inspection): ,

    . , . . [IEEE 610, IEEE 1028]. . .

    (test execution tool): ,

    , - /. [Fewster Graham]

    (dynamic analysis tool): ,

    . , , , .

    / (record/playback tool): . /. / (capture/playback tool): ,

    , (.., ). .

    / (capture/replay tool): . /. (security tool): , . (coverage measurement tool): . . (modelling tool): , ,

    . [Graham] (monitoring tool): . . (load testing tool): .

    . (debugging tool): ,

    , . .

    (defect tracking tool): C. .

  • (bug tracking tool): . . (test data preparation tool): ,

    , , , .

    (fault seeding tool): (..,

    ) . (error seeding tool): . . (coverage tool): , ,

    (, ) .

    (hyperlink tool, hyperlink test tool): ,

    - . (test design tool): ,

    , CASE (, ); , , .

    (review tool): , .

    : , , .

    (static analysis tool): . . (stress testing tool):

    . (test tool): ,

    , , , , . [TMap] . CAST.

    (security testing tool):

    . (performance testing tool):

    , : . . , . .

  • (defect management tool): , , . - , , . . .

    (incident management tool): ,

    . , , , , . . .

    (configuration management tool): ,

    , , , .

    (test management tool): ,

    . : , , , , .

    (requirements management tool): ,

    , (..: , ) , . , , .

    (integration testing): ,

    . . , .

    (integration testing in the small): .

    . (integration testing in the large): .

    . (integration): . (CMMI) (Capability

    Maturity Model Integration (CMMI)): , . CMMI , . CMMI CMM. [CMMI]. . (CMM).

  • (TMMi) [Capability Maturity Model Integration (CMMI)] (Test Maturity Model Integrated (TMMi)): , (CMMI) .

    (unit test framework): ,

    , , . . [Graham]

    (test infrastructure): ,

    , , , .

    (incident): , . [IEEE 1008] (software test incident): . . (resource utilization):

    (, , ..) . [ISO 9126] . .

    (exploratory testing): ,

    , , . [Bach]

    (outcome): . . (condition outcome): . (exhaustive testing): ,

    . (iterative development model):

    , . , ( ) , , .

    (test outcome): . . (retrospective meeting): ,

    , .

  • (test summary report): , , . [IEEE 829]

    (balanced scorecard):

    . . , .

    (risk category): . . (software quality):

    . (equivalence class): . . (defect taxonomy): ,

    . (bug taxonomy): . . (key performance indicator): .

    . (code): ,

    , . [IEEE 610] (comparator): . . (compiler): , ,

    , . [IEEE 610] (test set): . . (component): ,

    . (component testing):

    [ IEEE 610]. (finite state machine): ,

    , . [IEEE 610]

    (version control): . .

  • (change control): . . (configuration control): ,

    , , , . [IEEE 610]

    (risk control): ,

    .

    (test control): ,

    . . .

    (configuration testing): . . (configuration): , ,

    . (Charter): . . (Test charter): , ,

    . . . .

    (moderator): ,

    . (commercial off-the-shelf software): .

    . (corporate dashboard):

    . . , .

    (CTP): . . (resumption criteria): ,

    . [IEEE 829] (entry criteria):

    , , . - , () , . [Gilb and Graham]

    (exit criteria): ,

    , , . - , , .

  • , , . [Gilb and Graham].

    (completion criteria): . . (test completion criteria): . . (acceptance criteria): ,

    , , , . [IEEE 610]

    (suspension criteria): , ()

    , . [IEEE 829] / (pass/fail criteria): ,

    . [IEEE 829] (critical testing processes):

    , . , , .

    (severity):

    . [IEEE 610]

    (Software Usability Measurement Inventory):

    , . [Veenendaal04]

    (logical test case): . . (false-negative result): . . (false-fail result): ,

    , . (false-pass result): ,

    , . (false-positive result): . .

    Agile (agile manifesto): . .

  • (agile manifesto): ,

    . :

    ,

    ,

    ,

    ,

    (test process improvement manifesto): , Agile :

    ()

    . [Veenendaal08] (defect masking): ,

    . [IEEE 610] (fault masking): . . (installation wizard): ,

    . , .

    (scalability):

    . [Gerrard] (measure): , .

    [ISO 14598] (dead code): C. . (white-box technique): . . (test execution technique): ,

    - . (classification tree method): ,

    , , / . [Grochtmann]

    (value-based quality): ,

    . ( ) ( ), . , . [ ] .

  • , , , .

    (product-based quality): ,

    . . . [Garvin] . , , , , .

    (manufacturing-based quality): ,

    . (). [ ] . , , , .

    (transcendent-based quality):

    , , , , , . . [ ] . , , , .

    (user-based quality): ,

    , (). , . , , . [ ] . , , , .

    (test design technique): , /

    . (test specification technique): .

    . (specification-based technique): .

    . (specification-based test design technique): .

    .

  • (test case design technique): . .

    (test technique): . . " " (big-bang testing): ,

    , , , . [ IEEE 610] . .

    (black box technique): . . (defect based technique): .

    . (experienced-based technique): .

    . (functional test design technique):

    / , . . .

    (experienced-based test design technique):

    / , , .

    (defect based test design technique):

    / , , . . .

    , (structure-based technique): .

    . (metric): , [ISO 14598] (Chow's coverage metrics): . N . [Chow] (multiple condition): . . IDEAL (IDEAL): ,

    , . IDEAL , : (initiating), (diagnosing), (establishing), (acting), (learning) : .

    (maturity model): ,

    ,

  • . , .

    (CMM) (Capability Maturity

    Model ()): , . , . [CMM] . (CMMI).

    (TMM) [Capability Maturity Model (CMM)] (Test Maturity Model

    (TMM)): , (CMM) .

    (EFQM excellence model): (

    ): , , "" (, ) (, ).

    (content-based model): ,

    , , .. (process model): ,

    . , . (reliability growth model): ,

    , , .

    (modified multiple condition coverage): .

    . (modified condition decision coverage): .

    . (modified multiple condition testing): .

    . (modified condition decision testing): .

    . (module, unit): . . (module testing, unit testing): . . (monitor): ,

    , / . [IEEE 610]

  • (test monitoring): ,

    . . . .

    (test case suite): . . (test suite): ,

    .

    (load test): ,

    , / , . . , .

    (reliability):

    , . [ISO 9126]

    (fail): ,

    . (negative testing): , ,

    . , , - .

    (unreachable code): , . (infeasible path): ,

    . (fault): . . (independence of testing): ,

    . [DO-178b] (continuous representation):

    , . [CMMI]

    (test fail): . .

  • (non-conformity): . [ISO 9000] (informal review): ,

    () . (non-functional testing):

    , , , , , .

    (non-functional requirement): ,

    , , , , .

    (non-functional test design techniques):

    , . . .

    (regulation testing): . .

    (input domain): , .

    . . (output domain): ,

    . . . (exception handling):

    , , - .

    (Total Quality Management):

    , , , . , , , . [ ISO 8402]

    (test object): , .

    . . (volume testing): ,

    . . . (expected outcome): . .

  • (expected result): , .

    (statement): ,

    . (source statement): . . (data definition): ,

    . (risk identification):

    , . (oracle): . . (orthogonal array): ,

    , , .

    (instrumentation):

    . , .

    (failure): ,

    . [Fenton] (deviation): C. . (debugging): , ,

    . (debugger): . . - (cause-effect graphing):

    , - . [BS 7925/2]

    (defect report): ,

    , . [IEEE 829]

    (test item transmittal report): .

    . (bug report): . . (problem report): . . (test report): . .

  • (test progress report): , ,

    (, ) , .

    (deviation report): C. . (assessment report): , , ,

    , . . . (incident report): , , ,

    , , . [ IEEE 829] (software test incident report): .

    . (TQM): . . (evaluation): . . (test estimation): ,

    (, , , , , ..), , .

    (process assessment):

    . [ISO 15504] (functionality testing):

    . (scorecard):

    . . . , .

    (scorecard): . . (error): , . [IEEE 610]

    (storage): . . "-" (definition-use pair):

    . , , (, ) ( ).

  • (pair programming): ,

    ( ) . .

    (pair testing): ( , ,

    ), . , .

    (root cause): ,

    , . [CMMI] (best practice): ,

    , "" .

    (variable): , . (portability): ,

    . [ISO 9126] (buffer overflow):

    , , . . .

    (state transition): . (test improvement plan):

    , . [ CMMI]

    (test plan): , , ,

    . , , , , , , , , , . [IEEE 829]

    (project test plan): . . (phase test plan): ,

    . . . (test planning):

    .

  • (defect density): , , ( , , ).

    (fault density): . . (behavior): . (time behavior): . . (re-testing): ,

    , , .

    (subpath): . (fault seeding):

    , , , . [IEEE 610]

    (error seeding): . . (confirmation testing): . . (test approach):

    . , () , , , , , .

    (coverage): , ,

    . LCSAJ (LCSAJ coverage): [LCSAJs] ,

    . 100% [LCSAJ] 100% . N (N-switch coverage): N+1 ,

    . [Chow] (decision coverage): ,

    . .

    (branch coverage): , . 100%

    100% 100% . (boundary value coverage): ,

    .

  • (code coverage): , , () , , , , .

    (condition combination coverage): .

    . (branch condition combination coverage): .

    . (multiple condition coverage):

    , . .

    (statement coverage): ,

    , . (condition determination coverage):

    , , . 100% 100% .

    (data flow coverage): "-",

    . (path coverage): ,

    . 100% 100% LCSAJ. (condition coverage): ,

    . 100% , .

    (decision condition coverage):

    , . .

    (branch condition coverage): . . (equivalence partition coverage):

    , . (test policy): , ,

    . (complete testing): . . (user test): ,

    .

  • (user acceptance testing): .

    . (user scenario testing): .

    . (bug): . . (understandability):

    , , . [ISO 9126] . .

    (pairwise testing): ,

    , . . .

    (deliverable): () , -,

    () . - (post-project meeting): . . (postcondition): ,

    . (data flow):

    , : , . [Beizer]

    (control flow): ()

    . (usability): ,

    . [ISO 9126]

    (error guessing): ,

    , , .

    (predicted outcome): . . (pretest): . . (precondition): ,

    .

  • (attractiveness): . [ISO 9126] . .

    (acceptance): . . (suitability):

    . [ISO 9126] . .

    (acceptance testing):

    , , , , . [ IEEE 610]

    (priority): , . , . (adaptability):

    , , .[ISO 9126] . .

    (test objective): . - (cause-effect diagram): ,

    . , () . ( Juran)

    (causal analysis): . [CMMI] (problem): . . (exercised): ,

    , , , , .

    (checker): . . (test run): . (software attack): . . (software): , , ,

    , . [IEEE 610] (program instrumenter): . .

  • (project): , , , . [ISO 9000]

    (test design):

    1. . . 2.

    . (pass): ,

    . (performance): ,

    . [IEEE 610] . .

    (production acceptance testing): .

    . (elementary comparison testing):

    , , . [TMap]

    (mistake): . . (test run log): . . (test log): ,

    . [IEEE 829] (test logging):

    . (performance profiling):

    , . , , , . . , .

    (load profile): ,

    . , . . .

    (test pass): . . (test procedure): . .

  • (Defect Detection Percentage (DDP)): , , , , .

    (Fault Detection Percentage (FDP)): .

    . (process): ,

    . [ISO 12207] (Systematic Test and Evaluation Process):

    , - . () . . .

    (test process):

    , , , , .

    (bebugging): . . [Abbott] (pseudo-random): , ,

    . (STEP): . . (path): (, )

    . (audit trail): , (,

    ) , . . [ TMap]

    (control flow path): . .

    (operability):

    . [ISO 9126] . . (operational environment): ,

    , . , .

  • (peer review): , - . : , .

    (walkthrough): ,

    . [Freedman and Weinberg, IEEE 1028] . .

    (test driven development):

    , , , , .

    (white box test design technique):

    .

    (black box test design technique):

    / , .

    (test execution schedule): .

    , , .

    (test implementation):

    , , , .

    (recorder): . (incident logging): , ,

    , . (regression testing): ,

    , , . .

    (result): . ,

    , , . . , .

    (decision outcome): (, ,

    , ). (test result): . .

  • (project retrospective): .

    (reviewer): ,

    , . , .

    (review):

    . : , , , .

    (critical success factor): ,

    . , . . .

    (risk): , ,

    . (product risk): , . . . (project risk): ,

    . : , , , .. . .

    - (dd-path (decision-decision)): (

    , , -), -, , .

    (inspection leader): . . (test manager): ,

    , . , , , .

    (installation guide): ,

    . , " ", .

    (desk checking):

    . . .

    (MTBF): . .

  • (ad hoc review): . . (ad hoc testing): , ;

    , , .

    (Dashboard):

    , , , , , , , . . , .

    (feature): ,

    (, , ). [IEEE 1008]

    (software feature): . . (MTTR): . . (WBS): . . (scribe): , ,

    , . .

    (certification): , ,

    , , . (test session): ,

    . , . . . .

    (syntax testing): ,

    / .

    (system): ,

    . [IEEE 610] (safety critical system): ,

    , , , .

    (system of systems): ,

    ,

  • , .

    (system integration testing):

    , ( ..).

    (system testing):

    , . [Hetzel] (SCRUM): ,

    . . .

    (complexity): , /

    , . . .

    (risk mitigation): . . (Software Process Improvement): ,

    . [ CMMI]

    (TPI) (Test Process Improvement (TPI)):

    , , .

    (codependent behavior):

    , () . , , - , .

    ( IDEAL) (establishing (IDEAL)): IDEAL,

    , . : , . . IDEAL.

    (compliance): ,

    . [ISO 9126] (release note): , ,

    , , . [IEEE 829]

    (item transmittal report): . .

  • (maintainability):

    , , . [ISO 9126]

    (maintenance):

    , . [IEEE 1219]

    (compound condition): ,

    (, , ), 'A>B C>1000'. (co-existence):

    , . [ISO 9126] . .

    (test process improver): ,

    .

    (specification): , ( - ,

    ) , , . .

    (component specification):

    , (, ).

    (test design specification): ,

    ( ) , , . [IEEE 829]

    (test procedure specification): ,

    . . [IEEE 829]

    (test specification): ,

    , / . (test case specification): ,

    - , , , .

    (SPI): . . (TPI): . . (post-execution comparison):

    , .

  • (back-to-back testing): ,

    , .

    (Mean Time Between Failures):

    . , , , , , . . .

    (Mean Time Between Failures): .

    . (Mean Time To Repair): ,

    . , , .

    (stability):

    . [ISO 9126] . . (test stage): . . (standard): , , ,

    (, ISO / IEC , IEEE ). [ CMMI]

    (statistical testing): ,

    . . .

    (static analysis): ,

    , . .

    (static code analysis): ,

    . (static analyzer): , . (static code analyzer): ,

    . , , .

    (static testing):

    , .

  • (cost of quality): , , , .

    (site acceptance testing):

    . -, . , .

    (test strategy): ,

    , , , .

    (stress testing): ,

    , , . [IEEE 610] . , .

    (Work Breakdown Structure):

    . (structure-based test design technique): .

    . (structural coverage): ,

    . (structural testing): . . (structural test design technique): .

    . (structured walkthrough): . . (staged representation): ,

    . . [CMMI]

    (test scenario): . . (use case):

    , , , .

    - (cause-effect decision table): . .

  • (decision table): , /

    / (), .

    (state table): ,

    , , .

    (test): . [IEEE 829] " " (smoke test): ,

    . , , . " " . . .

    (confidence test): . " ". (sanity test): . " ". (testing): , ,

    , , , , , , .

    " " (top-down testing):

    , , . , . . .

    LCSAJ (LCSAJ testing): ,

    LCSAJ. N (N-switch testing): ,

    N+1 . [Chow]. . .

    [TMap] (algorithm test [TMap]): . . (safety testing):

    . - (process cycle test): ,

    - . [TMap]. . .

  • (maintenance testing): .

    (field testing): . -. (branch testing): ,

    . (thread testing): ,

    , .

    (interoperability testing):

    . . .

    (recoverability testing): ,

    . . . (boundary value testing): . . (documentation testing): ,

    . (accessibility testing): , ,

    . [Gerrard]

    (arc testing): . . (security testing):

    . . (component integration testing): ,

    .

    (interface testing): ,

    . (storage testing): . . (resource utilization testing): ,

    . . .

    (branch condition combination testing): .

    .

  • (condition combination testing): . .

    (scalability testing):

    . (white box testing): ,

    . (finite state testing): .

    . (clear box testing): .

    . (black box testing): ,

    , . (migration testing): . . (multiple condition testing):

    , ( ).

    (mutation testing): . . (design-based testing): ,

    / (, ).

    - (business process-based testing): ,

    / -.

    (data driven testing):

    , , , . , /. [Fewster Graham] C. .

    (keyword driven testing): ,

    , . : , , , , , , , , . [Fewster and Graham]

    - (checklist-based testing): ,

    , . ,

  • , , , . . 1.

    (action word driven testing): .

    . (session-based testing): ,

    , .

    (specification-based testing): .

    . (structurebased testing): .

    . (scenario testing): .

    . (requirements-based testing): ,

    , ; , , .

    (standards testing): . . (reliability testing): ,

    . (invalid testing): ,

    , . . , .

    (statement testing): ,

    . (condition determination testing):

    , , .

    (code-based testing): . . (logic-driven testing): .

    . (portability testing):

    .

    1 .

  • (use case testing):

    , . (logic-coverage testing): .

    .[Myers] (data flow testing): ,

    "-" .

    (usability testing):

    , , . [ISO 9126]

    (conversion testing): ,

    .

    (suitability testing):

    . (program testing): . . (glass box testing): . . (performance testing):

    . . . (path testing): ,

    . (development testing): ,

    , . [IEEE 610]

    (recovery testing): . . (decision testing): ,

    . (orthogonal array testing):

    . . . .

    (link testing): . . (partition testing): . . [Beizer]

  • (compatibility testing): . .

    (concurrency testing): ,

    ( ) . [ IEEE 610]

    (compliance testing):

    . (conformance testing): . . (maintainability testing):

    . (state transition testing):

    , . . N .

    (decision table testing): ,

    / , . [Veenendaal]. . .

    (accuracy testing ):

    . (serviceability testing): . . (condition testing): ,

    . (decision condition testing):

    , .

    (robustness testing): ,

    . (operational profile testing): ,

    ( ) . [Musa]

    (database integrity testing):

    , , , , , , , .

    (data integrity testing): .

    .

  • (efficiency testing): .

    , (risk-based testing):

    . , .

    (procedure testing): , ,

    - .

    (tester): ,

    . (testability):

    . [ISO 9126] . . (test record): . . (test harness): , ,

    . (test deliverable): () ,

    - , () . . . (test situation): . . (testware): ,

    , . : , , , , , , , , . [Fewster and Graham]

    (test environment): , ,

    , , , . [IEEE 610]

    (test coverage): . . (test comparison): ,

    , . ( ), .

    (test requirement): . .

  • (test condition): , . : , , , .

    (test data): , (, )

    , .

    (test generator): . . (test driver): . . (test incident): . . (test comparator): ,

    . (test incident report): . . (test oracle): ,

    , . ( ), , , . [Adrion]

    (test bed, test rig): . . (test case): , ,

    , , . [IEEE 610]

    (high level test case): (

    ) . , / . . .

    (low level test case): (

    ) . , . . .

    (testable requirements): ,

    (, , ) . [IEEE 610]

  • (technical review): , , . [Gilb and Graham, IEEE 1028] C. .

    (failure mode): . ,

    , . [IEEE 610]

    (risk type): , ,

    , , , . , ( ) . , .

    (test type): ,

    , , , , .. . [TMap]

    (standard software): . . (entry point): , ,

    . (exit point): , ,

    . (accuracy):

    . [ISO 9126] . .

    ( ) (transactional analysis): ()

    ; () . () - .

    (traceability):

    , , . . , .

    (requirement): ,

    , , , , . [IEEE 610]

  • (pointer): , . , ,

    . [IEEE 610] (defect management): , ,

    . , . [IEEE 1044]

    (change management):

    (1) , .

    (2) .

    . . (incident management): , ,

    . , . [IEEE 1044]

    (configuration management): ,

    : , , , . [IEEE 610]

    (problem management): . . (risk management):

    , , . (test management): , ,

    , . (session-based test management):

    , , . (management review):

    , , , , , , , , . [IEEE 610, IEEE 1028]

    (maturity level):

    , . [TMMi]

  • (failure rate): , .. , , . [IEEE 610]

    (risk level): :

    . . (: , , ), .

    (test level):

    . . , , . [TMap]

    (level test plan): ,

    . . . (condition): , ,

    A>B. . . (branch condition): . . (process improvement): ,

    , . [CMMI]

    (installability):

    . [ISO 9126]. . . (installability testing):

    . . . (robustness): ,

    . [IEEE 610] . , .

    (error tolerance):

    , . [IEEE 610]

    (fault tolerance):

    () . [ISO 9126] . , .

    (memory leak): ,

    , , , / - .

  • (status accounting): , , . , , . [IEEE 610]

    (test execution phase):

    , , . [IEEE 610]

    (test phase): ,

    , , . [Gerrard] (actual outcome): . . (actual result):

    . (formal review): ,

    , , . (functional integration): ,

    . . .

    (functional testing): ,

    . . .

    (functional requirement): , ,

    . [IEEE 610] (functionality): ,

    , . [ISO 9126]

    (operational profile): ,

    , , . , , .

  • (monkey testing): , , , .

    (software quality characteristic): .

    . (software product characteristic): .

    .

    (GQM): . --. (consistency): ,

    . [IEEE 610] (test target): . -- (Goal Question Metric):

    :

    ()

    ()

    () (Deming cycle): , 4 :

    , , , . [ ].

    (test cycle):

    . (cyclomatic complexity): .

    : L - N + 2P, L - / ; N - ; P - (, ). [McCabe]

    (Wide Band Delphi):

    , .

    (measurement scale): , ,

    . [ISO 14598]

  • (quality gate): . , . .

    (heuristic evaluation):

    ( "").

    (equivalence partition): ,

    , , .

    (equivalence partitioning): ,

    . , .

    (assessor): , ;

    . (operational acceptance testing):

    , / , (, ), . , , , . . .

    (operational testing): ,

    . [IEEE 610] (extreme programming):

    , , : , , . . .

    (configuration item): /

    , . [IEEE 610]

    (coverage item): ,

    , . (test item): , .

    . . .

  • (emotional intelligence): , ,

    . (emulator): , ,

    , [IEEE 610]. . .

    (benchmark test):

    (1) , . (2) ,

    , (1). [ IEEE 610] (requirements phase): ,

    . [IEEE 610]

    (probe effect): ,

    (, ) . : .

    (efficiency):

    , . [ISO 9126]

    (scripting language): ,

    (, /).

  • ()

    , :

    [Abbott] J. Abbot (1986), Software Testing Techniques, NCC Publications.

    [Adrion] W. Adrion, M. Branstad and J. Cherniabsky (1982), Validation, Verification and Testing of Computer

    Software, in: Computing Surveys, Vol. 14, No 2, June 1982.

    [Bach] J. Bach (2004), Exploratory Testing, in: E. van Veenendaal, The Testing Practitioner 2nd edition, UTN

    Publishing, ISBN 90-72194-65-9.

    [Beizer] B. Beizer (1990), Software Testing Techniques, van Nostrand Reinhold, ISBN 0-442-20672-0

    [Chow] T. Chow (1978), Testing Software Design Modelled by Finite-Sate Machines, in: IEEE Transactions on

    Software Engineering, Vol. 4, No 3, May 1978.

    [CMM] M. Paulk, C. Weber, B. Curtis and M.B. Chrissis (1995), The Capability Maturity Model, Guidelines for

    Improving the Software Process, Addison-Wesley, ISBN 0-201-54664-7

    [CMMI] M.B. Chrissis, M. Konrad and S. Shrum (2004), CMMI, Guidelines for Process Integration and

    Product Improvement, Addison Wesley, ISBN 0-321-15496-7

    [Deming] D. W. Edwards (1986), Out of the Crisis, MIT Center for Advanced Engineering Study, ISBN 0-

    911379-01-0

    [Fenton] N. Fenton (1991), Software Metrics: a Rigorous Approach, Chapman & Hall, ISBN 0-53249-425-1

    [Fewster and Graham] M. Fewster and D. Graham (1999), Software Test Automation, Effective use of test

    execution tools, Addison-Wesley, ISBN 0-201-33140-3.

    [Freedman and Weinberg] D. Freedman and G. Weinberg (1990), Walkthroughs, Inspections, and Technical

    Reviews, Dorset House Publishing, ISBN 0-932633-19-6.

    [Garvin] D.A. Garvin (1984), What does product quality really mean?, in: Sloan Management Review, Vol.

    26, nr. 1 1984

    [Gerrard] P. Gerrard and N. Thompson (2002), Risk-Based E-Business Testing, Artech House Publishers, ISBN

    1-58053-314-0.

    [Gilb and Graham] T. Gilb and D. Graham (1993), Software Inspection, Addison-Wesley, ISBN 0-201-63181-4.

    [Graham] D. Graham, E. van Veenendaal, I. Evans and R. Black (2007), Foundations of Software Testing,

    Thomson Learning, ISBN 978-1-84480-355-2

  • [Grochtmann] M. Grochtmann (1994), Test Case Design Using Classification Trees, in: Conference

    Proceedings STAR 1994.

    [Hetzel] W. Hetzel (1988), The complete guide to software testing 2nd edition, QED Information Sciences,

    ISBN 0-89435-242-3.

    [Juran] J.M. Juran (1979), Quality Control Handbook, McGraw-Hill

    [McCabe] T. McCabe (1976), A complexity measure, in: IEEE Transactions on Software Engineering, Vol. 2,

    pp. 308-320.

    [Musa] J. Musa (1998), Software Reliability Engineering Testing, McGraw-Hill Education, ISBN 0-07913-271-

    5.

    [Myers] G. Myers (1979), The Art of Software Testing, Wiley, ISBN 0-471-04328-1.

    [TMap] M. Pol, R. Teunissen, E. van Veenendaal (2002), Software Testing, A guide to the TMap Approach,

    Addison Wesley, ISBN 0-201-745712.

    [Veenendaal04] E. van Veenendaal (2004), The Testing Practitioner 2nd edition, UTN Publishing, ISBN 90-

    72194-65-9.

    [Veenendaal08] E. van Veendaal (2008), Test Improvement Manifesto, in: Testing Experience, Issue 04/08,

    December 2008

  • ( )

    ,

    .

    :

    ;

    ( 2.1);

    ;

    ,

    .

    [email protected].