software testing metrics formulas

Upload: saim123

Post on 03-Jun-2018

218 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/12/2019 Software Testing Metrics Formulas

    1/4

    Sl No Metric Formula

    1 Requirement Stability Index (Number of Original Baseline Requirements + Number of Baseline Requirementschanged + Number of New Requirements added to Baseline Requirements +number of baseline requirements deleted) / (Number of Original BaselineRequirements)

    2 Test Design Coverage ((# of requirements covered in test design by QA/Scope of the Requirements to be covered as mentioned in Test plan (after finalizing any Risk Based approach))* 100)

    3 Test Execution Coverage ((Total Number of test cases or scenarios executed (Pass + Fail)/ Total Numberof test cases or scenarios planned to execute)*100)

    4 Test Effectiveness ((Number of defects identified during QA testing phase - Number of invaliddefects) / (Number of defects identified during testing phase + Number ofCritical and High Severity defects found in Production))*100

    5 Defect Re-open Rate ((Number of Defects Reopened after fix / Total Number of Defects Fixed ) *100)

    6 Defect Discovery Rate ((Total number of defects found / Number of Test Cases executed) * 100)

    7 Defect Aging by Priority ((Detected on Date- Closing date of Defects with status as Closed, Rejected,Duplicate & Deferred) or (Detected On Date- Current date for any other status))

  • 8/12/2019 Software Testing Metrics Formulas

    2/4

    8 Test Design Productivity (Number of Test Cases prepared) / (Effort spent for Test Case Preparation)

    9 Test Execution Productivity (No of Test Cases executed) / (Effort spent for Test Case Execution)

    10 Production Defect Leakage Critical Severity Production Defect Leakage: ((number of Critical Severitydefects unidentified during testing phase but found in production/ (number ofdefects unidentified during testing phase but found in production + total numberof valid defects identified during testing phase))*100

    11 Test Plan Coverage onFunctionality

    (No of requirements covered / total number of requirements) * 100Example: Total number of requirements estimated are 46, total number ofrequirements tested 39, and uncovered 7

    12 Test Case defect density (Defective Test Scripts/Total Test Scripts) * 100Example: Total test script developed 1360, total test script executed 1280, totaltest script passed 1065, and total test script failed 215.

    So, test case defect density is215 X 100

    ---------------------------- = 16.8%1280

    13 Defect Slippage Ratio Number of Defects Slipped (i.e. reported from production) / (Number ofDefects Raised - Number of Defects Withdrawn) * 100Example: Customer filed defects are 21, total defect found while testing are267, total number of invalid defects are 17.

    So, Slippage Ratio is [21/ (267-17)] X 100 = 8.4%

  • 8/12/2019 Software Testing Metrics Formulas

    3/4

    14 Requirement Volatility (Number of Requirements Added + Deleted + Modified) *100 / Number ofOriginal Requirements.

    Ensure that the requirements are normalized or defined properly while estimatingExample: AO Auto claims v1.3 release had total 67 requirements initially, laterthey added another 7 new requirements and removed 3 from initial requirementsand modified 11 requirements.

    So, requirement Volatility is (7 + 3 + 11) * 100/67 = 31.34%Means almost 1/3 of the requirement changed after initial identification.

    15 Review Efficiency The Review Efficiency is a metric that offers insight on the review quality andtesting.

    Some organization also use this term as Static Testing efficiency and theyare aiming to get min of 30% defects in static testing.

    Review efficiency=(Total number of defects found by reviews/Total numberof project defects) * 100

    Example: A project found total 269 defects in different reviews, which werefixed and test team got 476 defects which were reported and valid.

    So, Review efficiency is [269/(269+476)] * 100 = 36.1%

    16 Defect Removal Effectiveness DRE= (Defects removed during development phase/ Defects latent in theproduct) * 100

  • 8/12/2019 Software Testing Metrics Formulas

    4/4

    Where defects latent in the product = Defects removed during development

    Phase+ defects found later by user

    17 ROI

    (Consider acquisition costs,hardware costs, labour costs,training costs)

    (Gains Investment costs)/ Investment costs