test case point estimation

21
Page 1 of 21 <Customer Name> <Project Name> Test Case Point Estimation Template 8.1.0 Reviewed By Approved By Name Role Signature Date Project ID: <Project ID> <SCI.ID> / Ver: <No.> Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Prepared By / Last Updated By Controlled copy Controlled copy Controlled copy Controlled Copy

Upload: pingdeepti

Post on 22-Nov-2014

476 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: Test Case Point Estimation

Page 1 of 20

<Customer Name><Project Name>

Test Case Point Estimation Template

8.1.0

Reviewed By Approved By

NameRoleSignatureDate

Project ID: <Project ID> <SCI.ID> / Ver: <No.>

Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected

Prepared By / Last

Updated By

Controlled copyControlled copyControlled copyControlled Copy

Page 2: Test Case Point Estimation

Page 2 of 20

Workbook Contents

Guidelines to complete the TCP estimation template

1. The classification of test requirements into Simple, Average and Complex will be based ona. Test requirement complexity ORb. Interface with other requirements ORc. No. of verification points ORd. Baseline Test data

2. Factor weight denotes the complexity of the factor with respect to the project. This value will vary from 0 to 10 only. For e.g. if the project is on a mainframes domain with various communication protocols, this could be assigned 10. Or if we have a system that requires to be tested on an Win95 OS but is an IVR(Interactive Voice Recognition) system, the Technical Know-how could be 10.

3. The complexity weight takes into count the expertise that we have and the amount of complexity that we foresee in the project due to this factor. This value will vary from 0 to 3 only.For. e.g. taking the same 2 examples as above…if we do not have any prior experience in the field of mainframe testing the complexity would now be assigned 3Or if the same IVR system was coming in for a new release testing(the prior release having been tested by us) the Technical Know-how complexity would be assigned 1 or 2

4. To calculate the Total Person Hrs for each of the following activities, add as many factors as required. All those factors that will affect the effort estimate must be included.A sample set of most probable factors have already been listed in the template, these can be retained/deleted as per project requirements.a. Test case generationb. Manual execution

Test Case Point Estimation Template - ReadMe <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

ReadMe sheet - Contains simple guidelines for using TCP methodologyMetrics per Project sheet - All projects using TCP methodology for estimation should complete this sheet. This will be used for further analysis and benchmarking.Sample sheet - Contains a sample project effort estimation for reference.Worksheet - Can be used for listing the functionality and classifying the Test requirements into Simple/Average/Complex

TCP Framework - Contains the template for TCP methodology implementation.Effort Break-up - Details of various project phases and the effort expended on each phase. Relevant values have been picked up from the Template sheet.Effort Summary - Phase-wise Effort Summary. All values have been picked up from the Effort Break-up sheet.

Page 3: Test Case Point Estimation

Page 3 of 20

Test Case Point Estimation Template - ReadMe <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

5. Guidelines for Test Requirement classification:a. Any verification point containing a calculation is considered 'Complex'b. Any verification point which interfaces with or interacts with another application is classified as 'Complex'c. Any verification point consisting of a report verification is considered as 'Complex'd. A verification point comprising a Search functionality may be classified as 'Complex' or 'Average' depending on the complexity

6. The Effort Estimation for Manual Test execution that is calculated in the TCP sheet is only for a single round of end-to-end functionality testing. Additional effort needs to be added for Regression/Sanity/Smoke testing rounds.

7. During effort estimation, apart from the effort calculation for the 4 activities listed above(4a. - 4d.), effort estimation needs to be performed for the following project related activities:a. Initiation phase - System Study, Brainstorming sessions, Application walk-through with client, Knowledge Transfer sessions etcb. Preparation phase - Test Case Reviews, Re-work etc.c. Test execution phase - Defects reporting, tracking then to closure etcd. Closure phase - Test case updations, Test Report preparation etce. Project Management activities f. General activities - Telecons, Team Meetings, preparation of status reports etc

8. The Graph in the Effort Summary sheet will be automatically populated once the effort estimation is completed.

9. Effort Break-up Sheet - The Initiation Phase activities and the Management activities are considered to be ten percent of the total effort calculated in the Template sheet. This may be modified as per project requirements.

10. Effort Break-up Sheet - The Test Plan and Test Report activities have been assigned standard person days effort for Preparation, Review and Rework. This maybe modified based on project requirements.

11. Adjustment factor is calculated as below:Assume, X = Total person hours that is needed without being influenced by any external factors.Adjusted effort is needed when there is any impact because of some factors which will be calculated as some y% of X.So Total effort that will be required with the influential factors = X+(y% of X) = X(1+y)And hence 1+y will become the adjustment factor which is calculated in Row no 82 and 102.

Page 4: Test Case Point Estimation

Page 4 of 20

Effort Estimation Summary SheetPhase Effort in Person Days

Initiation Phase 0Preparation Phase 8Testing Phase 4Closure Phase 5Management Activities (All Phases) 0Total 18Total in Person Wks 3.6

Test Case Point Estimation Template - Effort Summary <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

0

8

4

5 0

Effort in Person Days

Initiation Phase

Preparation Phase

Testing Phase

Closure Phase

Management Activities (All Phases)

Page 5: Test Case Point Estimation

Page 5 of 20

Effort Estimation Detail SheetNote: Phase Effort in Person Days % of Parent Phase

Initiation Phase 0 10Estimation 0 25Knowledge Transfer 0 25Environment Setup 0 25 Non Editable FieldsSystem Study 0 25

Preparation Phase 8Test Plan 4

Preparation 2Review 1Rework 1

Test Scenarios 1 50Preparation 1 60Review 0 30Rework 0 10

Test Cases (may include Test Data preparation) 3Preparation 2 60Review 1 30Rework 0 10

Testing Phase 4Manual Testing 4

End-to-End Functionality Round 2Regression Round 1 50Sanity Round 0 10Defect Reporting 0 25Defect Retesting 0 5

Test Case Point Estimation Template - Effort Break-up <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

Please fill in the blanks (effort/person day) as per the project requirements

C4
Refer Read Me worksheet
B25
For Single OS-Browser combination
D26
Cells D26 - D29 are onfigurable according to project scenario.
Page 6: Test Case Point Estimation

Page 6 of 20

Test Case Point Estimation Template - Effort Break-up <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

Closure Phase 5Test Report 4

Preparation 2Review 1Rework 1

Test Deliverables - Test Scenarios 0 25% of Test Scen. Prep.Preparation 0 60Review 0 30Rework 0 10

Test Deliverables - Test cases 1 25% of Test Case Prep.Preparation 0 60Review 0 30Rework 0 10

Management Activities 0 10Team Meetings/Review Meetings 0 25Conf. Call with client/OC 0 25Test Management - Status Reporting, Allocation etc 0 25Project Management 0 25

Total in Person Days 18.2Total in Person Wks 3.6Total in Person Hours 145.3

Assumptions: * We assume 1 cycle of testing - inclusive of Functionality, Regression and Sanity testing* We assume testers will join the team on day 1 and no leaves are taken* We assume 0 delay from client for providing feedback / reviews. * We assume that the test server environment will be provided by the client* Actual effort may vary from estimated effort depending on actual no. of test cases* We assume there are no delays from Customer in requirements clarification* We assume test data will be supplied by the clients

Page 7: Test Case Point Estimation

Page 7 of 20

Test Effort Estimation

Project NameProject Id

Complexity of Test Requirements within the ModuleRequirement Classification Simple (1-3) Average (4-7) Complex (> 8) Totaltest 1 1test1 5 5test2 9 9

000000000000

Total 1 5 9 15

Test Requirements Classification

Complexity Type Complexity Baseline Test Data

Simple < 2 transactions 0 < 2 Not RequiredAverage 3-6 transactions <3 3-8 RequiredComplex > 6 transactions >3 >8 Required

Test Case Point Estimation Template - TCP Framework <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

Interface with other requirements

Number of verification points

Page 8: Test Case Point Estimation

Page 8 of 20

Test Case Point Estimation Template - TCP Framework <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

Requirement Type Complexity Weight Adjustment Factor Number ResultSimple 1 2 1 2Average 2 4 5 20Complex 3 8 9 72Total Test Case Points 94

Independent Adjustment Factors - OS and Browser CombinationsFactor Number Description Total No

F14 Operating System Combinations 1F15 Browser Combinations 1

F16 5%

Multiplication Factor for Manual Execution 1

Hours per PersonDay 8

Number of iterations for execution 1

Factor Number Description Factor Weight (vertical) Result

F1 Domain Knowledge & Complexity 0 0.00F2 Technical Know How 0 0.00

F3 0 0.00

F4 Multi-lingual Support 0 0.00F5 Software/Hardware Set Up 0 0.00F6 Environment Set Up 0 0.00

Estimate for Total Test Case Points ( Note: The Adjustment Factor in the table below is pre-determined and must not be changed for every project.)

Excecution Producitivity Improvement from second iteration onwards

Complexity Weight (Horizontal --> Impact)

Adjustment Factor

Integration with other Hardware devices such as Hand-held devices, Scanners, Printers

C44
This can be altered as this varies from Project to Project
Page 9: Test Case Point Estimation

Page 9 of 20

Test Case Point Estimation Template - TCP Framework <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

F7 Build Management 0 0.00F8 Configuration Management 0 0.00F9 Preparation of Test Bed 0 0.00F10 Stable Requirements 0 0.00F11 Offshore/Onsite Coordination 0 0.00F12 Test Data Preparation 0 0.00F13 Network Latency 0 0.00

ESTIMATE FOR TEST CASE GENERATIONTotal of Adjustment factorOther Factors - F1 Adjustment factor : 0.00Other Factors - F2 Adjustment factor : 0.00Other Factors - F3 Adjustment factor : 0.00Other Factors - F4 Adjustment factor : 0.00Other Factors - F10 Adjustment factor : 0.00Other Factors - F11 Adjustment factor : 0.00Other Factors - F12 Adjustment factor : 0.00Other Factors - F13 Adjustment factor : 0.00Total of Adjustment factor 0.00

Total Test Case Points (TCP ) 94Adjustment Factor 1.00Person Hours Per TCP 0.25Total Person Hours: 23.5

ESTIMATE FOR MANUAL EXECUTIONTotal of Adjustment factorOther Factors - F1 Adjustment factor : 0.00Other Factors - F2 Adjustment factor : 0.00Other Factors - F3 Adjustment factor : 0.00Other Factors - F5 Adjustment factor : 0.00

D83
Use Project Specific TCP Productivity here. Else use OLBM Productivity
Page 10: Test Case Point Estimation

Page 10 of 20

Test Case Point Estimation Template - TCP Framework <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

Other Factors - F6 Adjustment factor : 0.00Other Factors - F7 Adjustment factor : 0.00Other Factors - F8 Adjustment factor : 0.00Other Factors - F9 Adjustment factor : 0.00Other Factors - F10 Adjustment factor : 0.00Other Factors - F11 Adjustment factor : 0.00Other Factors - F13 Adjustment factor : 0.00Total of Adjustment factor 0.00

Total Test Case Points (TCP ) 94Adjustment Factor 1.00Person Hours Per TCP 0.17Total Person Hours for one OS/ Browser Combination: 15.67Total Person Hours for all required OS/ Browser Combination: 15.67 Total Person Hours for all iterations: 15.67

D103
Use Project Specific TCP Productivity Here. Else use OLBM Productivity
Page 11: Test Case Point Estimation

Page 11 of 20

Test Case Point Estimation Template - TCP Framework <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

OverallPerson Hours Person Days

Effort 39.17 5Duration in Weeks Duration in Months

Calendar Duration 1 0

Prepared by Reviewed By Approved ByNameDate

Page 12: Test Case Point Estimation

Page 12 of 20

Effort Estimation Detail SheetPhase Effort in Person Days % of Parent Phase

Initiation Phase 11 10Estimation 3 25Knowledge Transfer 3 25Environment Setup 3 25 Non Editable FieldsSystem Study 3 25

Preparation Phase 108Test Plan 4

Preparation 2Review 1Rework 1

Test Scenarios 35 50Preparation 21 60Review 10 30Rework 3 10

Test Cases (may include Test Data preparation) 69Preparation 41 60Review 21 30Rework 7 10

Testing Phase 80Manual Testing 80

End-to-End Functionality Round 43Regression Round 21 50Sanity Round 4 10Defect Reporting 11 25Defect Retesting 1 5

Test Case Point Estimation Template - Sample Effort Break-up <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

C4
Refer Read Me worksheet
B25
For Single OS-Browser combination
D26
Cells D26 - D29 are onfigurable according to project scenario.
Page 13: Test Case Point Estimation

Page 13 of 20

Test Case Point Estimation Template - Sample Effort Break-up <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

Closure Phase 30Test Report 4

Preparation 2Review 1Rework 1

Test Deliverables - Test Scenarios 9 25% of Test Scen. Prep.Preparation 5 60Review 3 30Rework 1 10

Test Deliverables - Test cases 17 25% of Test Case Prep.Preparation 10 60Review 5 30Rework 2 10

Management Activities 0 10Team Meetings/Review Meetings 0 25Conf. Call with client/OC 0 25Test Management - Status Reporting, Allocation etc 0 25Project Management 0 25

Total in Person Days 229.6Total in Person Wks 45.9Total in Person Hours 1837.1

Assumptions: * We assume 1 cycle of testing - inclusive of Functionality, Regression and Sanity testing* We assume testers will join the team on day 1 and no leaves are taken* We assume 0 delay from client for providing feedback / reviews. * We assume that the test server environment will be provided by the client* Actual effort may vary from estimated effort depending on actual no. of test cases* We assume there are no delays from Customer in requirements clarification* We assume test data will be supplied by the clients

Page 14: Test Case Point Estimation

Page 14 of 20

S.No. ProjectEstimated Effort (in manhrs)

Total EffortActual Effort (in manhrs)

Total Effort No. of Resources No. of Defects Issues

Sample Data ABC Project 106.72 81.43 188.15 112 166 278 2 40 232

1

S.No Phase # of TCPs

1 Design 240 2400 10

Test Case Point Estimation Template - Metrics per Project <Project Name>Release ID: QTDM-ESTITC / 8.1.0 / 17-Apr-10 C3: Protected Controlled CopyProject ID: <Project ID> <SCI.ID> / Ver: <No.>

Size of project (in TCPs)Test case

GenerationManual Execution

Test case Generation

Manual Execution

1. Actual efforts are restricted to 8hrs/day due to Timesheets format restriction2. One small module was tested in addition to what was estimated

# of Test Cases (Actual)

TCP/Test Case Ratio

Page 15: Test Case Point Estimation

Page 15 of 20

Test Effort Estimation

Project NameProject Id

Complexity of Test Requirements within the ModuleRequirement Classification Simple (1-3) Average (4-7) Complex (> 8) TotalLogin and Authentication 6 10 16Validate Customer 8 15 10 33Entering Claim 8 20 25 53Claim Pre-Qualification 10 15 25 50Claim Qualification 10 20 25 55Activation process 9 15 35 59

000000000

Total 51 95 120 266

Test Requirements Classification

Complexity Type Complexity Baseline Test Data

Simple < 2 transactions 0 < 2 Not RequiredAverage 3-6 transactions <3 3-8 RequiredComplex > 6 transactions >3 >8 Required

Test Case Point Estimation Template - Template <Project Name>Release ID: QTDM-ESTITC.xls / 8.06 / 02.12.2008 C3: Protected Controlled CopyProject ID:<Project ID.> <SCI.ID.> / Ver: <Ver No.>

Interface with other requirements

Number of verification points

Page 16: Test Case Point Estimation

Page 16 of 20

Test Case Point Estimation Template - Template <Project Name>Release ID: QTDM-ESTITC.xls / 8.06 / 02.12.2008 C3: Protected Controlled CopyProject ID:<Project ID.> <SCI.ID.> / Ver: <Ver No.>

Requirement Type Complexity Weight Adjustment Factor Number ResultSimple 1 2 51 102Average 2 4 95 380Complex 3 8 120 960Total Test Case Points 1442

Independent Adjustment Factors - OS and Browser CombinationsFactor Number Description Total NoF14 Operating System Combinations 1F15 Browser Combinations 1

F16 5%

Multiplication Factor for Manual Execution 1

Hours per PersonDay 8

Number of iterations for execution 1

Factor Number Description Factor Weight (vertical) Result

F1 Domain Knowledge & Complexity 10 3 30 1.00F2 Technical Know How 6 2 12 0.40

F32 0

0 0.00

Estimate for Total Test Case Points ( Note: The Adjustment Factor in the table below is pre-determined and must not be changed for every project.)

Excecution Producitivity Improvement from second iteration onwards

Complexity Weight (Horizontal --> Impact)

Adjustment Factor

Integration with other Hardware devices such as Hand-held devices, Scanners, Printers

C44
This can be altered as this varies from Project to Project
Page 17: Test Case Point Estimation

Page 17 of 20

Test Case Point Estimation Template - Template <Project Name>Release ID: QTDM-ESTITC.xls / 8.06 / 02.12.2008 C3: Protected Controlled CopyProject ID:<Project ID.> <SCI.ID.> / Ver: <Ver No.>

F4 Multi-lingual Support 2 0 0 0.00F5 Software/Hardware Set Up 2 1 2 0.07F6 Environment Set Up 3 1 3 0.10F7 Build Management 3 1 3 0.10F8 Configuration Management 5 1 5 0.17F9 Preparation of Test Bed 10 3 30 1.00F10 Stable Requirements 8 3 24 0.80F11 Offshore/Onsite Coordination 8 2 16 0.53F12 Test Data Preparation 10 3 30 1.00F13 Network Latency 8 2 16 0.53

ESTIMATE FOR TEST CASE GENERATIONTotal of Adjustment factorOther Factors - F1 Adjustment factor : 1.00Other Factors - F2 Adjustment factor : 0.40Other Factors - F3 Adjustment factor : 0.00Other Factors - F4 Adjustment factor : 0.00Other Factors - F10 Adjustment factor : 0.80Other Factors - F11 Adjustment factor : 0.53Other Factors - F12 Adjustment factor : 1.00Other Factors - F13 Adjustment factor : 0.53Total of Adjustment factor 0.53

Total Test Case Points (TCP ) 1442Adjustment Factor 1.53Person Hours Per TCP 0.25Total Person Hours: 552.766666666667

ESTIMATE FOR MANUAL EXECUTIONTotal of Adjustment factor

D83
Use Project Specific TCP Productivity here. Else use OLBM Productivity
Page 18: Test Case Point Estimation

Page 18 of 20

Test Case Point Estimation Template - Template <Project Name>Release ID: QTDM-ESTITC.xls / 8.06 / 02.12.2008 C3: Protected Controlled CopyProject ID:<Project ID.> <SCI.ID.> / Ver: <Ver No.>

Other Factors - F1 Adjustment factor : 1.00Other Factors - F2 Adjustment factor : 0.40Other Factors - F3 Adjustment factor : 0.00Other Factors - F5 Adjustment factor : 0.07Other Factors - F6 Adjustment factor : 0.10Other Factors - F7 Adjustment factor : 0.10Other Factors - F8 Adjustment factor : 0.17Other Factors - F9 Adjustment factor : 1.00Other Factors - F10 Adjustment factor : 0.80Other Factors - F11 Adjustment factor : 0.53Other Factors - F13 Adjustment factor : 0.53Total of Adjustment factor 0.43

Total Test Case Points (TCP ) 1442Adjustment Factor 1.43Person Hours Per TCP 0.17Total Person Hours for one OS/ Browser Combination: 343.02Total Person Hours for all required OS/ Browser Combination: 343.02 Total Person Hours for all iterations: 343.02

D103
Use Project Specific TCP Productivity Here. Else use OLBM Productivity
Page 19: Test Case Point Estimation

Page 19 of 20

Test Case Point Estimation Template - Template <Project Name>Release ID: QTDM-ESTITC.xls / 8.06 / 02.12.2008 C3: Protected Controlled CopyProject ID:<Project ID.> <SCI.ID.> / Ver: <Ver No.>

OverallPerson Hours Person Days

Effort 895.79 112Duration in Weeks Duration in Months

Calendar Duration 22 6

Prepared by Reviewed By Approved ByNameDate

Page 20: Test Case Point Estimation

Page 20 of 20

Change Log

Please note that this table needs to be maintained even if a Configuration Management tool is used.

Version Number Changes MadeV1.0.0 Initial baseline created on <dd-Mon-yy> by <Name of Author>

V 1.1.0

Page No. Changed By Effective Date Changes Effected