monitoring quality metrics to know when to ship
TRANSCRIPT
![Page 1: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/1.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Monitoring Quality Metrics to Know When to Ship
Seapine ALM Tour
Huntsville, Alabama
Peter VarholSolutions Evangelist, Seapine Software
![Page 2: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/2.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Agenda
• Why we don’t know when to ship
• How we can know when to ship
• Data, reports, and shipping
• Demonstration
• Really knowing when to ship
![Page 3: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/3.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
When the schedule tells us to
We All Know When to Ship
![Page 4: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/4.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
We All Know When to Ship
• The schedule isn’t a good metric for shipping
• We don’t know if the software is ready
• In fact,
• What does “ready to ship” really mean?
• And if we don’t know what it is, we can’t measure it.
![Page 5: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/5.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
We All Know When to Ship
• Ready to ship may mean:
• All features seem to be working properly
• Failures aren’t replicable
• We think it’s ready
• But there are more objective indicators:
• No P0 or P1 bugs
• New bug count is asymptotic
• All functional tests execute for 10 consecutive days
![Page 6: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/6.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
We All Know When to Ship
• Any definition will do:
• As long as it meets our needs
• And can be measured
• You need:
• A platform for data collection
• The ability to analyze data and create ongoing reports
• The ability to perform ad hoc queries
• The ability to share reports and data
![Page 7: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/7.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
We All Know When to Ship
![Page 8: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/8.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
We All Know When to Ship
• Data tells you when to ship
• You need reports on your data
• TestTrack provides a powerful facility for defining reports
• Built-in reports
• Custom reports
• Easily creatable
• Live charts
![Page 9: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/9.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Building Reports in TestTrack Pro
• Open versus Closed defects
• Defects by type
• Defects by priority
• Live charts
• Custom reports
![Page 10: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/10.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Open Versus Closed Defects
![Page 11: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/11.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Defects by Type
![Page 12: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/12.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Custom Reports
![Page 13: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/13.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Custom Reports
![Page 14: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/14.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Live Charts
• Live charts visually display information in real time:
• Within the TestTrack dashboard
• In a separate window
• Useful for:
• Sharing changing data across the team
• Focusing on the most important data
![Page 15: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/15.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Live Charts
![Page 16: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/16.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Summary
• Define your criteria for shipping
• Determine information you need about that criteria
• Generate reports and live charts
• Now you know when to ship
![Page 17: Monitoring Quality Metrics to Know When to Ship](https://reader036.vdocuments.us/reader036/viewer/2022062514/55822805d8b42a48108b4c55/html5/thumbnails/17.jpg)
© 2010 Seapine Software, Inc. All rights reserved.
Thank you