Download - Launching Successful Applications
![Page 1: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/1.jpg)
![Page 2: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/2.jpg)
Successful Applications
A systematic framework for launching successful applications
Chris K. ChewEnterprise Infrastructure TeamPearson eCollege
@chrischew
![Page 3: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/3.jpg)
Successful Applications
![Page 4: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/4.jpg)
Successful Applications
![Page 5: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/5.jpg)
Successful Applications
![Page 6: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/6.jpg)
Successful Applications
![Page 7: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/7.jpg)
Successful Applications
![Page 8: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/8.jpg)
Successful Applications
![Page 9: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/9.jpg)
Successful Applications
![Page 10: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/10.jpg)
Successful Applications
![Page 11: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/11.jpg)
Successful Applications
![Page 12: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/12.jpg)
Successful Applications
![Page 13: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/13.jpg)
Successful Applications
![Page 14: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/14.jpg)
Successful Applications
![Page 15: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/15.jpg)
Successful Applications
![Page 16: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/16.jpg)
Successful Applications
![Page 17: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/17.jpg)
Successful Applications
![Page 18: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/18.jpg)
Successful Applications
![Page 19: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/19.jpg)
Successful Applications
![Page 20: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/20.jpg)
Successful Applications
Launching Successful Applications
1. What To Count– Key Performance Indicators– KPI’s in software– Choosing your indicators
2. How To Count– Finding the right places to measure– Frameworks that can help
3. Count Out Load– Transparency builds goodwill– Advertising success creates momentum
4. When To Evolve Your Measurements
![Page 21: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/21.jpg)
Successful Applications
What To CountKey Performance Indicators
1
![Page 22: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/22.jpg)
Successful Applications
![Page 23: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/23.jpg)
Successful Applications
![Page 24: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/24.jpg)
Successful Applications
![Page 25: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/25.jpg)
Successful Applications
![Page 26: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/26.jpg)
Successful Applications
![Page 27: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/27.jpg)
Successful Applications
![Page 28: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/28.jpg)
Successful Applications
![Page 29: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/29.jpg)
Presentation Title runs here l 00/00/00
Key Performance Indicators
KPI’s are a small number of measurable objectives that will add the most value to the organization for the foreseeable future.
![Page 30: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/30.jpg)
Successful Applications
Key Performance Indicators
• Targeted towards your strategic goals
• Must be objectively knowable
• Each measurement must clearly add value to the organization
• Articulate which scenarios are included in each measurement
• The fewer the better
![Page 31: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/31.jpg)
Successful Applications
Key Performance Indicators
• Quantitative: Something that is a number
• Practical: Something that ties into existing business processes
• Directional: Specifying whether something is improving, trending
• Actionable: Identifying a problem that is within the organization's ability to change
• Comparative: Comparing yourself with a "peer universe", e.g. industry. Also referred to as “financial”
![Page 32: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/32.jpg)
Successful Applications
Key Performance Indicators
Etsy’s Indicators
• Quantitative: How many items were sold last month?
• Practical: How many new members signed up?
• Directional: Comparison from January 2011 and February 2010
• Actionable: Number of complaints or returned items?
• Comparative: What are ebay’s trends for the same month?
![Page 33: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/33.jpg)
Successful Applications
Key Performance Indicators In Software
KPI’s are a small number of measurable objectives that will add the most value to the organization your application for the foreseeable future.
![Page 34: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/34.jpg)
Successful Applications
Key Performance Indicators In Software
• Quantitative: Measure the occurrences and durations of activities and transactions
• Practical: Measuring strategically-targeted usage patterns
• Directional: Did recent changes help or hurt performance?
• Actionable: Any error should be an actionable indicator
• Comparative: Compare your application to similar applications in your installation
![Page 35: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/35.jpg)
Successful Applications
Key Performance Indicators In Software
• Functional: Measuring the frequency and duration which features are used.
– Examples:
○Minutes in class○ Click-throughs○ SSO hand-offs○ Page views
![Page 36: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/36.jpg)
Successful Applications
Key Performance Indicators In Software
• Non-Functional: Measuring the transactional throughput of an application.
– Examples:
○ Connections per server○ Response times○ Page load times
![Page 37: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/37.jpg)
Successful Applications
Key Performance Indicators In Software
• Transactional: Measuring the frequency and duration which business transactions are executed.
– Examples:
○Messages○ Enrollments processed○ Courses viewed○ Thread responses
![Page 38: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/38.jpg)
Successful Applications
Key Performance Indicators In Software
How To Identify Your KPI’s
• What are the nearest-term goals of your application?
• How will you know when you have reached your goals?
![Page 39: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/39.jpg)
Successful Applications
Key Performance Indicators In Software
Example: Prospero Message Bus
Strategic Goal: To provide an always-on message bus that guarantees delivery with very low message publication latency.
What To Measure:• Availability• Message loss• Delivery latency
![Page 40: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/40.jpg)
Successful Applications
Key Performance Indicators In Software
Example: Prospero Message Bus
Key Performance Indicators:• Messages produced (per second and day)• Number of times it takes longer than 500ms to publish a message• Number of delivery problems• Production-to-Delivery latency• Linux “load factor” of servers
![Page 41: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/41.jpg)
Successful Applications
Key Performance Indicators In Software
Example: Anton.io Browser-Channel Test
Strategic Goal: To feel comfortable recommending the use of web sockets and flash sockets for realistic event-driven web UI.
What To Measure:• Connection reliability per transport• Connection density and server behavior of Node.js
![Page 42: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/42.jpg)
Successful Applications
Key Performance Indicators In Software
Example: Anton.io Browser-Channel Test
Key Performance Indicators• Connections succeeded and failed• Transport used (web sockets vs. flash vs. XHR polling)• Connection time in milliseconds
![Page 43: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/43.jpg)
Successful Applications
How To CountCollecting and presenting your application’s statistics
2
![Page 44: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/44.jpg)
Successful Applications
How To Count
The Golden Rules Of Audit Logging
• Log transactions, not errors and debug statements
• Find the right places to place the hooks
• Record the transaction as concisely as possible
• Leverage existing frameworks
![Page 45: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/45.jpg)
Successful Applications
How To Count
The Golden Rules Of Audit Logging
• Log transactions, not errors and debug statements
• Find the right places to place the hooks
• Record the transaction as concisely as possible
• Leveraging existing frameworks
![Page 46: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/46.jpg)
Successful Applications
How To Count
The Golden Rules Of Audit Logging
• Log transactions, not errors and debug statements
– Error logs are for identifying code and system problems
– Debug statements are for development and last-resort debugging
– Audit logs need to be noiseless and easily parsed
![Page 47: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/47.jpg)
Successful Applications
How To Count
The Golden Rules Of Audit Logging
• Log transactions, not errors and debug statements
• Find the right places to place the hooks
• Record the transaction as concisely as possible
• Leveraging existing frameworks
![Page 48: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/48.jpg)
Successful Applications
http://assets.en.oreilly.com/1/event/7/Improving%20Netflix%20Performance%20Presentation.pdf
![Page 49: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/49.jpg)
Successful Applications
![Page 50: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/50.jpg)
Successful Applications
![Page 51: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/51.jpg)
Successful Applications
![Page 52: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/52.jpg)
Successful Applications
How To Count
Finding The Right Places To Measure
...is all about knowing what pieces are included in the measurement
![Page 53: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/53.jpg)
Successful Applications
![Page 54: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/54.jpg)
Successful Applications
![Page 55: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/55.jpg)
Successful Applications
How To Count
The Golden Rules Of Audit Logging
• Log transactions, not errors and debug statements
• Find the right places to place the hooks
• Record the transaction as concisely as possible
• Leveraging existing frameworks
![Page 56: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/56.jpg)
Successful Applications
How To Count
Anatomy Of An Audit Log Statement
• Items:– Timestamp– Action– “key=value” pairs supplying context
• Format:– TIMESTAMP action=ACTION [key1=value1 ...]– Exclude anything the is deducible or implicit, e.g. server name – $64k Question: Can you parse it with a regular expression?
![Page 57: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/57.jpg)
Successful Applications
How To Count
Anatomy Of An Audit Log Statement - Prospero Example
2011-04-11T16:13:53Z action=SUBSCRIPTION-CANCELLED sub=e0490bb8-1eb7-4221-a6f2-4cb1bc9c76d4
2011-04-11T16:15:56Z action=MESSAGE msg=c14fd86f-f448-4aa6-b662-87c7f27895fc principal=ONE length=11 realm=default content_type=text/plain tag=MessageType:messageType1 tag=SubSystem:default tag=System:default tag=ClientString:default tag=Client:default
2011-04-11T16:15:56Z action=ATTEMPTING-DELIVERY sub=fc9c7e50-542b-44cb-b48f-7c1f992d13a9 msg=c14fd86f-f448-4aa6-b662-87c7f27895fc del_attempt=d52054d8-1cbb-47f7-927e-ff901d6020ce
2011-04-11T16:15:56Z action=DELIVERED sub=fc9c7e50-542b-44cb-b48f-7c1f992d13a9 msg=c14fd86f-f448-4aa6-b662-87c7f27895fc del_attempt=d52054d8-1cbb-47f7-927e-ff901d6020ce del_ref=12345 duration_seconds=0 latency_seconds=1 ramp_churn=0
NOTE: This is word-wrapped...always do one statement per line for easier parsing!
![Page 58: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/58.jpg)
Successful Applications
How To Count
Anatomy Of An Audit Log Statement - Prospero Example
2011-04-11T16:13:53Z action=SUBSCRIPTION-CANCELLED sub=e0490bb8-1eb7-4221-a6f2-4cb1bc9c76d4
2011-04-11T16:15:56Z action=MESSAGE msg=c14fd86f-f448-4aa6-b662-87c7f27895fc principal=ONE length=11 realm=default content_type=text/plain tag=MessageType:messageType1 tag=SubSystem:default tag=System:default tag=ClientString:default tag=Client:default
2011-04-11T16:15:56Z action=ATTEMPTING-DELIVERY sub=fc9c7e50-542b-44cb-b48f-7c1f992d13a9 msg=c14fd86f-f448-4aa6-b662-87c7f27895fc del_attempt=d52054d8-1cbb-47f7-927e-ff901d6020ce
2011-04-11T16:15:56Z action=DELIVERED sub=fc9c7e50-542b-44cb-b48f-7c1f992d13a9 msg=c14fd86f-f448-4aa6-b662-87c7f27895fc del_attempt=d52054d8-1cbb-47f7-927e-ff901d6020ce del_ref=12345 duration_seconds=0 latency_seconds=1 ramp_churn=0
NOTE: This is word-wrapped...always do one statement per line for easier parsing!
![Page 59: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/59.jpg)
Successful Applications
How To Count
Anatomy Of An Audit Log Statement - Prospero Example
2011-04-11T16:13:53Z action=SUBSCRIPTION-CANCELLED sub=e0490bb8-1eb7-4221-a6f2-4cb1bc9c76d4
2011-04-11T16:15:56Z action=MESSAGE msg=c14fd86f-f448-4aa6-b662-87c7f27895fc principal=ONE length=11 realm=default content_type=text/plain tag=MessageType:messageType1 tag=SubSystem:default tag=System:default tag=ClientString:default tag=Client:default
2011-04-11T16:15:56Z action=ATTEMPTING-DELIVERY sub=fc9c7e50-542b-44cb-b48f-7c1f992d13a9 msg=c14fd86f-f448-4aa6-b662-87c7f27895fc del_attempt=d52054d8-1cbb-47f7-927e-ff901d6020ce
2011-04-11T16:15:56Z action=DELIVERED sub=fc9c7e50-542b-44cb-b48f-7c1f992d13a9 msg=c14fd86f-f448-4aa6-b662-87c7f27895fc del_attempt=d52054d8-1cbb-47f7-927e-ff901d6020ce del_ref=12345 duration_seconds=0 latency_seconds=1 ramp_churn=0
NOTE: This is word-wrapped...always do one statement per line for easier parsing!
![Page 60: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/60.jpg)
Successful Applications
How To Count
Anatomy Of An Audit Log Statement - Prospero Example
2011-04-11T16:13:53Z action=SUBSCRIPTION-CANCELLED sub=e0490bb8-1eb7-4221-a6f2-4cb1bc9c76d4
2011-04-11T16:15:56Z action=MESSAGE msg=c14fd86f-f448-4aa6-b662-87c7f27895fc principal=ONE length=11 realm=default content_type=text/plain tag=MessageType:messageType1 tag=SubSystem:default tag=System:default tag=ClientString:default tag=Client:default
2011-04-11T16:15:56Z action=ATTEMPTING-DELIVERY sub=fc9c7e50-542b-44cb-b48f-7c1f992d13a9 msg=c14fd86f-f448-4aa6-b662-87c7f27895fc del_attempt=d52054d8-1cbb-47f7-927e-ff901d6020ce
2011-04-11T16:15:56Z action=DELIVERED sub=fc9c7e50-542b-44cb-b48f-7c1f992d13a9 msg=c14fd86f-f448-4aa6-b662-87c7f27895fc del_attempt=d52054d8-1cbb-47f7-927e-ff901d6020ce del_ref=12345 duration_seconds=0 latency_seconds=1 ramp_churn=0
NOTE: This is word-wrapped...always do one statement per line for easier parsing!
![Page 61: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/61.jpg)
Successful Applications
How To Count
The Golden Rules Of Audit Logging
• Log transactions, not errors and debug statements
• Find the right places to place the hooks
• Record the transaction as concisely as possible
• Leveraging existing frameworks
![Page 62: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/62.jpg)
Successful Applications
How To Count
Leverage Existing Frameworks
• Log files work well:
– Rotated with logrotate or CHOMP
– Many search utilities (grep, sed, awk)
– Easily processed by any language
– log4j and log4net write asynchronously
– They can always be latter parsed and inserted into a database
![Page 63: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/63.jpg)
Successful Applications
How To Count
Leverage Existing Frameworks
– Try our audit logging library available on GitHub at○ https://github.com/PearsonLearningStudio/audit-logging
– Java
– Coming soon:○ .NET○Node.js○ Erlang
![Page 64: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/64.jpg)
Successful Applications
![Page 65: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/65.jpg)
Successful Applications
![Page 66: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/66.jpg)
Successful Applications
![Page 67: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/67.jpg)
Successful Applications
![Page 68: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/68.jpg)
Successful Applications
Count Out LoudTransparency and advertisement
3
![Page 69: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/69.jpg)
Successful Applications
![Page 70: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/70.jpg)
Successful Applications
![Page 71: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/71.jpg)
Successful Applications
Count Out Loud, Be Transparent
• Being transparent with successes and failures builds goodwill towards your application.
– Users are more likely to trust your application
– Users will be more patient when problems occur
![Page 72: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/72.jpg)
Successful Applications
![Page 73: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/73.jpg)
Successful Applications
Count Out Loud, Advertise Your Results
• Advertising your results will help keep users aware of your application after the excitement of the initial launch dies down.
– Product folks are more likely to prioritize improvements to the application
– Potential users of the application will feel more comfortable adopting it
– The data you share may help your peers
![Page 74: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/74.jpg)
Successful Applications
![Page 75: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/75.jpg)
Successful Applications
When To Evolve Your MeasurementsMetrics change as goals change
4
![Page 76: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/76.jpg)
Successful Applications
![Page 77: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/77.jpg)
Successful Applications
When To Evolve Your Measurements
• Goals will change either because strategies change or because the goal is reached and new ones must be set.
• KPI’s should be adjusted at the same time when goals change
![Page 78: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/78.jpg)
Successful Applications
When To Evolve Your Measurements
• Goals will change either because strategies change or because the goal is reached and new ones must be set.
• KPI’s should be adjusted at the same time when goals change
• But it is also important to listen for negative feedback because you might be measuring the wrong things.
![Page 79: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/79.jpg)
Successful Applications
Wrong KPI?
• Inadvertently incentivize undesirable behavior
• Start measuring the negative feedback to determine if the problem is real
• Either replace the old KPI with the new one or add it to the squad
![Page 80: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/80.jpg)
Successful Applications
Buffer Bloat: Measuring The Wrong Thing
• Bufferbloat is the existence of excessively large (bloated) buffers in systems, particularly network communication systems
![Page 81: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/81.jpg)
Successful Applications
Buffer Bloat: Measuring The Wrong Thing
• Bufferbloat is the existence of excessively large (bloated) buffers in systems, particularly network communication systems
• Some experts believe that bufferbloat is the cause of much of the poor performance and human pain experienced using today’s Internet
![Page 82: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/82.jpg)
Successful Applications
Buffer Bloat: Measuring The Wrong Thing
• Bufferbloat is the existence of excessively large (bloated) buffers in systems, particularly network communication systems
• Some experts believe that bufferbloat is the cause of much of the poor performance and human pain experienced using today’s Internet
• If true, this is a quintessential example of picking the wrong industry KPI– Networks should probably use “Round Trip Latency” instead of
“Dropped Packets” because excessive work to not drop packets negates the effectiveness of TCP/IP
![Page 83: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/83.jpg)
Successful Applications
Buffer Bloat: Measuring The Wrong Thing
• See http://www.bufferbloat.net for details
![Page 84: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/84.jpg)
Successful Applications
Buffer Bloat: Measuring The Wrong Thing
• See http://www.bufferbloat.net for details
• Wager: Phở is on me if Buffer Bloat is not part of the general networking conversation by the end of 2012.
![Page 85: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/85.jpg)
Successful Applications
Conclusion
5
![Page 86: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/86.jpg)
Successful Applications
Launching Successful Applications
1. What To Count– Key Performance Indicators in software– Choosing your indicators
![Page 87: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/87.jpg)
Successful Applications
Launching Successful Applications
1. What To Count– Key Performance Indicators in software– Choosing your indicators
2. How To Count– Finding the right places to measure– Frameworks that can help
![Page 88: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/88.jpg)
Successful Applications
Launching Successful Applications
1. What To Count– Key Performance Indicators in software– Choosing your indicators
2. How To Count– Finding the right places to measure– Frameworks that can help
3. Count Out Load– Transparency builds goodwill– Advertising success creates momentum
![Page 89: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/89.jpg)
Successful Applications
Launching Successful Applications
1. What To Count– Key Performance Indicators in software– Choosing your indicators
2. How To Count– Finding the right places to measure– Frameworks that can help
3. Count Out Load– Transparency builds goodwill– Advertising success creates momentum
4. Evolve Your Measurements– When goals change– Negative feedback
![Page 90: Launching Successful Applications](https://reader033.vdocuments.us/reader033/viewer/2022052600/5589600bd8b42a57718b467d/html5/thumbnails/90.jpg)
Thank you
Chris K. ChewEnterprise Infrastructure Team
@chrischew