app & api monitoring: building a 5-star reputation for your apps
TRANSCRIPT
Apps & API Monitoring
Apigee@apigee
Ole Lensmar@olensmar
Alan Ho@karlunho
SmartBear@SmartBear
Building a 5-Star Reputation for your Apps
groups.google.com/group/api-craft
groups.google.com/group/app-craft
youtube.com/apigee
slideshare.net/apigee
@olensmarOle Lensmar
@karlunhoAlan Ho
@SmartBear @Apigee
During webcast - participate on twitter hastag #5starapp
Agenda
• Why (Web) API performance matters• How can you avoid performance issues?
• Synthetic Transaction monitoring• Real User monitoring
• Recap pros/cons of different techniques• Questions
What matters to the user?
900,000 apps & growing
Performance Matters
• Poor reviews skew your overall app ratings
• Majority of Poor Reviews Occurred in first 24 hours
• Customers do not tolerate software Errors
• Combination of App & API problems
• Fixing Problems without trace logs is difficult
Don’t crash
Don’t give me errors
Don’t slow me down
Return on Features vs. Performance
Features
Perform
ance
Benefit
Application Maturity
Inflection
How can you avoid performance issues?
API performance = app performance
Indirect vs. Direct API Integration
Synthetic Monitoring
• Functional Consistency• Perf. Consistency• Proactive Error Detection
Real User Monitoring• API Errors• API Performance• Variation of Devices /
Networks
Demo
Real User Monitoring
Synthetic Monitoring
Pros Cons
Real User Monitoring
• Capture Real User problems
• Exercise real devices and networks
• Correlate with errors & abandonment
• Need critical mass of traffic for each API monitored
• Need to instrument your code• Potential Bandwidth / Battery
issues
Synthetic Transaction Monitoring
• Can monitor all APIs all the time
• Doesn’t require instrumentation of app
• Can reuse existing test assets from Dev & QA
• Doesn’t simulate real users / devices / networks
• Need to setup and maintain the monitors
• Cannot tell you the end behavior of the app
Use both techniques!
• Reduce effect of cons of both techniques
• Use RUM traffic to create tests for Synthetic Transaction Monitoring
• Correlate STM failures to usage in RUM
In Summary . . .
Mobile app experience depends on API performanceSuccess depends on meeting users’ performance
expectationsUse multiple techniques for monitoring your app
Questions
THANK YOUQuestions and ideas to:
@olensmar@karlunho
groups.google.com/group/api-craft
groups.google.com/group/app-craft