the what, why and how of analytics testing
TRANSCRIPT
THE WHAT, WHY & HOW OF WEB ANALYTICS TESTING
Anand BagmarSoftware Quality Evangelist
ABOUT ME
@BagmarAnand
about.me/anand.bagmar
AnalyticsWeb / Mobile / ...
WHY DO WE NEED ANALYTICS?
WHAT IS ANALYTICS?
ANALYTICS SOLUTIONS
Google Analytics
SiteCatalyst
Amplitude
WebTrends
….
Is that all to Analytics?
The new “kids” in town
IoT & Big Data
teenagers
Some popular use cases
https://www.kaaproject.org/iot-use-cases/
IOT – INTERNET OF THINGS
Opportunity to
¨ Create new value propositions
¨ Be Innovative & Creative
IOT – HOW TO DELIVER VALUE?
¨ Automate the manual processes
¨ Integrate data capabilities
¨ Collect – integrate from various sources
¨ Repeat collection – automate the collection
¨ Analyze – manual & machine learning
¨ Optimize / Pivot
¨ Repeat
IOT – CHALLENGES
¨ Federated devices,
¨ Different types of networks
¨ Different communication channels
¨ Physical (hardware) & Virtual (software)
IOT – BIGGER CHALLENGES
¨ Too many devices
¨ Lots of data
BIG DATA …. IS GETTING BIGGER
¨ Volumes of data generated¨ A jet engine generates 1TB of data per flight.
¨ A large refinery generates 1TB of raw data per day.
¨ As cars get smarter, the number of sensors is projected to reach as many as 200 per car.
¨ Sensors of all types will generate immense amounts of data. In fact, analysts estimate that by 2020, 40 percent of all data will come from sensors.
¨ IoT leads to massive volumes of data
http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper
What does all this mean for Testing?
TESTING OPPORTUNITIES ...
¨ Build capabilities (and tools) to validate –
¨ Data collection is working well
¨ From all sources
¨ Analyzing data, capturing patterns and trends
¨ Optimize business value
¨ Create new opportunities and value propositions
TESTING OPPORTUNITIES
¨ “Testing” of these new integrations & its value propositions
¨ Performance
¨ Reliability
¨ Security
¨ Scale
You don’t need to think complex!!
VIU
¨ Unique installs (Android) - > 1.75M
¨ Unique # of devices (Android) - > 13K
Testing Analytics
TESTING AT THE REPORT LEVEL
Pros
¨ Ensure report is setup correctly
Cons
¨Licensing
¨Reports not yet setup
¨Validate all requests are sent / captured
Biggest Problem
It is TOO LATE!
The Solution
Analytics Testing Challenges
MANUAL
REPEATING OVER-AND-OVER AGAIN
BATCHING
The Automation Solution
WAAT - Web Analytics Automation Testing
WHAT DOES WAAT DO FOR ME?
q Plugs into existing Test Automation Frameworkq With minimal changes
q Web Analytic tool independentq UI Driver framework independentq Browser independentq Works for Native apps as well mobile-web (Android / iOS)
@BagmarAnand
about.me/anand.bagmar
THANK YOU
RESOURCES
¨ https://github.com/anandbagmar/waat
¨ https://github.com/anandbagmar/waat-ruby
¨ http://essenceoftesting.blogspot.in/search/label/waat
¨ http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper
¨ http://www.dezyre.com/article/how-big-data-analysis-helped-increase-walmart-s-sales-turnover/109