dev analytics overview

Developer AnalyticsOverview & Demo

Agenda

• Functional overview

• Demo

• Architecture overview

Developer Portal

Per app report

App Tile App summary

Adoption

Downloads In-app purchases Usage

Ratings Quality Finance

Per Developer report

Financial summary

Store report

Explore Store trends

Developer Analytics – Sitemap

This is an aggregation of downloads, ratings, quality, finance, purchases and in-app purchases report to give an overview of all the metrics useful to the developer.

This is an summary of downloads, purchases, in-app purchases, usage metricsIt also shows Discovery metrics – App discovery/conversion funnel and app’s web listing page’s web referrers distribution

Developer Analytics – Partner dependency

Fundamental Telemetry

5R – RnR

DSP Telemetry

Downloads

In-app purchases

Usage

Quality

Ratings and Reviews

Finance

Financial Summary

Adoption page


Page views + Conversion funnel

Primes

PFDb – PartnerFeedDb (Aggregation)BI Cube (Copy to FEs)

Telemetry Cube (Copy + Stability feed generation)

RnR BCP Feed (Aggregation)

ComTransactionDb (Aggregation)

DemoDeveloper Analytics

Architecture OverviewDeveloper Analytics

Architecture overview

• Component Grouping• Copy, Validate & Publish SSAS Cube• Extract and Load with basic processing• Extract, Transform and Load• Data Mining for Store Trends

•Workitem Framework Block Diagram

Architecture overview – Cube PAS

• Copy, Validate & Publish SSAS Cube• Input – Cube backup• Processing

• Restore cube backup on BE• Validate Schema

• Publish• Restore new cube to Passive instance• PAS - Passive Active Sync

• Copy cube to passive instance of all FEs • Flip Passive to Active instance.

Cube (Backup)

DCS Pipeline

DLS Pipeline

Temp Storage

Cube SSAS

PAS Pipeline

Telemetry Cube SSAS

Cube SSAS

FE Cube SSAS

Telemetry Cube SSAS

Cube SSAS

FE Cube SSAS

Passive

ActiveFE

Portal

Architecture overview – Basic ETL

• Extract and Load with basic processing• Input – Raw data• Processing

• Validate Schema of raw data• Filter unwanted data• Remove duplicate entries

• Load• Re-process SSAS Cube and Publish to FE using PAS• Copy processed data to FE DB

FE Portal

Staging DB DWHProcessingCube SSAS

PAS Pipeline

Store Cube SSAS

Store Cube SSAS

FE Cube SSAS

Feed Data Feed Pipeline

App Store Analytics

DB

App Store Analytics

DBFE DB

DPS Pipeline

Architecture overview – ETL

• Extract, Transform and Load• Input – Raw data• Processing

• Data Fetch• Validate Schema of raw data• Filter unwanted data• Remove duplicate entries• Data normalization

• Data Processing – Data Aggregation• Load

• Copy processed data to FE DB

FE Portal

Staging DB

DWH

FeedData Feed Pipeline

App Store Analytics

DB

App Store Analytics

DBFE DB

Data Move

Processing

Source DB

Data Fetcher

Architecture overview - Mining

• Data Mining• Input – Acquisition data• Processing

• Data Fetch• Validate Schema of raw data• Filter unwanted data• Remove duplicate entries• Data normalization

• Data Processing • Data Preparation – Data Filtering, Data Sampling, Data Discretization• Data Mining

• Output• Mining Rules i.e. Observed data trends

FE Portal

DWHApp Store Analytics

DB

App Store Analytics

DBRules DB

Data Preparator

Source DB

Data Fetcher

Sampled Data Store

Data Mining


• Workitem Framework

DB Based Workitem Queue

Workitem Generator1 WI Type 1 State 1

WI Type 1 State 2

WI Type 4 State 10

Workitem Generator2

WI ProcessorType 1 State 1





Partner Feed DB

RnR Feed

ComTxn Feed

DevAnalytics Staging DB

MiningDWH DB

MiningDWH DB MiningDWH

DB

Sampled Data Store

Sampled Data Store

Data Fetcher

WIFx

Data Feed Pipeline

Data Fetcher WIFx

Mining Data Preparator

WIFx

Mining Data Miner – WIFx,

SSAS

Data Aggregator WIFx

Move Data to FE WIFx

Data Feed Pipeline

Payout Cube SSAS

Telemetry Cube

DCS Pipeline

DLS Pipeline Temp

Storage

Telemetry Cube SSAS

PAS Pipeline

Telemetry Cube SSAS

A. Telem

Telemetry Cube SSAS

Manual Cert DB

Data Feed Pipeline

Certification Reporting DB

Mining Rules DB

Mining Rules DB

Mining Rules DB

DevAnalyticsFE DB DevAnalyticsFE

DB DevAnalyticsFE DB

Analytics Staging DB

Analytics DWH

Load DWH SSIS

Store Cube SSAS

PAS Pipeline Store

Cube SSAS

Store Cube SSAS

Store Cube SSAS

App Catalog

Feed

Data Feed Pipeline

Control DB

Data Fetch Workitem Generator

Data Mining Workitem Generator

Aggregation Workitem Generator

Settelment Feed

CP Feed

ForEx Feed

App Store Analytics DB



DPS Pipeline

Tracking DB

Currency Conversion

Tracking DB

Dev Portal

Dev Portal Dev Portal

Dev Portal

Mining Rules DB

Mining Rules DB

Onboarding DB

Stability Score Pipeline

Stability Score Feed

Data Feed Pipeline

BI Cube DCS

Pipeline DLS Pipeline

BI Cube SSAS

PAS Pipeline

Telemetry Cube SSAS

Teleme

BI Cube SSAS


Telemetry Cube

DCS Pipeline

DLS Pipeline

Temp Storage

Telemetry Cube SSAS

PAS Pipeline

Telemetry Cube SSAS

Telemetry

Cube SSAS

Telemetry Cube SSAS

Stability Score Pipeline


BI Cube

DCS Pipeline DLS

Pipeline BI Cube SSAS

PAS Pipeline

Telemetry Cube SSAS

Telemetry

Cube

SSAS

BI Cube SSAS



5R – RnR

DSP Telemetry

Downloads

In-app purchases

Usage

Quality

Ratings and Reviews

Finance

Finance Summary

Adoption page



Primes + CP + CTP

PFDb -- PartnerFeedDbBI Cube

Telemetry Cube

RnR BCP Feed

ComTransactionDb


ComTxn Feed

Data Feed Pipeline

Payout Cube SSAS


Analytics DWH

Load DWH SSIS

Store Cube SSAS

PAS Pipeline

Store Cube SSAS

Store Cube SSAS

Store Cube SSASSettelment

Feed

CP Feed

ForEx Feed




DPS Pipeline

Currency Conversion

Data Feed Pipeline



5R – RnR

DSP Telemetry

Downloads

In-app purchases

Usage

Quality

Ratings and Reviews

Finance

Finance Summary

Adoption page



Primes





Architecture overview – Aggregate DB and Mining

Partner Feed DB

RnR Feed

DevAnalytics Staging DB

MiningDWH DB

MiningDWH DBMiningDWH

DB

Sampled Data Store

Sampled Data Store

Data Fetcher

WIFx

Data Feed Pipeline

Data Fetcher WIFx


WIFx

Mining Data Miner – WIFx,

SSAS

Data Aggregator WIFx

Move Data to FE WIFx

Manual Cert DB

Data Feed Pipeline

Mining Rules DB

Mining Rules DB

Mining Rules DB

DevAnalyticsFE DBDevAnalyticsFE

DBDevAnalyticsFE DB

App Catalog

Feed

Data Feed Pipeline

Control DB

Data Fetch Workitem Generator

Data Mining Workitem Generator

Aggregation Workitem Generator

Tracking DB

Tracking DB

Architecture overview – Aggregate DB and Mining


5R – RnR

DSP Telemetry

Downloads

In-app purchases

Usage

Quality

Ratings and Reviews

Finance

Finance Summary

Adoption page



Primes





Architecture overview – Front End Block Diagram

ReportDefinitions.xml

CubeQueries.xml

DbQueries.xml

Report Manager

Cube DAL

DB DAL

DataAccessService

DAL Interface

DeveloperAnalytics Controller (MVC)

Highcharts

Agg DB

BI Cube

DevAnalyticsFE DB

TransactionDB DAL

Mining Rules API

Agg DBApp Store

Analytics DB

Telemetry Cube

Store Cube

Architecture overviewHeading

Heading

Component + Physical Architecture for Dev Analytics for Windows BlueComponent + Physical Architecture for Dev Analytics for Windows Blue

Sources

Store(Ratings/Review as bcp)

5/8 MB, 1/12 hrs50 MB/Day 7MB/Day10 GB, 1/Day

Partner Feed(Acquisitions,

Page Referrals, Conversions)

2GB/Day

Manual Cert DB

Telemetry(Quality,Usage as a cube)

DSP Telemetry aka BET (Acquisitions,

Conversion, Referrers as a

cube)

Upgrade Model: FE is meant to be active even when BE is down. WebStore Layer is updated first. BE Layer components next. FE components last. V (N) FE components must work with V(N+1) pipelines.Availability : 3 way replication for FE stores . Replication Load prevents addition of a new DC. BE is Active/Passive. Procedure to do failover is not tested or captured as a runbook.Scalability : FE scale model is based on data replication. BE scale model is adhoc.

Portal

WebStore/SQLLocal Caching(for

metadata)

Internal Partners Only

Certification Reporting DB

FE Layer(Active/Active))FE Layer(Active/Active))

DS2DS1

Backend Layer(Active/Passive)Backend Layer(Active/Passive)

Mining DWH DB(partition 0)

Data Fetcher WIFx(Partner

Feed DB)

Dev Analytics Staging DB

Control DBMining DWH

DB (partition 1)


WIFx

Data Feed Pipeline(RNR, Manual Cert,

App Catalogue)

Data Aggregator

WIFx

PS1

Data Fetcher WIFx(Partner

Feed DB)

Data Fetcher WIFx(Dev Analytics

Staging DB)


WIFx

Sampled Data

Store(partition 0)

Sampled Data Store

Data Miner WIFx

PS2

Sampled Data

Store(partition 1)

Data Miner WIFx

Tx Catalog (Finance, as bcp)

300MB/Day

7MB/Day

SSAS Cube

Analytics BE CubeAnalytics Pipeline BE

Backend LayerBackend Layer


Analytics DWH DB

Store CubeTelemetry Cube

Store BI CubeBET

DCS

DLS

PAS

DCS

DLS

PAS

DCS

DLS

PAS

Mining WI Monitoring WIFx


WIFx

DC1

Payout Cube

Frontend Cube ServerFrontend Cube Server

Telemetry Cube

Store Cube

Store BI Cube


Telemetry Cube

Store Cube

Store BI Cube


Telemetry Cube

Store Cube

Store BI Cube

Frontend DB Server


Dev Analytics FE DB

Mining Rules DB

Onboarding DB

Frontend DB Server


Dev Analytics FE DB

Mining Rules DB

Onboarding DB


Architecture overview – Front End Cube Per DC

Architecture overview – Front End DB Per DC

Architecture overview – Back End Cube

Architecture overview – BE DWH & Processing (Pri DC)

Architecture overview – BE DWH & Processing (Sec DC)

AppendixDeveloper Analytics

Developer Analytics – Quality/Usage details

• Usage metric & Reliability rates• Sampled data.

• CEIP applies. Minimum 15 minute usage threshold to be sampled.• Max 1000 machines per sample. Random sampling.

• Latency: 5 days• Metric computed for 3 day periods

• Quality page – Top limitations• Triage dumps with only call stacks.• Un-sampled data. (CEIP applies)• Latency: 6 days

Developer Analytics – Finance page details

dev analytics overview

Documents