4_huawei mbb qoe assurance solution-10!06!01

8/6/2019 4_Huawei MBB QoE Assurance Solution-10!06!01

1/21

UAWEI TECHNOLOGIES CO., LTD.

Huawei MBB QoE Assurance

Solution


2/21

ne real case. How to avoid it happen?

Customer Operator Customer

No complaint

complain

No action

No any changen Page download slowly

n Drop frequently

Dont know what

happened

Get ,but dont know

how to treat it?

Cant tolerate

say Goodbye

3 Requirements Solution

Evaluation

Optimization

Faultlocation

1

2

3

QoE evaluationHow to evaluate whether QoE has problem?

QoE problem is known ,How to locate it?

QoE problem is Located, How to solve it?

E2E QoE optimization

Bad experience

ISILICON SEMICONDUCTOR

UAWEI TECHNOLOGIES CO., LTD. Page 2

Fast troubleshooting

QoE Optimization


3/21

ervice quality is key of QoE assurance

E2E QoE optimizationISILICON SEMICONDUCTOR


Marketservice(34%)

Application

content

(4%)

Servicequality

(62%)

uBrand

uPrice

uService after sale

uUsability

uConvenient

uSecurity

uEntertainment

uRetainablity

uIntegrity/QualityuCustomer care

uDevice

uAccessibility

QoE(Quality of

Experience)

Page download peak rate

Page refresh download time

throughput

PDP active tim

PDP Active SR

Accessibility

Retainablity

Integrity/

Quality

Drop rateDrop rateInterrupt frequency

HO SRInterrupt time

Ps setup SR

Ps connect SR.

DNS analysis

timePage download error

Attach timePage download time

Attach SRPage download setup SR

Network KPIMappingService KQIService

Quality

Example: Browsing service QoE

QoE assurance including evaluation, problem location and optimization should focus on service KQI

QoE is impacted by many factors including market service, service quality, etc. Service quality is key

Service quality can be matched by E2E service KQI (Key Quality Indication).


4/21

oE Manager Solution-QoE evaluationoE Manager Solution-QoE evaluation

10:00 pm 10:15

Subscriber

d experience:age download slowlyrop frequently

again and again ,

any change

n By installing agent software on terminal , terminal can collect and reportsubscriber QoE related info to WEB server in network.

Improving customer satisfaction and loyalty by customer care before complaint

Saving OPEX greatly by reducing dedicate dial and drive testing task by 60% due to

subscriber with agent is one full time testing volunteer.

10:20 pm

collect Evaluate

.Agent

WEB Server

service KQI Radio KPI VIP

Abnormal KQI find

Http Browsingaverage throughput

Page downloadtime

Coverage

Sending care message to customer before he complains




5/21

oE Manager Solution-Mobile Manager (M2) Overview

DB SPASAMSTerminal AN MT

basicSupport 800 measurement itemsRadio qualityNetwork KPI

option

option

basic

basic

basic

basic

basic

Ty

Customize interface for specific applicationServiceStatistics

API

Service KQI evaluationQoE EvaluationExperiences

User Behavior Switch on/off time, functionality usage etc

Setup delay, Jitter, Video/Audio Syn, MOS etc

SMS/MMS delivery Suc. Rate, Text Size,

PDP Act. Delay, Jitter/Throughput/PLR.

Call setup time, MOS, Drop etc

Function description

Streaming

Message

Statistics

Data

VoiceService quality

Sub-Cat.Category

Main functionalitiesSystem Components:

Terminal: Datacard, commercial mobile phoneAgent: Data collection and upload

AMS: Agent distribution and update and data

pre-process.

DB: Data storage and post-process

SPAS: Network and service quality evaluation

report

Network: GPRS, EDGE, UMTS, HSPAMutli-Operator Benchmark

Agent




6/21

oE Evaluation M2 Solution-System Architecture

Relating troubletickets

Service/wireless quality

monitoring

KPI anomalies & QoE / QoS alarms

monitoring

Relevant KPIReports

Relating alarms

Problemlocalization

Data card

Mobile phone

DB SPAS(Service Performance &Quality

Analysis System)

AMS(Agent Management System)

Commercial terminals GENEX TEST(PHU/Probe/special test terminal)

Passive measurement in RT (KPIs / log file /),automated data upload

Active probing measurement in RT or periodical (automated) ormanual data uploading

TATA

0.00%

5.00%

10.00%

15.00%

20.00%

25.00%

Cell 1 Cell 2 Cell 3 Cell 4 Cell 5

CallDropRate

T o ta l Dr o p Ra te HO Dr o p Ra te

ata collect

layer

Data

lassification

nd storage

nalysis and

report




7/21

oE Evaluation M2 Solution- Agent Distribution

Datacard

Terminal AMS

For new Datacard, Agent kit cooud be integrated with installation disk for customer installation.

For Datacard in subscriber, AMS push agent installation guide via SMS/MMS.

Installation is default enabled but shall be explicitly reminding for customers choice.

Agent will contact AMS server during idle period after dial-up.

Agent automatically record and analysis the radio quality service quality without disturb subscriber.

Agent could be uninstalled by user-self.

Application Scenarios

Internal user: voluntary to installagent to QoE monitoring

Group user: Express service

company, Taxi company, etc. Unlimited volume user, default

agreement with user VIP user, explicitly agreement with

user.

Tariff promotion to get volunteer

Commercial Mobile phone

System inform subscriber via SMS/MMS and push the installation directory to subscriber.

Subscriber could logon network to install agent by user-self

Agent will contact AMS server during idle period after dial-up.Agent automatically record and analysis the radio quality service quality without disturb subscriber.

Agent could be uninstalled by user-self.




8/21

Bad Coverage

DownlinkInterference

Abnormal HO

2 Solution- Examples of radio quality parameters

Radio KP

HSUPA RLC Throughput

HSDPA RLC Throughput

BLER

Tx Power

PICH Ec/N0

Rx Power

PICH RSCP

Radio KPI

HSUPA RAB Setup Success Ratio

PDP Context Activation Success Ratio

RRC Setup Success Ratio /Delay

HSDPA RAB Setup Success Ratio

Random Access Success Ratio /Delay

Bearer Service Drop Ratio

Radio KPI

HSDPA Inter-RAT HO Success Ratio/Delay

HSUPA Inter-RAT HO Success Ratio

/Delay

HSUPA Soft HO Success Ratio /Delay

Hard HO Success Ratio /Delay

TA

TA

SPASAMS DB

ISILICON SEMICONDUCTORUAWEI TECHNOLOGIES CO., LTD. Page 8


9/21

2 Solution- Examples of mobile data service KPIs

VoIP &Video Call

Mobile DataInternet

E-CommerceE-Mail

Game/TV/Content

E-mail session setup success ratio, e-mail send/receive completed ratio, send/receivedelay, etc

Video MOS**, streaming setup success ratio, first buffering delay, streamingaudio/video non-synchronization, RTP over IP QoS

Listening quality MOS (MOS-LQ)*, call setup success ratio, call setup delay, call successratio, one way delay, packet loss ratio, jitter, etc

Browsing completed ratio, page download delay, active session throughput, FTP

download/upload delay, IP QoS (throughput, delay, jitter, packet loss)

*)Perceptual Evaluation of Speech Quality PESQ (ITU-T P.862.x) for active measurements and E-Model (ITU-T G.107) for passive measurements

**)PEVQ (ITU-T Rec. J.247)



10/21

2 Solution- Service triggered questionnaires

Input a web URL

Start loading page

assive measurementsoading delayhroughput

F signal

Loading completed

Customer

Experience

What about the page loadingdelay?5 very quick4 quick3 normal2 slow1 very slow

Close the explorer

1When the service terminates, a questionnaire is sent to the customer to capture his/herimmediate experience

2Compare the subjective and objective measurement results, improve service quality KPI

models

3Correlate the E2E service quality, radio quality and terminal performance, helptroubleshooting

Pop-up

Data analysis

2Questionnaires

1E2E Servicequality

measurement

3Correlation

KPI KQI

KPI Mapping



11/21

2 Solution- Real time QoE monitoring for VIP user

Ensuring a good end user experience is a

cornerstone of SLA contracts with corporate

customers

M2 is able to constantly monitor the received

service level from end-user perspective

Network coverage

Data connection reliability and speed

Service quality for key applications like e-mail and

intranet access

Also collects information also outside of

network coverage when abroad



12/21

otal vision of collection and QoE Evaluation of M2 solution

Questionnaires

n RSCP/CI/Tx Poweer/

n MOC attempt, succ, Rate.

n Handover statistics

n Cell ID

n Statistics based on cell/time etc.

n GIS support

n

Service KQIn WAP/WEB: First page download delay, page refresh delay, conn. Suc.Rate,

Average Throughput..

n FTPAverage file size, peak and average throughput, Conn. Suc,Rate..n MMSSend Suc.Rate, file size, delay, drop rate,

n

Network KPI:n Attach Success rate [%]

n Attach Delivery Time [sec]

n PDP Context Success Rate [%]

n PDP Context Activation Time [sec]n

n APN;

n OS and version;

n Connection type (GPRS only/GPRS Preferred/3G Only/3G

Preferred);

n Channel quality index (CQI);

n Service Cell ID and neighbour cell ID Info.

n 3G DL UARFCN e Primary Scrambling Code;

n 2G BCCH & BSIC;n

Service Quality Evaluation

n Periodic updated question list

n QoE subjective feedback

n

Radio Performance Evaluation

Basis information



13/21

Fault located

Device Radio Core IMSBackhaul

End to end Control/User plan information (C-plan/U-plan)

Probe Probe ProbeProbeProbe

Events3

ervice Quality Inspector (SQI) Solution-Fault locationervice Quality Inspector (SQI) Solution-Fault location

Subscriber

d experiencege download slowly

rop frequently

y again and again,

any change

10:00 pm 10:15 10:20 pm

n Locate fault fast by correlated

O&M ,expert DB and

information which collected by

probe of each interface.

Improving satisfaction and loyalty by

fast troubleshooting ( e.g. 5+ Hrs to

~20 Min) Reduce operation cost

service trace for

fault analysis

GGSN delay

abnormal

M2000/N2000i2000

RAN NastarCN Nastar

U2520/ ServiceSQM

PerformanceAlarm info

Sending care message again to

customer after problem solved

solved

1

Huawei Case DB2Data collectionand correlation

evaluationInfo

Huawei Case DB2

1 2 3+ +


GGSN Faultlocated


14/21

ault location Solution-Functional Architecture

RT Monitor Data DrillingService QualityFault location

Web Server

MD-Database

Database Entry Database Entry Database Entry

Data adaptation Data adaptation Data adaptation

CHR Config.Statistic CHR Config.Statistics

RAN CN ServiceNetwork Element

Data collecting

Data adaptor

Data pre-process

Data Correlation

Data Server Layer

Service qualitypresentation

Terminal

Database Entry

Data pre-processData pre-process

Data pre-process

Data pre-process

RT Monitor



15/21

ault location Solution-E2E Deployed on Huawei Equipment

Analysis Presentation

Collection and Resolution by

Hardware platform

Datacollectio

M2

RAN CN Service Plat. CP/SP

SG

SN

GG

SN

BS

C/

RN

CBTS

NodeB

MMSWAPGW SP

Terminal

IP IPGb/Iu-PS

Gn Gi

CHR CHR

IP

Charactersu E2E network equipment from Huawei

u Data comes from Embed probe:

Terminal probe/RAN probe/CN

probe/ network probe

u

Fault location pinpoint to modulelevel



16/21

ault location Solution-E2E Deployed on Multi-vendor

Analysis Presentation

Collection and Resolutionby Hardware platform

M2

CP/SP

SG

SN

GG

SN

BS

C/

RN

CBTS

NodeB

MMSWAPGW SPTerminal

IP IPGb/Iu-PS

Gn GiCHR

Characters:

u Standard interface probes for

flexible distribution

u Support multi-vendor Scenario

u Integrated data resolution and

composition, fast delimitation and

location

CHR

RAN CN Service Plat.Terminal

Datacollectio



17/21

ault location Solution-E2E Delimitation and pinpoint

E2E data correlation analysis to fast Fault delimitation and pinpoint, improve O&M Efficiency.

l Analysis of signaling calling procedurel Analysis of service calling procedure

E2E procedure analysis

l Analysis of service delayl Analysis of service code result

Service application layer analysis

l Analysis of transfer delay, loss, jitterl Analysis of bandwidth and traffic flow

E2E transport layer analysis

0%

. .

0.5% 0%

RNC SGSN GGSN ServiceUE

0.5%

Wireless Beare Core App



18/21

oE Optimization-Browsing service caseoE Optimization-Browsing service case

Subscriber

Excellent experience :

Page download very f

Connect stably

Service quality betterthan before

veral weeks ago Now

TCP steady statePDP contextsetup

Renderingattach Radio channelsetup

DNS query &TCPsync.

TCP slowstart

Channel Setup TCP TransmissionRendering

FACH state 4a spec optimization: reduce 700msDNS protocol optimization: reduce 500msTCP window optimization :improve throughput 17%

Dup ACK context optimization:400ms

[email protected] KQI Value

Page download setup SR 91%

First Page download timeDownlink average throughput

Page download final SR

[email protected] KQI Value

Page download setup SR

4.3sFirst Page download timeDownlink average throughput

Page download final SR53%

5.9s260k

98.9%

309k

90.2%

n QoE Optimization key requirement :

Optimization must focus on user direct aware service quality

Unlike network KPI optimization, optimization is E2E and supported by powerful

tools and rich experience

luation

Info

mailto:[email protected]:[email protected]:[email protected]:[email protected]


19/21

uawei MBB E2E QoE Assurance Solution-Highlights

Comprehensive E2E data service QoE Metrics

l Manageable QoE-KQI Metricsl Measurable KQI-KPI index

l Entirely KQI/KPI relationship and mapping model

Closed loop QoE Assurance: Evaluation/Fault Location/Optimizatil Terminal Based QoE evaluation-M2 Solutionl E2E data correlation analysis platform for fast fault locationl QoE Based improve and optimization mechanism

Serials of Embed probe and external probe, support multi-vendorl UE probe, RAN probe, CN probe, network Probe and Service platform prob

l Monitor standard interface such as Gb/lu-PSGnGiGw

Easy to deploy and nearly no impact on Network Performancel Monitor mirroring portnearly have no impact on network Performance and

architecture

E2E QoE Optimization Solution and capabilityl Joint optimization for UE, RAN, CN, Application and network

l System platform and capability improve based QoE requirement

ireless Beare Core App

Mirroring Port

UserExpe-rience

lu-PS Gi MMXGwGn

QoE

KQI KQIKPI

KPI

KPI

KPI

KQIKPI

KPI

KPI

KPI

Probe



20/21

iscussion) Which services/applications are you mostly focus on?

) What are your comments and suggestion for Terminal based QoE evaluation solution? E.

measurement indicators/resolution, report mechanism, operation model etc ?

) For network O&M, How long will it take to locate problem? How long it will take to solve it

) What are your requirement on data collecting by probe?

) Do you prefer service monitoring for 7*24 E2E or only for busy hour?

) What are the most complains on the MBB service usage in your network?

) Which service/application and which experience factor shall be optimized and improved?

Web first page loading time, Web Page Refreshing Success Ratio etc.

ny other requirements and suggestions???



21/21

Thank You

www.huawei.com
http://www.huawei.com/http://www.huawei.com/

4_huawei mbb qoe assurance solution-10!06!01

Documents