quality of service department - tra oman · key performance indicators ... – this indicator is...

12
Mobile Network Performance Assessment Report Salalah Khareef Season 2015 Regulatory & Compliance Unit Quality of Service Department

Upload: phungtuong

Post on 06-May-2018

214 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

Mobile Network Performance Assessment Report

Salalah Khareef Season 2015

Regulatory & Compliance Unit Quality of Service Department

Page 2: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

Contents

1. Background

2. Test Methodology

3. Performance Indicators Definition

4. Results

5. Conclusion

Page 3: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

1. Background

A comprehensive field test was conducted independently by TRA to assess the performance of

Omantel and Ooredoo mobile voice and data networks in Salalah during the Khareef Season 2015.

Field Survey Date & Time: 26th – 30th July 2015, from 9:00 A.M. to 10:00 P.M.

Services Tested

Test Area

Network Service Technology

Omantel Voice 3G

Data 4G (LTE)

Ooredoo Voice 3G

Data 4G (LTE)

Governorate Wilayat

Dhofar Salalah

Page 4: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

2. Test Methodology

The following test configuration was used for measurements: Service

Tested

Technology

Mode

Objective Test sequence KPIs measured

Omantel-

Mobile voice

3G To check network

accessibility, retain-ability,

mobility, service integrity

and coverage

Repetitive Calls of 90 sec. duration CSSR, CDR, CSR,

RSCP.

Omantel-

Mobile data

4G To check data network

performance and

coverage

HTTP file download from the

service providers network and ping

test.

Latency, Ping Packet

Success Rate, Avg.

downlink throughput,

RSRP.

Ooredoo-

Mobile voice

3G To check network

accessibility, retain-ability,

mobility service integrity

and coverage

Repetitive Calls of 90 sec. duration CSSR, CDR, CSR,

RSCP.

Ooredoo-

Mobile data

4G To check data network

performance and

coverage

HTTP file download from the

service providers network and ping

test.

Latency, Ping Packet

Success Rate, Avg.

downlink throughput,

RSRP.

Page 5: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

3. Key Performance Indicators (KPIs) Definition

Mobile voice performance was measured based on the following set of KPIs: Call Setup Success Rate (CSSR)– This indicator is used to measure the percentage of calls successfully

established without facing blockage in the network as a ratio of the total number of call attempts made to access

and establish a voice call. (to check network accessibility)

Call Drop Rate (CDR) – This indicator is used to measure the percentage of calls dropped due to technical

problems or coverage gaps in the service provider’s network as a ratio of the total number of calls successfully

established. (to check network retain-ability)

Call Success Rate (CSR) – This indicator is used to measure the percentage of calls successfully established

without facing blockage in the network as a ratio of the total number of call attempts made to access and establish

a voice call and then successfully terminated from the user-end without being dropped or disconnected from the

network side due to a technical irregularity. (to check service integrity)

Mobile data performance was measured based on the following set of KPIs:

Packet Latency - Packet delay, which represents the time taken for data packets to pass through the GPRS

bearer in a round-trip time from the mobile to the server in the service provider’s core network and back to the

mobile. (to check delay in the network)

Ping Packet Success Rate is the percentage of packets lost between designated routes in the network. It is

used to indicate the loss of data packets during transmission over a telecommunications network. (to check data

integrity)

HTTP Average downlink throughput - This is the average downlink throughput (rate at which data/bits are

transferred to the user) experienced by a user while downloading content from the Internet. (to check download

speed)

Page 6: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

Performance Indicators Definition (continued)

Coverage is assessed based on the following radio parameters:

Reference Signal Received Power (RSRP) – This indicator measures the linear average of the received power

on reference signal resource elements in the downlink during the drive test (to assess 4G/LTE coverage).

Received Signal Code Power (RSCP) – This indicator measures the received signal code power of the pilot

channel in the downlink during the drive test (to assess 3G/UMTS coverage).

Received Signal Level (RxLevSub) - This indicator measures the received signal strength in downlink during the

drive tests (to assess 2G/GSM coverage).

The following convention is used for the coverage plot.

Serving Cell RSRP (dBm) CPICH RSCP (dBm) RxLevSub (dBm)

Range

Range

Range Classification

Estimated Signal

Penetration

>= - 85 >= -80 >= -75 Excellent Indoor

>= -95 and < -85 >=-87 and <-80 >=-82 and <-75 Good

>= -105 and < -95 >=-100 and <-87 >=-95 and <-82 Fair In-Car

>= 120 and < -105 <-100 <-95 Weak Outdoor Only

Page 7: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

4. Results 4.1a Mobile Voice Coverage

98.81 97.33

1.16 1.42 0.03 1.09 0.00 0.17 0

10

20

30

40

50

60

70

80

90

100

Omantel Ooredoo

PD

F (%

) Salalah Voice Coverage Distribution

Excellent Good Fair Weak

Indoor, In-Car & Outdoor Coverage

In-Car & Outdoor Coverage

No Indoor Coverage, Only Outdoor

Page 8: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

4. Results 4.1b Mobile Data Coverage

Indoor, In-Car & Outdoor Coverage

In-Car & Outdoor Coverage

No Indoor Coverage, Only Outdoor

76.34 68.66

16.08 12.46 4.25 11.11 3.33 7.77 0.00

10.00

20.00

30.00

40.00

50.00

60.00

70.00

80.00

90.00

100.00

Omantel Ooredoo

PD

F (%

) Salalah Data Coverage Distribution

Excellent Good Fair Weak

Page 9: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

4.2 Mobile Voice Performance

CSR: Call Success Rate (Higher is better)

CDR: Call Drop Rate (Lower is Better)

CSSR: Call Setup Success Rate (Higher is better)

99.2

0

99.2 99.56

0.45

99.11 98

0.8

95

0

10

20

30

40

50

60

70

80

90

100

CSSR CDR CSR

Val

ue

(%

)

KPI

Voice Performance Indicators

Omantel Ooredoo TRA Threshold

Page 10: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

0

5

30

100

12.8

4.3 Mobile Data Download Speed

0

5

30

100

7.4

Overall Avgerage Download Speed (Mbps)

Maximum Download Speed Attained (Mbps)

0

5

30

100

11.7

0

5

30

100

63.7

Download Speed: Higher is Better

Page 11: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

4.4 Mobile Data Performance

Packet Latency (ms): Lower is Better (Less than 120 ms is desired), Ping Packet Success Rate: Higher is Better (Greater than

99% is desired)

89.75 90.07

59.06

61.53

0

10

20

30

40

50

60

70

80

90

100

110

120

130

140

84

86

88

90

92

94

96

98

100

1

Pac

ket

Late

ncy

(m

s)

Pin

g P

acke

t Su

cce

ss R

ate

(%

) Data Performance Indicators

Ping Packet Success Rate Omantel Ping Packet Success Rate Ooredoo

TRA Threshold (Packet Latency) Packet Latency Omantel

Packet Latency Ooredoo

Page 12: Quality of Service Department - TRA Oman · Key Performance Indicators ... – This indicator is used to measure the percentage of calls successfully ... (to assess 3G/UMTS coverage)

5 Conclusion

• In General, both Omantel and Ooredoo exhibit excellent 3G mobile voice and data coverage in and around

Salalah.

• Omantel and Ooredoo exhibit strong LTE coverage in Salalah City.

• Omantel and Ooredoo mobile voice performance is found to be very good with all Key Performance Indicators

meeting TRA thresholds.

• Mobile broadband download speeds (on LTE network) are found to be good with an average speed of above 5

Mbps. Ooredoo mobile broadband network exhibits faster download speeds.

• Omantel and Ooredoo mobile broadband networks (LTE) exhibit low packet delay which is well within the TRA

threshold.

Basis of results and conclusion

• The coverage information is based on the geographical drive test route used during the measurement exercise.

• The exercise has been conducted independently by the TRA without sharing any prior information with the

service providers about the type of tests being performed or location.

• The results of the exercise are based on the data collected from the field at a certain instance of time and day;

network behaviour may vary with traffic variations over time and occurrence of events.

• Industry standard tools have been used and work best practices are ensured during the whole exercise.