3g-bmc report- kampala 25 june 2015
DESCRIPTION
DTBMTRANSCRIPT
18/04/232
© Nokia 2014
Confidential
Document Review/ Version Control
Title:3G-Network
Benchmarking ReportKampala
Document ID:
Version: Ver.1
Status: Final
Type: BM Report
Security Classification: For internal use
Organization Name: GS Global Service Delivery
Owner: Vishal
Author, Creation Date: Vishal 28-June-2015
Reviewer, Review Date Kunal 2-July-2015
Approver, Approval Date: Lalit Gururani 2-July-2015
Change History
Version Date Handled by Comments and status
1.0 2-July-2015 Vishal Final
18/04/233
© Nokia 2014
Confidential
UMTS Benchmarking Objective.
Mode ObjectiveIdle -Compare Coverage
Dual Mode Call -Compare Call Setup Time
-Compare Accessibility
-Compare Retainability
-Compare SHO & ISHO SR
-Compare Received Quality
- Compare Reselection Statistics
Dual Mode Data Call -Compare FTP, HTTP accessibility
FTP – Compare throughputs
HTTP – Compare throughputs
HTTP – Compare browsing experience
PING – Compare latency
Comparison between Airtel, Orange & MTN Networks
18/04/234
© Nokia 2014
Confidential
Device Configuration
Operator
IDLE MODE
DUAL MODE
FTP HTTP PING
MOC MOC Data Data Data
AirtelAirtel
Mobile(1)Airtel
Mobile(2)NA NA
http://www.google.c
o.ug/
OrangeOrange
Mobile(1)Orange
Mobile(2)NA NA
http://www.google.c
o.ug/
MTNMTN
Mobile(1)
MTN Mobile(2) NA NA
http://www.google.c
o.ug/
18 April 2023 4
18/04/235
© Nokia 2014
Confidential
Content
Overview
RSCP Coverage footprint comparison
Ec/No Comparison
CQI distribution
Data technology distribution
Active set Distribution
Accessibility comparison
Modulation comparison
FTP Comparison
HTTP comparison
Ping Test comparison
Benchmarking Summary
18/04/236
© Nokia 2014
Confidential
Kampala Network Overview
Operator Technology Band of operation
Subscribers (Circle wide)
Mar 2012 Figures
(in Millions)
No of carriers Benchmarked
Airtel UMTS 2100 - F1 √
Orange UMTS 2100 - F1 √
MTN UMTS 2100 - F1 √
Uganda Population: 34.51 (million – 2011)(Kampala : 1,659,600)
Area: Uganda 236,040 sq km : Kampala 189 sq km** Source Google/Wikipedia
18/04/237
© Nokia 2014
Confidential
Benchmarking Testing Overview
Date & time
of testing
From 16 June 2015,00:02 AM
To 22 June 2015, 03:17 AM
Drive
distance • 426 km
Tests done
• Coverage footprint RSCP (Idle mode)
• Ec/No footprint (Call Sequence Mode)
• Data throughput and latency test (FTP,HTTP,PING)
Test Call pattern
• Data sessions
Kampala Drive Route
Drive Route
18/04/238
© Nokia 2014
Confidential
Number of Sites Comparison
• Airtel is 1st in terms of number of 3G sites ( Site count is based on average Number of serving sites/Log file , Exact data not available.)
Operators Number of Sites from Log RankingAIRTEL 229 1
ORANGE 208 3MTN 226 2
18/04/2311 © Nokia 2014
Confidential
Data Testing Algorithm
•After every application test, we have 2 sec Idle time before the next Application is tested.
No HTTP Websites1 www.google.com2 www.facebook.com3 www.yahoo.com4 www.onlinesbi.com5 www.cricinfo.com6 www.ovi.com7 www.youtube.com8 www.flipkart.com9 www.irctc.co.in10 www.rediff.com
Test Details SpecificationsNo of Operators tested Dual Mode (Airtel, Orange & MTN)
Data Test AlgorithmAttach and PDP Activation Before every testPing 3 times - 32 bytes on www.google.co.inFTP Download 15 MB (for Dual Mode) from serverFTP Upload 1 MB to ServerHTTP 10 different websites.
18/04/2312 © Nokia 2014
Confidential
Strategic Location Testing
Strategic Locations Specifications
No of Operators tested 3G Mode (Airtel ,Orange & MTN)
Data Test Algorithm
FTP Download 50MB
FTP Upload 10MB
Apart from the above tests during the drive, at 11 strategic locations across the city, additional stationary tests were carried out. These locations are important locations of the city(Hot Spots).
18/04/2313 © Nokia 2014
Confidential
Overall Results
18 April 2023
13
1st in Accessibility.1st in Retainability. 2nd in Voice Score.1st in Coverage.1st in SHO SR
Strength
3rd in Quality.2nd in Data Score.
Weakness
Opportunity Threat
Make use of findings from the BM to improve weak areas
No. KPIScore Ranking
AIRTEL ORANGE MTN AIRTEL ORANGE MTN
1 Voice Score (%) 92.66% 91.04% 91.60% 1 3 2
2 Data score (%) 55.2% 55.5% 52.4% 2 1 3
3Coverage (% of samples RSCP >
-82dbm) 71.30% 66.80% 71.00% 1 3 2
4 EcNo (% of samples 0-8) 31.60% 53.80% 46.50% 3 1 2
Data score formula= [FTP Tests%*65+HTTP Browsing%*25+RTT%*10]/100Voice Score(%) = [Coverage%*33.33+CSSR%*33.33+CCSR%*33.33]/100
18/04/2314 © Nokia 2014
Confidential
Comparison Overview3G - Airtel
3G Orange 3G MTNKPI Kampala KPI Kampala KPI Kampala
No. of NodeB in Town 229 No. of NodeB in Town 208 No. of NodeB in Town 226
% of Rxlevel sample better then -75 dBm 47.7 % of Rxlevel sample better
then -75 dBm 43.4 % of Rxlevel sample better then -75 dBm 48.5
% of Rxlevel sample between -75 dBm to -85 dBm 32.4
% of Rxlevel sample between -75 dBm to -85
dBm33.1
% of Rxlevel sample between -75 dBm to -
85 dBm30.6
% of Rxlevel sample between -85 dBm to -95 dBm 17.0
% of Rxlevel sample between -85 dBm to -95
dBm18.3
% of Rxlevel sample between -85 dBm to -
95 dBm16.5
% of Rxlevel sample below -95 dBm 2.9 % of Rxlevel sample below -
95 dBm 5.1 % of Rxlevel sample below -95 dBm 4.4
% of Ec/Io sample better then -13 84.8 % of Ec/Io sample better
then -13 94.5 % of Ec/Io sample better then -13 92.1
Average DL Throughput (Kbps)- 4165.17 Average DL Throughput
(Kbps) 3944.79 Average DL Throughput (Kbps) 3858.15
% of samples of DL Mobility => 3 Mbps
73.91 % of samples of DL Mobility => 3 Mbps
62.41 % of samples of DL Mobility => 3 Mbps
61.53
Call Setup Time(s) 6.6 Call Setup Time(s) 5.8 Call Setup Time(s) 6.3
18/04/2317 © Nokia 2014
Confidential
Coverage Rate (%) = A%*10+B%*8+C%*6+D%*1 [D should be considered till -98dBm]
10
For UMTS operator, RSCP is used to measure coverage
A % samples where RSCP is greater -74dBm B % samples where RSCP is between -74 and -82 dBm C % samples where RSCP is between -82 and -90dBm D % samples where RSCP is between -90 and -98dBm
Coverage statistics Criteria
Airtel is 1st in Coverage Score.
Coverage Score AIRTEL ORANGE MTN
0 to -74 4.42 4.04 4.54
-74 to -82 2.168 2.112 2.048
-82 to -92 1.362 1.464 1.278
-92 to -98 0.047 0.062 0.055
Score 79.97% 76.78% 79.21%
18/04/2318 © Nokia 2014
Confidential
Voice Score statistics
Airtel is 1st in overall Voice Score.
OPERATOR CSSR BLOCKEDAIRTEL 99.34% 0.66%
ORANGE 99.28% 0.72%MTN 98.74% 1.26%
OPERATOR CCSR DROPPEDAIRTEL 98.68% 0.66%
ORANGE 97.10% 2.19%MTN 96.86% 1.91%
Overall Voice Score Score RankAIRTEL 92.66% 1
ORANGE 91.04% 3MTN 91.60% 2
Voice Score(%) = [Coverage%*33.33+CSSR%*33.33+CCSR%*33.33]/100
Coverage Score AIRTEL ORANGE MTN0 to -74 4.42 4.04 4.54
-74 to -82 2.17 2.11 2.05-82 to -92 1.36 1.46 1.28-92 to -98 0.05 0.06 0.06
Score 79.97% 76.78% 79.21%
18/04/2319 © Nokia 2014
Confidential
Accessibility Statistics
Airtel is 1st in Accessibility KPI.
OPERATOR Total Call Attempts Total Call Block Accessibility Ranking
AIRTEL 152 1 99.34% 1ORANGE 138 1 99.28% 2
MTN 159 2 98.74% 3
OPERATOR CSSR (%) BLOCKED (%)
AIRTEL 99.34% 0.66%ORANGE 99.28% 0.72%
MTN 98.74% 1.26%
18/04/2320 © Nokia 2014
Confidential
CCSR - Retainability Statistics
Airtel is 1st in Retainability.
Total Call Established Total Call Drop Retainability Ranking
AIRTEL 151 1 99.34% 1ORANGE 137 3 97.81% 3MTN 157 3 98.09% 2
OPERATOR CCSR (%) DROPPED (%)
AIRTEL 98.68% 0.66%ORANGE 97.10% 2.19%
MTN 96.86% 1.91%
18/04/2321 © Nokia 2014
Confidential
SHO Statistics
OPERATOR HO SR (%) HO FR (%)
AIRTEL 100.00% 0.00%ORANGE 100.00% 0.00%
MTN 100.00% 0.00%
OPERATORTotal Handover
AttemptsTotal Handover
FailSHO SR Ranking
AIRTEL 5282 0 100.00% 1ORANGE 4655 0 100.00% 1
MTN 4944 0 100.00% 1
Airtel is 1st in SHO SR.
18/04/2322 © Nokia 2014
Confidential
ISHO Statistics
OPERATOR ISHO SR (%) ISHO FR (%)
AIRTEL 100.00% 0.00%
ORANGE 100.00% 0.00%
MTN 98.59% 1.41%
OPERATORTotal Handover
AttemptsTotal Handover
FailISHO SR Ranking
AIRTEL 20 0 100.00% 1ORANGE 12 0 100.00% 1
MTN 71 1 98.59% 2
Airtel is 1st in ISHO SR.
18/04/2323 © Nokia 2014
Confidential
Reselection StatisticsOPERATOR AIRTEL ORANGE MTN
IRAT Selection 2G3G 20 8 68
IRAT Selection 3G2G 5 4 7
18/04/2325 © Nokia 2014
Confidential
Coverage Footprint RSCP (AIRTEL)
Site and sectors are not plotted to maintain visibility.