bës tni test. - umlaut.com...survey we proudly award this certificate to vodafone ireland score 884...

10
For adding something on top in Ireland and reaching an overall score of 884 dots in mobile network benchmarking survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480 in Data Services Score 167 out of 200 in Crowdsourced Quality bëst in test. Hakan Ekmen Chief Executive Officer Telecommunication 02 20

Upload: others

Post on 09-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: bës tni test. - UMLAUT.COM...survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480

For adding something on top in Ireland and reaching an overall score of 884 dots in mobile network benchmarking survey we proudly award this certificate to

Vodafone Ireland

Score 884 out of 1000 in TotalScore 290 out of 320 in Voice ServicesScore 427 out of 480 in Data ServicesScore 167 out of 200 in Crowdsourced Quality

bëst in test.

Hakan EkmenChief Executive Officer Telecommunication

Mobile BenchmarkIreland

02 20

Page 2: bës tni test. - UMLAUT.COM...survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480

Measurement setupMeasurement Overview

Drivetest Voice Data

Device Samsung Galaxy S9 Samsung Galaxy S9

Test Cases Mobile-to-Mobile (M2M)Channel1: Side1 (VoLTE) to Side2 (VoLTE) Channel2: Side1 (VoLTE) to Side2 (VoLTE) 115 sec call window70 sec call duration15 sec call setup timeoutMulti-RAB traff ic injection on both sides

Data 4G preferred CAHTTP DL datastream 7sHTTP UL datastream 7sHTTP 5MB DL fi xed fi le transferHTTP 2.5MB UL fi xed fi le transferWeb Browsing - Kepler ETSI Ref. Page10 Live web pages 3 YouTube HD video ~ 45s

Mobility andRoute Types

100% Drivetest54% in Cities, 20% in Towns and 26% on Roads

Samples ~ 12606 ~ 64572

Dates 13 measurement days07.02.2020 – 21.02.2020

Crowd DataAssessment

24 weeksCW35 2019 – CW06 2020

2

umlaut certifi cate umlaut certifi cate

3

umlaut tested and measured the performance of its voice

and data services on smartphones in comparison to other

LTE/UMTS/GSM mobile radio networks in metropolitan

and rural areas of Ireland.

The audit was done as a performance benchmark performed

by umlaut between 07.02.2020 – 21.02.2020 in cities and

towns as well as on connection roads.

Dedicated measurements have been executed as drive

tests outdoors using a Samsung Galaxy S9 cat16 Smart-

phone 1000 Mbit/s Download / 105 Mbit/s Upload.

All data measurements have been performed in 4G

preferred mode. Voice measurements have been done in

4G/4G preferred mode on both sides, while call origin has

been alternated.

In addition crowdsourced performance data has been

collected and evaluated between CW35 2019 and CW06

2020.

The following pages provide a comparative overview

about the performance results observed for the

different tested service types.

Page 3: bës tni test. - UMLAUT.COM...survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480

Testing areasDrive route

Testing areasCrowdsourcing based test area

99.5 % of populated areas Urban

90.0 % of populated areas Non-Urban

54.166 km2

size of tested area

42 % of population measured

3100 kmmeasuring distance

DublinGalway

Limerick

Cork

Waterford

DroghedaNavah

Swords

Dundalk

4

umlaut certifi cate umlaut certifi cate

5

Page 4: bës tni test. - UMLAUT.COM...survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480

Claims Methodology

The leader in mobile benchmarking, umlaut, has analy-

zed the mobile networks of Ireland with regards to mobile

network performance. We measure smartphone voice and

data performance based on extensive drivetests – from

major metropolitan areas to smaller cities and connection

roads.

We objectively define the routes and test methodology

and publish the results through certificates or public

benchmark reports.

As the de-facto industry standard, our benchmarking

methodology focuses on customer-perceived network

quality and covers a wide range of mobile services.

Today, more than 200 mobile networks in more than

120 countries are being evaluated by our unique scoring

methodology. It allows a technical analysis that is unpre-

cedented in its level of detail and enables comparisons

between the network performance and capability of each

mobile network. Our public benchmarks as well as the

certificate benchmarks help network operators to demon-

strate how well they are delivering wireless connections to

consumers, business users and enterprises and reveals the

areas of improvement.

Best in crowd-sourced qualityVodafone Ireland

Best in voiceVodafone Ireland

Best in dataVodafone Ireland

Best in testVodafone Ireland

6

umlaut certifi cate umlaut certifi cate

7

Page 5: bës tni test. - UMLAUT.COM...survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480

Score and breakdown

Shown scores are rounded.

Vodafone achieved the highest overall score among competitors with 884 dots out of 1000.

Total score

Vodafone Operator 2 Operator 3

Voice max. 320 290 190 147

Cities Drivetest 192 90% 60% 42%

Towns Drivetest 64 96% 63% 57%

Roads Drivetest 64 86% 53% 49%

Data max. 480 427 341 321

Cities Drivetest 288 92% 72% 69%

Towns Drivetest 96 84% 67% 62%

Roads Drivetest 96 84% 70% 65%

Crowdsourced Quality max. 200 167 160 146

Crowd 200 84% 80% 73%

Total 1000 884 691 614

Overall score considering Voice, Data and Crowdsourcing.

Total Score1000 Dots

Operator 2

341

190

160

Operator 3

321

147

146

- S

how

n to

tal s

core

s ar

e ro

und

ed.

Vodafone

427

290

167

Voicemax. 320

Datamax. 480

Crowdmax. 200

Operator

884

691

614

8

umlaut certifi cate umlaut certifi cate

9

Page 6: bës tni test. - UMLAUT.COM...survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480

Achieved percentage of the maximum score in each of the diff erent data services. Achieved percentage of the maximum score in each of the diff erent crowdsourcing services.

Data Service Group max Vodafone Operator 2 Operator 3

Cities

Web Browsing 64,0 99% 87% 86%

File Download 80,0 87% 71% 66%

File Upload 80,0 93% 80% 73%

YouTube 64,0 92% 50% 51%

Towns

Web Browsing 21,3 97% 86% 81%

File Download 26,7 79% 66% 63%

File Upload 26,7 82% 70% 65%

YouTube 21,3 81% 47% 40%

Roads

Web Browsing 21,3 95% 83% 82%

File Download 26,7 85% 72% 69%

File Upload 26,7 76% 66% 59%

YouTube 21,3 81% 60% 51%

Crowd Service Group max Vodafone Operator 2 Operator 3

Country Operational Excellence 60 100% 97% 100%

Urban

Voice Coverage 13 93% 98% 89%

Data Coverage 17 99% 95% 88%

4G Coverage 29 58% 48% 27%

DL Data Speed 17 72% 66% 59%

UL Data Speed 8 58% 64% 52%

Non-urban (Benchmark view)

Voice Coverage 7 100% 100% 100%

Data Coverage 9 100% 100% 99%

4G Coverage 15 87% 79% 58%

DL Data Speed 9 64% 64% 46%

UL Data Speed 4 35% 39% 33%

Non-urban (Own network view)

Voice Coverage 2 100% 99% 99%

Data Coverage 2 100% 100% 99%

4G Coverage 4 78% 76% 57%

DL Data Speed 2 45% 49% 37%

UL Data Speed 1 21% 25% 26%

10

umlaut certifi cate umlaut certifi cate

11

Page 7: bës tni test. - UMLAUT.COM...survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480

Voice KPI overviewAchieved values of all networks under test in each of the relevant Voice Key Performance Indicators (KPIs) for the

geographical categories “Cities”, “Towns” and “Roads”.

Voice Service Group Unit Vodafone Operator 2 Operator 3

Cities

Qualifi er [%] 98,6 97,6 95,2

Call Setup Time [s] 2,3 8,3 9,0

Call Setup Time (P90) [s] 3,0 9,5 11,1

Speech Quality (AVG) [MOS-LQO] 3,9 3,6 3,4

Speech Quality (P10) [MOS-LQO] 3,4 3,2 2,6

Multirab connectivity [%] 99,7 31,1 73,5

Towns

Qualifi er [%] 99,7 97,7 97,7

Call Setup Time [s] 2,3 7,8 8,8

Call Setup Time (P90) [s] 2,8 8,8 10,5

Speech Quality (AVG) [MOS-LQO] 3,8 3,7 3,5

Speech Quality (P10) [MOS-LQO] 3,3 3,2 2,6

Multirab connectivity [%] 100,0 29,8 72,9

Roads

Qualifi er [%] 97,0 93,3 94,3

Call Setup Time [s] 2,4 8,0 8,6

Call Setup Time (P90) [s] 3,1 9,0 10,4

Speech Quality (AVG) [MOS-LQO] 3,7 3,6 3,4

Speech Quality (P10) [MOS-LQO] 3,0 3,2 2,3

Multirab connectivity [%] 99,3 30,4 60,4

Data Services KPI overviewAchieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the

geographical category “Cities”.

Data Cities KPI Name Unit Vodafone Operator 2 Operator 3

HTTP Live Page DL Smartphone

Qualifi er [%] 99,9 98,2 97,8

Overall Session Time [s] 0,9 1,2 1,2

HTTP Static Page DL Smartphone

Qualifi er [%] 100,0 97,9 98,2

Overall Session Time [s] 1,0 1,2 1,2

HTTP 5MB DL Smartphone

Qualifi er [%] 100,0 99,3 99,0

Average Session Time [s] 1,9 5,6 5,6

90% faster than [Mbit/s] 12,4 3,1 3,5

10% faster than [Mbit/s] 78,9 59,5 50,2

HTTP 2500KB UL Smartphone

Qualifi er [%] 99,8 99,0 99,0

Average Session Time [s] 1,5 2,3 2,8

90% faster than [Mbit/s] 8,4 5,3 3,4

10% faster than [Mbit/s] 39,0 26,7 25,8

HTTP DL FDTT

Qualifi er [%] 99,8 98,8 97,4

Average Data Rate [Mbit/s] 50,5 29,0 27,5

90% faster than [Mbit/s] 11,7 3,0 3,8

10% faster than [Mbit/s] 100,7 67,2 57,4

HTTP UL FDTT

Qualifi er [%] 99,9 98,8 97,9

Average Data Rate [Mbit/s] 29,9 22,9 17,8

90% faster than [Mbit/s] 9,6 5,0 3,4

10% faster than [Mbit/s] 52,2 44,5 29,0

YouTube

Qualifi er [%] 99,2 91,9 92,6

Start Time [s] 1,1 1,3 1,3

AVG Resolution [p] 911 880 882

YouTube LiveSmartphone

Qualifi er [%] 99,3 93,4 92,8

Start Time [s] 1,1 1,4 1,5

AVG Resolution [p] 1030 1005 990

12

umlaut certifi cate umlaut certifi cate

13

Page 8: bës tni test. - UMLAUT.COM...survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480

Data Services KPI OverviewAchieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geo-

graphical category “Towns”.

Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geo-

graphical category “Roads”.

Data Towns KPI Name Unit Vodafone Operator 2 Operator 3

HTTP Live Page DL Smartphone

Qualifi er [%] 99,8 98,1 97,7

Overall Session Time [s] 1,1 1,2 1,4

HTTP Static Page DL Smartphone

Qualifi er [%] 99,8 97,6 97,4

Overall Session Time [s] 1,2 1,2 1,5

HTTP 5MB DL Smartphone

Qualifi er [%] 100,0 98,2 98,9

Average Session Time [s] 3,2 4,9 8,2

90% faster than [Mbit/s] 6,0 3,3 2,0

10% faster than [Mbit/s] 61,2 59,6 46,8

HTTP 2500KB UL Smartphone

Qualifi er [%] 99,6 98,2 98,5

Average Session Time [s] 2,7 3,3 3,9

90% faster than [Mbit/s] 3,7 3,3 3,1

10% faster than [Mbit/s] 27,7 24,9 23,7

HTTP DL FDTT

Qualifi er [%] 99,3 97,8 97,8

Average Data Rate [Mbit/s] 36,4 31,7 23,9

90% faster than [Mbit/s] 4,9 3,7 2,2

10% faster than [Mbit/s] 82,6 65,5 55,3

HTTP UL FDTT

Qualifi er [%] 99,6 97,5 96,4

Average Data Rate [Mbit/s] 18,3 21,6 13,1

90% faster than [Mbit/s] 3,8 3,2 2,2

10% faster than [Mbit/s] 37,0 44,3 27,6

YouTube

Qualifi er [%] 97,5 91,7 87,5

Start Time [s] 1,5 1,3 1,4

AVG Resolution [p] 891 865 852

YouTube LiveSmartphone

Qualifi er [%] 97,8 92,5 88,8

Start Time [s] 1,6 1,5 1,6

AVG Resolution [p] 998 984 934

Data Roads KPI Name Unit Vodafone Operator 2 Operator 3

HTTP Live Page DL Smartphone

Qualifi er [%] 99,3 96,1 96,5

Overall Session Time [s] 1,2 1,3 1,5

HTTP Static Page DL Smartphone

Qualifi er [%] 99,2 95,6 96,2

Overall Session Time [s] 1,3 1,4 1,7

HTTP 5MB DL Smartphone

Qualifi er [%] 100,0 96,7 97,7

Average Session Time [s] 4,7 5,7 8,6

90% faster than [Mbit/s] 3,9 2,9 1,9

10% faster than [Mbit/s] 58,4 59,3 45,4

HTTP 2500KB UL Smartphone

Qualifi er [%] 97,5 96,2 95,3

Average Session Time [s] 4,0 4,7 5,8

90% faster than [Mbit/s] 2,3 1,8 1,3

10% faster than [Mbit/s] 24,8 22,6 21,6

HTTP DL FDTT

Qualifi er [%] 99,4 95,9 96,5

Average Data Rate [Mbit/s] 28,9 31,8 20,8

90% faster than [Mbit/s] 4,3 3,5 2,0

10% faster than [Mbit/s] 77,5 72,4 54,8

HTTP UL FDTT

Qualifi er [%] 97,0 93,8 91,9

Average Data Rate [Mbit/s] 14,9 15,8 10,4

90% faster than [Mbit/s] 3,0 1,6 1,7

10% faster than [Mbit/s] 30,2 38,7 24,7

YouTube

Qualifi er [%] 95,1 89,5 85,8

Start Time [s] 1,5 1,5 1,8

AVG Resolution [p] 882 877 811

YouTube LiveSmartphone

Qualifi er [%] 96,5 88,8 91,2

Start Time [s] 1,5 1,5 1,9

AVG Resolution [p] 991 1005 900

14

umlaut certifi cate umlaut certifi cate

15

Page 9: bës tni test. - UMLAUT.COM...survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480

Crowdsourced Quality KPI overviewAchieved values of all networks under test in each of the relevant Crowd Key Performance Indicators (KPIs) for the geo-

graphical categories “country”, “urban” and “non-urban”.

Crowd Service Group Unit Vodafone Operator 2 Operator 3

CountryOperational Excellence

Degraded days [d] 0 1 0

Degraded periods [h] 0 2 0

Urban

4G Coverage Quality of Coverage [%] 89,5 87,0 81,7

Data Coverage Quality of Coverage [%] 99,8 99,2 98,2

DL Data Speed P90 EA Top Throughput [Mbit/s] 64.1 57.2 51.0

UL Data Speed P90 EA Top Throughput [Mbit/s] 13.4 15.2 11.9

Voice Coverage Quality of Coverage [%] 99,6 99,9 99,5

Non-urban (Benchmark view)

4G Coverage Test Area Coverage [%] 96,1 93,6 87,5

Data Coverage Test Area Coverage [%] 100,0 100,0 99,8

DL Data Speed P90 EA Top Throughput [Mbit/s] 25.4 25.3 20.2

UL Data Speed P90 EA Top Throughput [Mbit/s] 3.5 4.0 3.4

Voice Coverage Test Area Coverage [%] 100,0 100,0 100,0

Non-urban (Own network view)

4G Coverage Test Area Coverage [%] 93,3 92,8 87,1

Data Coverage Test Area Coverage [%] 99,9 99,9 99,8

DL Data Speed P90 EA Top Throughput [Mbit/s] 20.1 21.1 18.4

UL Data Speed P90 EA Top Throughput [Mbit/s] 2.6 2.8 2.9

Voice Coverage Test Area Coverage [%] 100,0 99,9 99,9

16

umlaut certifi cate

Page 10: bës tni test. - UMLAUT.COM...survey we proudly award this certificate to Vodafone Ireland Score 884 out of 1000 in Total Score 290 out of 320 in Voice Services Score 427 out of 480

umlaut AG

Am Kraftversorgungsturm 3 · 52070 Aachen · Germany

Hakan Ekmen · Chief Executive Officer Telecommunication

cell +49 151 571 33 235 · [email protected]

www.umlaut.com