public

public

2021 Fixed Broadband Benchmarking Framework

Document Version V1.1 December, 2021

public

Benchmarking, our Territöry.The Industry Standard.

August 2021Fixed Broadband Methodology 2

Our top priority is to fairly and transparently assess the global development of networks, push their quality and performance with our benchmarks and ultimately achieve improvements for every customer.

We apply our unique scoring methodology to fixed line ISPs globally.

This year’s methodology introduces active testing components to the set of evaluation criteria to complement the user centric passive observation of internet speeds with an ISP centric view.

public

Prefäce.The umlaut Benchmarking Framework Basis.

Fixed Broadband Methodology 3

Key features:

International comparability

End customer relevance

Drill-down capability

Transparency

The umlaut Benchmarking Framework is based on a unified measurement method for true international comparability combined with the umlaut-Score approach.

August 2021

public

Rationäle.How to stay focused?

Measuring performance means collecting a vast multitude of different performance indicators, so the important aspects can be easily missed. The question is how to stay focused and communicate results smoothly?

The umlaut Score, as a management tool, is umlaut’s solution which: aggregates the complete set of KPIs into a single score figure,

preserving the drilldown capability

features implicit weighting of environment, services and KPIs and comparability on national and international level …

Fixed Broadband Methodology 4August 2021

public

umlaut Scöre.As a Management Tool.

BenchmarkYour network against competitors in or across markets

Manageable targetsDerive achievable targets to steer your teams

Unique performance profileThat characterizes your network

Learning from best in class Understand what can be achieved with similar setup

PrioritiesHelp steering your investments where they make

an impact to the user

HistoryBenchmark against your former self

5Fixed Broadband Methodology

0 1000

August 2021

public

umlaut Scöre Principles.Building Blocks.

Fixed Broadband Methodology 6

The umlaut score delivers a robust scale to assess network quality and performance. It is coupled with a unified measurement methodology for true international comparability.

Modular Score Approach

Unified MeasurementMethodology

ConsistentReporting

August 2021

public

The umlaut Fixed Broadband Score covers an assessment of ISPs obtained through the observation of end user performance with devices connected to fixed line ISPs via WiFi.

The score works based on the identificationof individual subscriber lines and their speedcapabilities.

It also provides means to take into account the different geographicaldistribution of data from differentISPs to ensure a fair comparison.

Cöncept Overview.

Fixed Broadband Methodology 7

• Defined weighting between performance aspects

• Download speeds

• Upload speeds

• Round Trip Time Latency

• Relation of observed performance

• to typical end-user services

• Fixed maximum score

Characterized by

August 2021

Properties

public

umlaut Score Family.Modularity and Hierarchy.

Fixed Broadband Methodology 8

umlaut delivers user experience and performance ratings for the communications and other industries. The family of umlaut score products is depicted below and constantly being expanded.

This document focuses on the Fixed Broadband Score.

max. 1000 ptMobile Broadband Score

max. 1000 pt5G Mobile Crowd Score

max. 1000 ptFixed Broadband Score

Scope:1) Network Testing Voice and

Data Experience and Performance, Focus on “best

available product”2) Crowdsourcing Mobile

Broadband (4G+5G focus), Coverage, Speed, Latency,

Voice

Scope:Crowdsourcing w. focus on 5G capable users Coverage,

Speed, Latency, Voice

Scope:Crowdsourcing Fixed

Broadband, Speed, Latency

max. 1000 ptRadio Interf. Sec.Score

Scope:Radio Interface Security

agains Interception, Impersonation and Tracking

max. 1000 ptCharging Infrastr. Score

Scope:Charging Infrastructure for

Electrical Vehicles.

August 2021

public

Fixed Bröadband Score Metrics.Globally applicable score framework to assess ISP user experience.

9

Fixed Broadband Score Overall Score Throughput DL Score Throughput UL Score Latency Score Services Score Score Split: urban/suburban/rural Score available via umlaut report

Score Calculation

Fixed Broadband Methodology Fixed Broadband Benchmark August 2021

Passive Throughput Metrics DL/UL Service Category Urban, Suburban, Rural

Use

r Exp

erie

nce

Netw

ork

Cap

abilit

y

Latency Metrics Per CDN (Akamai/Amazon) Service Category Urban, Suburban, Rural

Active Background Testing P10 , Avg., P90 Throughput from network capability perspective Urban, Suburban, Rural

public

Public Benchmarks, Network Certification, Audit Reports.

The umlaut Fixed Broadband benchmarking activities with public visibility are based on a crowdsourcing-based assessment. The umlaut score is the common element of all activities. These publicly visible activities are:

• Public benchmarks executed in cooperation with a publishing partner• Independent network certification activities, commissioned by one or more 3rd parties (e.g. ISP, network vendor, etc.)• Audit reports, which are independently executed but can contain bespoke elements as far as technical or geographical scope,

timeline, or other aspects are concerned.

The setup, scope and timeline• for any certification and claim support activity is independently chosen and decided by umlaut• for any public benchmarking activity is independently chosen and decided by the publisher and umlaut

Description of Approach

10Fixed Broadband Methodology August 2021

public

public

Fixed Broadband - World Ranking Score.

August 2021Fixed Broadband Methodology 11

public August 2021Fixed Broadband Methodology 12

umlaut Fixed Broadband Score.Worldwide Ranking is available.

Overall umlaut ScoreWeek 24 to Week 47, 2021

European, North American and Asian countries are leading.

public

umlaut Fixed Broadband Score.Worldwide Ranking is available.

August 2021Fixed Broadband Methodology 13

More than 140 countries are shown in the Global ranking –The Global ranking shows the best rated ISP per country.

public

umlaut Fixed Broadband Score.Worldwide Ranking Top 20 and last 20.

August 2021Fixed Broadband Methodology 14

European, North American and Asian countries are leading the Top 20. The gap to the last 20 is significant.

public

Disclaimer

This document and all information contained herein is the sole property of umlaut.No intellectual property rights are granted by the delivery of this document or the disclosure of its content. This document shall not be reproduced or disclosed to a third party without the express written consent of umlaut. This document and its content shall not be used for any purpose other than that for which it is supplied.

15Fixed Broadband Methodology August 2021

public

www.umlaut.com

Fixed Broadband Methodology 16August 2021