grfsdt00402-gsm radio network performance evaluation delivery report-v2r2

7/31/2019 GRFSDT00402-GSM Radio Network Performance Evaluation Delivery Report-V2R2

1/25

GSM Radio Network Performance

Evaluation Delivery Report (Template)


2/25

For internal use only

Huawei Technologies Co., Ltd.

All Rights Reserved

2012-7-21

Revision RecordDate Version Description Review Author

2010-9-28 2.2 Initial Lishucheng 2010-9-28

2012-07-21 HUAWEI Confidential Page2, Total25


3/25


Content

1 Introduction...................................................................7

2 Workflow.......................................................................8

3 Evaluation information collection....................................91.1 Complaint Information Collection.................................................................................. ........ ..9

1.2 Statistic data Collection......................................................................................................... ..10

4 Subscriber complaint ...................................................11

1.3 Various complaints percentages...............................................................................................11

5 DT preparation.............................................................12

1.4 Specific drive test measurement tools................................................................................... ..12

1.5 External Antenna and Attenuator Requirement.......................................................................12

1.6 Cluster definition.................................................................................................................. ...13

1.7 Route definition.................................................................................................................... ...15

1.8 Test Methodology....................................................................................................................16

6 Drive Test.....................................................................17

7 DT data procession.......................................................18

1.9 Coverage KPI................................................................................................................ ........ ..18

1.9.1 Rx-lev log file....................................................................................................................18

1.9.2 Rx-lev Distribution............................................................................................................18

1.9.3 Rx-lev Coverage................................................................................................................18

1.9.4 Rx-Qual log file.................................................................................................................19

1.9.5 Rx-Qual Distribution...................................................................................................... ...19

1.9.6 Rx-Qual Coverage.......................................................................................................... ...19

1.10 Accessibility KPI...................................................................................................................19

1.10.1 Call Setup Success Rate of MS Origination log file.............................................. .........19

1.10.2 Origination Call Setup Success Rate...............................................................................20

1.10.3 Call Setup Success Rate log file......................................................................................20



4/25


1.10.4 Call Setup Success Rate ........................................................................................ .........20

1.11 Retainability KPI.............................................................................................................. .....21

1.11.1 Call-Drop Rate log file............................................................................................. .......21

1.11.2 Call-Drop Rate.................................................................................................................21

1.12 Handover...............................................................................................................................24

1.12.1 Handover Statistics log file............................................................................ ........ .........24

1.12.2 Handover Statistics..........................................................................................................24

8 Summary......................................................................24



5/25


Figures

Workflow of Network Evaluation........................................9

Complaints percentage....................................................11

Top view for install Ext ANT..............................................13

Cluster border ................................................................14

Test Route.......................................................................16

Rx-lev Coverage..............................................................18

Rx-Qual Coverage............................................................19

Drop Call Location-1.......................................................23

Drop Call Reason-2.........................................................24



6/25


Tables

Timelines of Performance Evaluation..................................7

Complaint Information.......................................................9

Pre-swap statistic data....................................................10

Cluster sites list..............................................................14

Origination Call Setup Success Rate.................................20

Call Setup Success Rate..................................................20

Call Drop Rate.................................................................21

Handover Statistics.........................................................24

Drive Test KPI summary...................................................24



7/25


1 IntroductionBefore a radio network swapping, a well evaluation of the original network shouldbe carried out. The evaluation result will be the benchmark of the swapped network.This report will discuss about methodology of evaluation and give an example torepresent real status of the network.

Evaluation will be done in 3 aspects as follows:

Complain status evaluation

Traffic Statistic evaluation

Drive Test evaluation

For the previous 2 tasks the main work are collect information from operator andclassify them into tables that can be reference after the swapping. Thus the key taskin this report is the last one Drive Test evaluation, it will be discuss in detail.

Scope of This Report:

Evaluation information collection

DT preparation

Drive Test

DT data procession

Summary

Performance Evaluation Schedule:

Table 1.1 Timelines of Performance Evaluation

1st 2nd 3rd 4th 5th 6th 7th 8th

1 Update Radio Engineering Parameter 0.2 week

2 Collect Complaint Information 0.4 week

3 Collect Performance Statistic before Swap 0.4 week

4 Review Existing Sites Coordinates 0.4 week

5 Drive Test 7 week

6 DT Data Post Process 6 week

7 Generate Evaluation Report 0.6week

No. Items Duration

weekly progress



8/25


2 WorkflowThe workflow of Performance Evaluation as below:

START

Existing Radio

Network Information

Data-In-001

Review Existing Sites

Coordinates

002

Collect Existing

Radio Network

Information

001

DT Data Post Process

004

Generate Evaluation

Report

005

END

Legend

Huawei

Operator

Huawei &

Operator

NOC

Doc-Out-001

Doc-Out-002

OS/

RD

OS

RD

Out Sourcing

Remote Delivery

Drive Test

003

OS



9/25


Figure 1.1 Workflow of Network Evaluation

3 Evaluation information collectionBefore commencing swap process, there is a group of information need to becollected from the original radio network. These information will become thebaseline for evaluate the swapped network performance in the future.

1.1 Complaint Information CollectionComplaint information can be get from the operator call centre, it record thecomplaint history information before the swap. This information can indicateexistent problems in the original network that can be the reference for swappednetwork. It used to evaluate the feeling of subscriber in the network before and afterthe swap.

It should include recent subscribers cases which are still open.(problems, areas,analysis and follow up action items)

The recent period means during last 2 weeks or 1 month before the swap. If swap isdelayed and overdue past 1 month, this information needed to re-collect.

Complaint information showing as the table below:

Table 1.1 Complaint Information

NO Problem

Detail

Problem

Area

Problem

time

Related

RNC ID

Related

CELL ID

Related

SITE

NAME

Related

CLUSTER

Trouble

shooting

data

Analysis

conclusion

Solution

& result

REMAR

K

1 Call

drop/Ca

ll setup

xx

buildin

g, xx

hh:mm,

dd-

mm-

10 1001 RAM

INTHRA

EXPRESS

1 DT data &

Trace

Missing

neighbor

Adding

neighb

or



10/25


fail/Low

through

put

street,

xx

district,

xx

city/xx

cross

road,

xx

district,

xx city

yyyy WAY cells cells,

the

proble

m

disapp

eared.

This table need keep same with the Complaint Information sheet of the

1.2 Statistic data CollectionPre-swap statistic data need to be collected as the benchmark criterion for swappednetwork. The statistic data should include all the items that negotiated in KPIMapping phase.

The data should be collected in the last 2 weeks or 1 month before the swap. If swap

is delay and overdue past 1 month, this data need re-collect to make sure the statisticwill represent real time performance of the original network.

Statistic data for example as the table below:

Table 1.2 Pre-swap statistic data

2010-10-11. 2010-10-12 2010-10-13 2010-10-14 2010-10-15 2010-10-16 2010-10-17

Drop Call

Rate

1%

Call Setup

Success Rate

97%

Soft Hand

Over Success

Rate

98%



11/25


The KPI items here are just for example, the exact ones need negotiated withoperator in the KPI Mapping phase.

4 Subscriber complaint1.3 Various complaints percentages

Figure 1.1 Complaints percentage



12/25


5 DT preparation1.4 Specific drive test measurement tools

Probe V2R3 for voice and data tests

External Antenna 0dB gain with cable and connector

GPS with external antenna Laptop loaded with Probe V2R3 or TEMS

2 Mobiles and 1 data card

In case of some KPI acceptance items are special in other vendors test and analyzetool, validate whether them can be realized in Huaweis tool also. If not TEMS/PilotFleet will be recommended or need choose other tool, that means DT toolpurchasing flow need to be started. Pay attention the operation guide of the test toolsfrom other vendor should be considered also.

Setup:

MS: CS Calls using a National Roaming disabled SIM. MS is set as GSM mode

only and locked on operator network (2G->3G cell reselection is not allowed)

Data Card for PS, SIM card special requirement:

Using a National Roaming disabled SIM and locked on operator GSM

Support EGPRS

SIM cards provided and prepared by operator

FTP Download Server provided by operator

CS Calls Answering Machine provided by operator

Vehicle

DC to AC converter

1.5 External Antenna and Attenuator Requirement

The external antenna of MS will be used in Drive Test, and the antenna will bemounted on rooftop of drive test car.

The following figure shows the external antenna installation.

It is necessary that 1 Lambda displacement between Antenna and the roof edge.



13/25


Roof luggage rack is not allowed.

V A N

++

M S A N TG S P A N T

++

G S P A N TM S A N T

Figure 1.1 Top view for install Ext ANT

1.6 Cluster definitionThe clusters shall be defined based on the principles determined both huawei andcustomer. Principles please refer to section 2.2.

There is a cluster definition example below:



14/25


Figure 1.2 Cluster border

List of cluster sites:

Table 2.1 Cluster sites list

SiteID NodeB Name Cell Name Cluster Cell ID Frequency

10350 IESSW08 IESSX 1 10357 25

10350 IESSW08 IESSY 1 10358 06

10350 IESSW08 IESSZ 1 10359 57

10360 MALLSURW08 MALLSURX 1 10367 18

10360 MALLSURW08 MALLSURY 1 10368 09

10360 MALLSURW08 MALLSURZ 1 10369 20

10390 SAIBAW08 SAIBAX 1 10397 38

10390 SAIBAW08 SAIBAY 1 10398 3

10390 SAIBAW08 SAIBAZ 1 10399 17

11070 CGUEVARAW08 CGUEVARAX 1 11077 60

11070 CGUEVARAW08 CGUEVARAY 1 11078 1

11070 CGUEVARAW08 CGUEVARAZ 1 11079 52



15/25


Total number of sites for the cluster is: 10

Percentage Sites Radiating: 100%

1.7 Route definitionThe route will be defined by Huawei and sent to customer for confirmation. Ifcustomer agree on it, Huawei will use it for the cluster route otherwise changes willbe made.

All sectors in every site in the cluster should be covered by the drive route.

Routes should cover Business centers, shopping centers, tourist attractions andrailway stations.

Major roads: Motorways in both directions.

The routes should be laid out to gain a clear footprint of each cell.

Routes should avoid roads with restricted access, pedestrian areas or secure areas orthose requiring special access conditions.

Routes should be captured in MapInfo format or something similar, i.e. GoogleEarth.

At least 200 samples for PS and CS have to be collected.

Below is a sample of test route.



16/25


Figure 1.3 Test Route

1.8 Test MethodologyCluster drive tests shall perform 2 call scenarios: Voice short calls, VP short callswith 120 sec duration with 10 sec interval.

PS functionality tests were performed by downloading a huge file from an FTPserver with CQT (Call Quality Test).



17/25


6 Drive TestDuring the DT a Protocol-File should be written which captures all the problemslike broken cable, loose cable, mobile error and any other equipment error, unusualbehaviour or lunch break.

The protocol shall as well capture the DT-engineers name and vehicle number.

Pre and Post DT shall be done using the same vehicle and measurement equipment.

The DT-Engineer has to check the stability and functionality of the equipmentduring the DT.

In case of major problems during the DTs the DT Engineers should contact Huaweitechnical assistance personnel.

It is important to check if the right network is measured.

Information: Tests will be done by using National Roaming disabled SIM-Cards.

The Log-Files should not be too big. A proper splitting of files length is necessary.Recommend every log file less than 20M.



18/25


7 DT data procession1.9 Coverage KPI

1.9.1 Rx-lev log file

PSDL_070620_Toapayoh_1.gen

1.9.2 Rx-lev Distribution

Figure 1.1 Rx-lev Coverage

1.9.3 Rx-lev Coverage

Rx-lev (>=-95dBm) Ratio = 99.24%



19/25


RSCP (>=-85dBm) Ratio = 96.17%

1.9.4 Rx-Qual log file


1.9.5 Rx-Qual Distribution

Figure 1.2 Rx-Qual Coverage

1.9.6 Rx-Qual Coverage

Rx-Qual (>=4dB) Ratio = 96.54%

1.10 Accessibility KPI

1.10.1 Call Setup Success Rate of MSOrigination log file




20/25


1.10.2 Origination Call Setup Success Rate

Table 2.1 Origination Call Setup Success Rate

Call Statistics Result Rate

Total Number of Calls 26 100.0%

Total Drops 2 7.7%

Total Completed Calls 23 88.5%

Total Call Setup Success 26 100.0%

Total Call Setup Failure 0 0.0%

Total Number of Outgoing Call 26 100.0%

Total Drops of Outgoing Call 2 7.7%

Outgoing Call Setup Success 26 100.0%

Outgoing Call Setup Failure 0 0.0%

Origination Call Setup Success Rate

= Total Call Setup Success / Total Number of Calls = 26 / 26 * 100% = 100.0%

1.10.3 Call Setup Success Rate log file

PSUL_070620_Toapayoh_1.gen

1.10.4 Call Setup Success Rate

Table 2.2 Call Setup Success Rate



Total Drops 0 0.0%




21/25








Call Setup Success Rate of VP

= Total Call Setup Success / Total Number of Calls = 23 / 23 * 100% = 100.00%

1.11 Retainability KPI

1.11.1 Call-Drop Rate log file


1.11.2 Call-Drop Rate

Table 2.3 Call Drop Rate



Total Drops 2 7.7%








22/25




One drop call was not only caused by the normal release from DL_DCCH but

also traffic time was 120sec should be excluded from the KPI

The other drop call was caused by the Abis interface problems between BSC

501 and BSC 403.

Origination Call Drop Rate

= Total Drops/ Total Number of Calls = 0 / 26 * 100% = 0.00 %



23/25


Figure 1.3 Drop Call Location-1



24/25


Figure 1.4 Drop Call Reason-2

1.12 Handover

1.12.1 Handover Statistics log file


1.12.2 Handover Statistics

Table 4.1 Handover Statistics

Handover

Statistics

Total

Total HandoverPerformed

490

Total HandoverSuccess

489

Total Handover Failure 1

Handover SuccessRate

99.80%

8 SummaryBelow is the Drive Test KPI summary:

Table 1.1 Drive Test KPI summary

KPI Original network TestResults

Contractual KPIcriteria

AcceptanceResults



25/25


Rx-lev 97.62%@-100dBm >=96%@-95dBm

Rx-Qual 97.52%@-12dB >=96%@-12dB

Call Setup SuccessRate

100.00%

Call Drop Rate 4.17% 1%

HO Success Rate 100.00%

KPI: Means Drive Test KPI items agreed by both Huawei and operator.

Original network Test Results: Means the original network KPI test values.

Contractual KPI criteria: Means Drive Test KPI criteria agreed by both Huawei andoperator.

Acceptance Results: It will fill with the KPI test values that test from the swappednetwork.

Please note when Acceptance Results of one KPI item achieves any one of theOriginal network Test Results or Contractual KPI criteria, that KPI item is passed.


grfsdt00402-gsm radio network performance evaluation delivery report-v2r2

Documents