HUAWEI TECHNOLOGIES CO., LTD.
www.huawei.com
HUAWEI Confidential
Security Level:
Specifications and Key Points for GPRS/EDGE CQT&DT Test
V1.1
HUAWEI TECHNOLOGIES CO., LTD. Page 2HUAWEI Confidential
DT test is the most direct approach to obtain network information. DT tests on GPRS services in the network can collect a serial of network data for RNO projects. By analyzing the collected network data, you can find and correct the existing problems in the network, thus improving the overall quality of the network.
Correct and effective DT tests on GPRS services can provide basis for our future work.
Introduction
HUAWEI TECHNOLOGIES CO., LTD. Page 3HUAWEI Confidential
Content
Chapter 1: Test Preparations
Chapter 2: Test Specifications
Chapter 3: Test Instances
HUAWEI TECHNOLOGIES CO., LTD. Page 4HUAWEI Confidential
Key Points for Test PreparationSite test
Environment detection
Test terminals
Test software
FTP servers used for test
HUAWEI TECHNOLOGIES CO., LTD. Page 5HUAWEI Confidential
Key Point 1: On-site Environment Detection
Selection of test cells
Perform lock frequency test to avoid handovers
Select the best test route
Selection of test time segments
Select non-hot spot cells for the test
Signal level in the service cell – signal level in neighbor ≥20dB
HUAWEI TECHNOLOGIES CO., LTD. Page 6HUAWEI Confidential
Key Point 2: Requirements for Test Terminals
•Composition of typical drive test equipment
Information of SIM cardMultislot capability
Connected to the laptop
Disconnected with other networksClose network access tasksChange TCP window in the register table
Set GPS correctly
HUAWEI TECHNOLOGIES CO., LTD. Page 7HUAWEI Confidential
Key Points 2: Requirements for Test Terminals
Peak throughput in PDP context setting
NCK mode on LLC layerACK mode on RLC layer
•SIM cards used for test
HUAWEI TECHNOLOGIES CO., LTD. Page 8HUAWEI Confidential
Key Point 3: FTP Server Used for Test
Test FTP address provided by the
operator
•Select FTP servers with reliable performance for test
HUAWEI TECHNOLOGIES CO., LTD. Page 9HUAWEI Confidential
key Point 4: Selection of Test Software
Drive test software used by Huawei
Genex Probe
Ericsson TEMS Investigation
Pilot Premier
CDS
HUAWEI TECHNOLOGIES CO., LTD. Page 10HUAWEI Confidential
key Point 4: Selection of Test Software
Pilot Premier
HUAWEI TECHNOLOGIES CO., LTD. Page 11HUAWEI Confidential
key Point 4: Selection of Test Software
TEMS Investigation
HUAWEI TECHNOLOGIES CO., LTD. Page 12HUAWEI Confidential
Test software Installation Interface Workbench Test item Test script Report output Stability
TEMS Complex FriendlyComplete
varietyMany
Can be
edited
Various/
complexGood
PremierComparatively
complexCommon Single Few Fixed Single/simple
No
response
often
key Point 4: Selection of Test Software
Pilot PremierTEMS
InvestigationVS
HUAWEI TECHNOLOGIES CO., LTD. Page 13HUAWEI Confidential
Content
Chapter 1 Test Preparations
Chapter 2 Test Specifications
Chapter 3 Test Instances
HUAWEI TECHNOLOGIES CO., LTD. Page 14HUAWEI Confidential
Test Items
Test specifications
CQT DT
Attach
Ping
WAP
FTP
Cell reselection
WEB
FTP
WAP
RAU
Coverage rate
HUAWEI TECHNOLOGIES CO., LTD. Page 15HUAWEI Confidential
GPRS Attach Test
Test method
Perform this test through multiple logging on to GPRS network
Key indexes
Attach success rate
Average attach time
Attach success rate = (Successful GPRS attaches/Total GPRS attach attempts) x100%
Average attach time = Total time for successful GPRS attches/Times for successful GPRS attaches
HUAWEI TECHNOLOGIES CO., LTD. Page 16HUAWEI Confidential
GPRS Attach Test GPRS Attach interface for TEMS test
detach
attach
HUAWEI TECHNOLOGIES CO., LTD. Page 17HUAWEI Confidential
Ping Test
Test method
Perform Ping test in the sites of GGSN LAN with the customized of package length
Key indexes
Ping success rate
Average Ping delay
Ping success rate = (Successful Pings/Ping attempts x 100%
Average Ping delay = Sum of time for successful Pings/Successful Pings
HUAWEI TECHNOLOGIES CO., LTD. Page 18HUAWEI Confidential
Ping Test
Edit interface of TEMS test script
Packet length: 32 byte
Times for test
HUAWEI TECHNOLOGIES CO., LTD. Page 19HUAWEI Confidential
Ping Test
Result of Ping test
HUAWEI TECHNOLOGIES CO., LTD. Page 20HUAWEI Confidential
WAP Test
Test method
WAP site login test or WAP page refresh test
Key indexes
PDP activation success rate
Average time for PDP activation
PDP activation success rate: successful PDP activations/Total PDP activation attempts ×100%
Average time for PDP activation: Sum of time for successful PDP activations/Successful PDP activations
HUAWEI TECHNOLOGIES CO., LTD. Page 21HUAWEI Confidential
WAP Test Test interface
HUAWEI TECHNOLOGIES CO., LTD. Page 22HUAWEI Confidential
FTP Download Test
Test method
Upload/download files with customized length on the specified server
Key index
FTP download rate on application layer
FTP download rate on application layer = Data amount (Byte) actually downloaded/Actual time (s) for download
HUAWEI TECHNOLOGIES CO., LTD. Page 23HUAWEI Confidential
FTP Download Test Test method
HUAWEI TECHNOLOGIES CO., LTD. Page 24HUAWEI Confidential
Mail Download/Upload Test in WEB Mode
Test method
Upload a 100-kByte mail once
Download a 500-kByte mail once
Key indexes
Upload rate on application layer
Download rate of application layer
Upload rate on application layer = Data amount (Byte) actually uploaded/Actual time (s) for upload
Download rate on application layer = Data amount (Byte) actually downloaded/Actual time (s) for download
HUAWEI TECHNOLOGIES CO., LTD. Page 25HUAWEI Confidential
DT Test
1. WAP site login success rate
2. Average time for WAP first page displa
y
3. WAP page refresh success rate
4. WAP page refresh duration
5. WAP download success rate
6. WAP download rate
7. Average RAU time interval
8. Average RAU distance interval
9. Average cell reselection time interval
10. Average cell reselection distance interv
al
11. Coverage rate
12. Call drop rate
13. FTP download rate
Main contents for DT test
HUAWEI TECHNOLOGIES CO., LTD. Page 26HUAWEI Confidential
DT Test
Serial number
Record items of DT test Definition of item
1 WAP site login success rate Successful WAP site logins/WAP site login attempts ×100%
2 Average time for WAP first page display Sum of time for successful WAP first page display/Successful WAP first page displays
3 WAP page refresh success rate Successful WAP page refreshes/WAP page refresh attempts ×100%
4 WAP page refresh duration Sum of time for successful WAP page refresh/Successful WAP page refreshes
5 WAP download success rateSuccessful WAP ringtones and graphics downloads/WAP ringtones and graphics download attempts ×100%
6 WAP download rate Data amount (Byte) downloaded successfully/Time (s) for successful downloads
7 Average RAU time interval Total RAU times/Total test time (s)
8 Average RAU distance interval Total RAU times/Total test distance (Km)
9 Average cell reselection time interval Total cell reselection times/Total test time (s)
10Average cell reselection distance interval
Total cell reselection times/Total test distance (Km)
11 Coverage rate GPRS coverage distance (Km)/Total test distance (Km) X100%
12 Call drop rate Call drops/Total FTP download attempts X100%
13 FTP download rate Total data amount of FTP download/Total time for FTP download (s)
Record items of DT test and their definitions
HUAWEI TECHNOLOGIES CO., LTD. Page 27HUAWEI Confidential
DT Test Cell reselection
HUAWEI TECHNOLOGIES CO., LTD. Page 28HUAWEI Confidential
DT Test Inter-routing area reselection
HUAWEI TECHNOLOGIES CO., LTD. Page 29HUAWEI Confidential
Content
Chapter 1 Test Preparations
Chapter 2 Test Specifications
Chapter 3 Test Instances
HUAWEI TECHNOLOGIES CO., LTD. Page 30HUAWEI Confidential
GPRS Network Optimization Test in Nantong
Test comparison before and after the cutover in some business halls of
Rudong county
Serial number
Name of business hall
ATTACH duration PDP activation duration PING delay FTP download rate k/s
Before cutover
After cutover
Before cutover
After cutover
Before cutover After cutoverBefore cutover
After cutover
1 Nanyu business hall 1893 1802 1170 611 1792 1522 3.56 3.74
2 Shidian business hall 4136 1846 1576 772 1696 918 2.9 3.58
3 Tongye garden 1770 1880 856 755 1479 1245 4.78 4.32
4 Yinquan business hall 1583 2267 895 739 959 1086 4.92 4.29
5 Sunyao business hall 1880 1924 878 898 1068 941 4.73 4.1
6 Huanzhen business hall 1577 2217 993 795 957 1372 5.02 3.97
7 Linghe business hall 1875 1975 909 814 1430 943 3.86 3.55
8 Shiping business hall 1679 1882 1194 751 1261 927 3.3 4.27
9 Tongdian business hall 1621 1867 942 767 914 955 3.31 4.42
10 Huafeng business hall 1609 1782 934 746 903 990 4.42 4.76
11 Xiangtai business hall 2029 2345 896 753 836 998 5 4.54
12 Mianchang business hall 1828 1815 932 753 1603 929 5.09 4.64
HUAWEI TECHNOLOGIES CO., LTD. Page 31HUAWEI Confidential
GPRS Network Optimization Test in Baiyin
Test contents
GPRS DT test in main trunk roads
GPRS CQT test in main downtown areas
Test tools
SAGEM OT190
Nokia 6230
Motorola A760
Stopwatch
Laptop
Test software
DingLi Pilot Premier
HUAWEI TECHNOLOGIES CO., LTD. Page 32HUAWEI Confidential
Test itemTest result of
HuaweiTest result before the optimization
Test result after the
optimization
Attach testAttach success rate 100.00% 95.00% 97.00%
Average time (s) 2.0325 1.81 1.77
PDP activation testPDP activation success rate 100.00% 97.00% 100.00%
Average PDP activation time (s) 2.1279 0.86 0.81
PING testSuccess rate 99.00% 95.00% 97.00%
Average delay (s) 2.1336 1.63 1.46
FTP test FTP download (KB/S) 3.0546 3.2 3.52
WAP test
WAP login success rate 94.00% 99.70% 100.00%
Time for first page display (s) 10.7626 9.28 6.01
Refresh success rate 100.00% 100.00% 100.00%
Time for page refresh (s) 4.7886 5.74 4.33
Graphics and ringtones download success rate
99.00% 99.00% 100.00%
Graphics and ringtones download rate (Kb/s)
11.5432 17.8 18.9
KJava testMobile KJava download rate (Kb/s) 12.6173 15.5 15.9
Mobile KJava download success rate 84.00% 96.20% 96.00%
SMS testSMS test success rate 100.00% 100.00% 100.00%
SMS end-to-end delay 4.3042 5.2 5.3
MMS test
Push message success rate 100.00% 100.00% 100.00%
Average Push message delay 8.7660 6.5 6.2
Color message end-to-end success rate 87.50% 97.30% 97.00%
CQT Test Result
HUAWEI TECHNOLOGIES CO., LTD. Page 33HUAWEI Confidential
Summary of DT Test Results
Test type Test ItemTest result before the
optimizationTest result after the
optimization
WAP testWAP site login success rate 97.50% 98.50%
Time for WAP first page display 15.38 13.56
FTP test
Mileage without coverage 0 0
Coverage rate 100.00% 100.00%
Attempted downloads 37 42
Call drops 0 0
Call drop rate 0.00% 0.00%
Average throughput rate (KB/s) on application layer
2.34 2.77
HUAWEI TECHNOLOGIES CO., LTD. Page 34HUAWEI Confidential
Test Analysis 1 Coverage of RXlevel (RxLevFull) in GPRS network
HUAWEI TECHNOLOGIES CO., LTD. Page 35HUAWEI Confidential
Test Analysis 2 Distribution of downlink RLC BLERs in GPRS network
HUAWEI TECHNOLOGIES CO., LTD. Page 36HUAWEI Confidential
Test Analysis 3 Having no cell for direct coverage, the area between two BTSs has a high bit error rate.
A
HUAWEI TECHNOLOGIES CO., LTD. Page 37HUAWEI Confidential
Test Analysis 4 Distribution of downlink PDCH channels in GPRS network
HUAWEI TECHNOLOGIES CO., LTD. Page 38HUAWEI Confidential
Test Analysis 5
A
There are only two downlink PDCH channels in area A and it affects the download rate.
HUAWEI TECHNOLOGIES CO., LTD. Page 39HUAWEI Confidential
Test Analysis 6 Distribution of Downlink CS Coding Modes in GPRS Network
HUAWEI TECHNOLOGIES CO., LTD. Page 40HUAWEI Confidential
Test Analysis 7 Distribution of Cell Reselection in GPRS Network
HUAWEI TECHNOLOGIES CO., LTD. Page 41HUAWEI Confidential
Thank You