test report rogers lab pcm-i7 2011 (cpu speed impact on lte networks)
DESCRIPTION
123TRANSCRIPT
-
Test Report PCM-i7 Rogers LTE Lab December 2011
Overall Management Summary - PCM-i7 Performance Tests
-> No issues found
- PCM-i7 USB Tests
-> No issues found
- MCM Hookup Performance Tests
-> No issues found
-> Data measurement at 60Mbit/s didnt show any degradation if there is a voice measurement running (POLQA)
- PCM CD vs. PCM-i7 Comparison
-> On PCM CD:
- Up to 30 Mbit/s, we are on the safe side
- Between 30 and 40 Mbit/s possible IP Trace packet loss
- Above 40 Mbit/s we have an impact on the throughput
-> On PCM-i7:
- No issues found
- Lab Tests Sierra Wireless AirPrime MC7700
-> No issues found
-> Avg. throughput as expected ~60Mbit/s
- Lab Tests Novatel Expedite E371
-> Throughput limited at 43Mbit/s (even with latest FW/HW)
- Live Tests Huawei E398u-15
-> No issues found
-> ~65 Mbit/s
Results located here:
\\10.23.1.174\media\Measurement Files\Rogers Canada\2011\2011_12_16 LTE Tests PCM-i7\
and here:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\
-
PCM-i7 Performance Tests
PCM-i7 performs as expected at 60Mbit/s
MC7700 in Hookup - NO Phone - MCM FDDI Channels Disabled
- Thats basically our reference at the moment since we cannot use the internal embedded module slot due to the
known issue with Sierra Wireless and the TI xHCI USB 3.0 controller.
- The throughputs are as expected and correlate pretty much with the speedtest results (which reflects peak
throughputs)
- CPU load around 35%
- \\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\Sierra Wireless AirPrime
MC7700\Hookup - NO Phone - MCM FDDI Disabled
MC7700 in Hookup Nokia C7 running POLQA in parallel
- The throughputs are as expected, no significant influence
- CPU load still around 35%
- \\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\Sierra Wireless AirPrime
MC7700\Hookup - Nokia C7 - POLQA
Remarks:
Were using a beta version of the 64bit IP Tracer which runs in a dedicated process. This seems to have a very good influence on
the CPU load. The IPTracer generates only around %10 CPU load. That is unexpected low. Plus, we havent seen *any* missing
packets from Netmon.
-
PCM-i7 USB Tests All major combinations have been tested using Philips Capacity Test Tool. No significant influence has been seen.
Please refer to the screen shots in the respective folders:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\USB Tests\
-
MCM Hookup Performance Tests
NO Phone - MCM FDDI Disabled
Nokia C7 - POLQA
Example files:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\Sierra Wireless AirPrime MC7700\
-
PCM CD vs. PCM-i7 Comparison
Focused on the PCM CD (with SSD) and the question if Rogers will see degradation in their measurements at the throughputs
they currently have.
1:1 Comparison PCM CD vs. PCM-i7 using Rogers current Job
- Since we still couldnt answer Rocks question if the data they collect today is valid, we captured a measurement file
with their current job one the PCM CD and on the PCM-i7. The results are in line with our statement, we provided to
AT&T this summer.
- Up until 30 Mbit/s, we are on the safe side.
- Between 30 and 40 Mbit/s we are in a gray zone, but do not expect a big impact (except some dropped IP Packets in
the IP Trace)
- Above 40 Mbit/s we have an impact on the throughputs
- For sure, we have to carefully discuss the results, but from what we can see now in the comparison, we have to be
aware of the limitations
- The throughputs below are from their 50MB HTTP download. Capacity would be even worse
The above graph shows pretty well, that we have to expect degradation above ~50Mbit/s. The conditions in the lab are very
stable and you can see on the left side that using the Capacity test, we properly fill the pipe in UL at around 25Mbit/s. In DL
however, when we expect a steady line at around 55Mbit/s, we have a lot of up and downs around 50Mbit/s. To the right, we
can see the same DL Capacity test without Diversity (mainly IPTracer) running.
If we add a POLQA voice test in parallel, it gets a bit worse.
All tests have been performed with Tom/Philips new external IP Tracer. So there is not a lot we currently have in our pockets ;-)
Example files:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\Comparison
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-CD\Sierra Wireless AirCard 313U
-
Lab Tests Sierra Wireless AirPrime MC7700 Throughputs are consistent and at an expected level around 58Mbit/s avg.
Direction
Tota
l N
um
ber
of Test
s
Data
Sess
ion C
om
ple
ted R
ate
Avg T
hro
ughput
[kbps]
Min
Thro
ughput
[kbps]
Max T
hro
ughput
[kbps]
Avg D
ura
tion [
s]
Min
Dura
tion [
s]
Max D
ura
tion [
s]
Tota
l byte
s tr
ansf
err
ed [
kByte
]
Uplink 7 100.0% 22435.77 17966.09 23812.97 29.96 29.94 29.97 588120.1
Downlink 7 100.0% 58009.71 55054.84 59383.79 59.96 59.93 59.98 3043414.2
Example files:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\MC7700 - Nokia C7 - Nokia 6720 II\
-
Lab Tests Novatel Expedite E371 Even after getting the latest version of the module (just received on Thursday 15
th from Rhonda Bass
[[email protected]]), the Novatel Expedite shows the same limitations on the PCM-i7 as seen before.
The throughput is limited at around 45Mbit/s:
Looking at the network performance monitor, we can see an unsteady peak:
In comparison, here an example of the MC7700 at around 60Mbit/s
Example files:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\USB Tests\E371 PCIe Slot - MCM
disconnected\
-
Live Tests Huawei E398u-15 Rogers provided us with special SIM cards to perform some first tests in their new 2600MHz (20MHz bandwidth) network. They
told us that they still have some issues and are expecting around 60Mbit/s. On a drive test weve got an average throughput of
59Mbit/s. They plan to go nationwide in June 2012.
Example files:
\\10.23.1.174\media\Measurement Files\Rogers Canada\2011\2011_12_16 LTE Tests PCM-i7\2011_12_11\Huawei E398u-15
LTE Only RAW LOG\