tems automatic 10.2 technical product description

40
8/9/2019 TEMS Automatic 10.2 Technical Product Description http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 1/40 Prepared by: Date: Document : Ascom Network Testing 8/18/2014 NT14-32322 © Ascom (2014). TEMS is a trademark of Ascom. All other trademarks are the property of their respective holders. No part of this document may be reproduced in any form without the written permission of the copyright holder. The contents of this document are subject to revision without notice due to continued progress in methodology, design and manufacturing. Ascom shall have no liability for any error or damage of any kind resulting from the use of this document. TEMS Automatic 10.2 Technical Product Description

Upload: ali-danone

Post on 01-Jun-2018

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 1/40

Prepared by: Date: Document : Ascom Network Testing 8/18/2014 NT14-32322

© Ascom (2014). TEMS is a trademark of Ascom. All other trademarks are the property of their respective holders.No part of this document may be reproduced in any form without the written permission of the copyright holder.The contents of this document are subject to revision without notice due to continued progress in methodology, design andmanufacturing. Ascom shall have no liability for any error or damage of any kind resulting from the use of this document.

TEMS Automatic 10.2 TechnicalProduct Description

Page 2: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 2/40

© Ascom (2014) Document :NT14-32322

Contents

1 Introduction ................................................................ 1 1.1 Key Features of TEMS Automatic ............................................1

1.2 Who Is TEMS Automatic Intended For? ..................................2

1.3 Where to Find More Information ..............................................2

2 New Features and Functionality ............................... 3

2.1 What’s New in TEMS Automatic 10.2 ......................................3

2.2 What Was New in TEMS Automatic 10.1 .................................3

2.3 What Was New in TEMS Automatic 10.0 .................................4

2.4 What Was New in TEMS Automatic 9.2 ...................................4

3 Overview of TEMS Automatic ................................... 6

4 How TEMS Automatic Works .................................... 8

4.1 Testing Capabilities ..................................................................8

4.1.1 Tethered vs. On-device Testing ..................................................8 4.1.2 Voice Testing ..............................................................................8 4.1.3 Data Service Testing ..................................................................9 4.1.4 Available Bandwidth Measurements: Blixt™ ............................. 11

4.1.5 Scanning .................................................................................. 11 4.2 Remote Probe Administration ............ ......... ......... ......... ........ 12

4.2.1 Workflows: Test Script Administration .......... ......... .......... ......... . 12 4.2.2 Probe Administration ................................................................ 13 4.2.3 System Administration ......... .......... ......... .......... ......... ......... ...... 15

4.3 Measurement Probes.............. .......... ......... ......... .......... ......... . 15

4.3.1 Deployment: Mobile vs. Fixed Probes .......... ......... .......... ......... . 15 4.3.2 Radio vs. Ethernet Testing .......... ......... ......... .......... ......... ......... 15 4.3.3 Data Upload .......... ......... .......... ......... ......... .......... ......... ......... ... 15 4.3.4 Overview of Measurement Probe Types ............... .......... ......... . 16 4.3.5 RTU (Remote Test Unit) .......... ......... ......... .......... ......... .......... .. 18 4.3.6 RTU Control Unit (RCU) .......... ......... ......... .......... ......... .......... .. 19 4.3.7 Multiple Device Unit (MDU) for Smartphone Testing .......... ....... 20 4.3.8 Ruggedized Measurement Unit (RMU) for Smartphone

Testing ...................................................................................... 20

4.4 In-field Probe Administration: “Local GUI” ........................... 20

4.5 Service Quality Test Nodes ......... ......... .......... ......... ......... ...... 21

4.5.1 CallGenerator ........................................................................... 21 4.5.2 Mobile CallGenerator (MCG) ............... ......... .......... ......... ......... 21 4.5.3 PS Data Test Nodes ......... .......... ......... ......... .......... ......... ......... 22 4.5.4 Available Bandwidth Measurements: Blixt™ Test Nodes ......... . 22

4.6 Post-processing with TEMS ™ Discovery ......... .......... ......... . 22

Page 3: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 3/40

© Ascom (2014) Document :NT14-32322

5 Product Package, System Components ................ 24

5.1 Product Package Overview ......... ......... .......... ......... ......... ...... 24

5.2 Measurement Probes.............. .......... ......... ......... .......... ......... . 24

5.2.1 RTU Configuration ......... .......... ......... ......... .......... ......... ......... ... 24 5.2.2 RCU Configuration ......... .......... ......... ......... .......... ......... ......... ... 25 5.2.3 MDU Configuration ................................................................... 25 5.2.4 RMU Configuration ................................................................... 25

5.3 Testing Capabilities .......... ......... .......... ......... ......... .......... ....... 26

5.3.1 CS Voice Testing ...................................................................... 26 5.3.2 PS Data Testing ................. ......... .......... ......... ......... .......... ....... 27 5.3.3 Interference Measurements ......... .......... ......... ......... .......... ....... 28 5.3.4 Measurement Control Capabilities ................ .......... ......... ......... 28 5.3.5 Measurement Trigger Capabilities ............. .......... ......... ......... ... 30 5.3.6 Data Upload Trigger Capabilities .............. ......... ......... .......... .... 30 5.3.7 Scanning Capabilities of RTU Devices/External Scanners ........ 31 5.4 Device Capabilities ......... .......... ......... ......... .......... ......... ......... 33

5.5 Technical Capabilities ............................................................ 34

5.5.1 Probe Capabilities ......... ......... ......... .......... ......... .......... ......... .... 34

5.6 Technical Specifications .......... ......... ......... .......... ......... ......... 35

5.7 TEMS Pocket Device Capabilities .......... ......... .......... ......... .... 36

6 TEMS Automatic System Configuration ................ 37

6.1 Scalability Options ................................................................. 37

6.2 Hardware and Software Requirements .......... .......... ......... .... 37 6.3 Intra-system Communication ......... ......... .......... ......... .......... .. 37

Page 4: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 4/40

© Ascom (2014) Document :NT14-32322 1(37)

1 IntroductionFor true end-to-end testing of radio wireless networks, Ascom offers the air interface

monitoring tool TEMS Automatic.TEMS Automatic helps operators to:

Increase revenue: Problems can be located and fixed before they start affectingcustomers, improving customer satisfaction and cutting churn. Fewer blocked anddropped calls means more call time and higher earnings, and a higher quality ofservice also helps attract new subscribers.

Boost efficiency: Being autonomous, TEMS Automatic is highly cost- and staff-efficient, providing a comprehensive and continuously updated overview of networkquality.

Optimize investments: A wireless telecom network represents a huge investmentand needs optimizing to bring the best possible return. TEMS Automatic providesthe means both to collect the relevant data and to conduct analyses on which tobase wise investment decisions. It can also be used to test new features beforerollout to ensure their performance in the live network.

TEMS Automatic provides comprehensive data collection support, including servicetesting over packet-switched and circuit-switched radio bearers. The product supportsall major radio technologies, such as UMTS, CDMA and LTE, for the worldwide market.

1.1 Key Features of TEMS Automatic

TEMS Automatic is a multi-purpose solution for data collection and end-to-end testing,developed for 24/7 monitoring, troubleshooting, and benchmarking. It produces multi-level output, spanning the whole range from raw route data to KPIs.

TEMS Automatic provides users with:

Insight into the end- user’s perception of the network , thanks to measurementstaken in the air interface rather than at network nodes (where other monitoring toolsare used). A faithful measure of the end-to-end quality is obtained both for voice(using PESQ) and for data transfer.

24/7 measurements without the cost of 24/7 staff. Every corner of the network isprobed around the clock by autonomous data collecting units. The state of thenetwork as perceived by subscribers can be fed back to technicians and modified ata pace approaching real-time control.

Automated measurements in the truest sense. Not only test calls andmeasurements, but also data uploading and system configuration are carried outautomatically. This enables rapid feedback on the state of the network – almost inreal-time – to the entire organization, all the way from RF engineers in the field tomanagement.

Benchmarking capabilities in the form of multi-device test units and mechanismsfor careful synchronization of test calls and data sessions.

Remotely configurable data collecting probes. Test units can have theirmeasurement instructions and their software uploaded from a central administrationconsole.

Page 5: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 5/40

© Ascom (2014) Document :NT14-32322 2(37)

1.2 Who Is TEMS Automatic Intended For?

TEMS Automatic is designed to benefit all levels of the operator’s organization:

RF engineers are notified of all sorts of local malfunctions (weak signal reception,bad C/I, low data throughput, etc.), prompting them to try out various tweaks to thenetwork configuration. TEMS Automatic provides KPIs with drill-down functionalityfor evaluating network problem areas.

Managers are able to super vise the organization’s processes and services. Theycan keep track of KPIs (dropped call rate targets, for example) by studying reportsautomatically distilled from measurement data at user-specified times. They areaided in making decisions on investments and organizational improvements. Bygetting a tighter grip on the network’s end -to-end voice and data quality, thecompany is also in a better position to offer customers reliable service levelagreements.

Network planners learn about spots with recurrent problems by requestingstatistics confined to specific areas. This helps them reveal deficiencies in thenetwork layout or the underlying theoretical models, also providing input forimprovements. As a result they are able to boost network utilization and getmaximum mileage out of the existing network before new investments are made.

Marketing staff can extract statistics on usage patterns, furnishing the basis forprecisely targeted advertising campaigns. Being more intimately familiar with thenetwork’ s quality of service, they can also work out more advanced and precisecharges for various services. It is less risky to promise, and charge for, quality thathas been thoroughly assured.

The customer care unit can order coverage information to enlighten customerswho are making complaints or enquiries. Complaints can be cross-checked againstnetwork status reports to help determine whether a problem resides in the networkor in the customer’s handset.

1.3 Where to Find More Information

Our monthly newsletter TEMS News contains articles on new TEMS product releasesand their features, general information on the TEMS portfolio, and much more. To signup for this free service, go to www.ascom.com/nt/en/index-nt/nt-news.htm and click the“TEMS News” link. In this section of our website you can also read our press releasesand find out about upcoming events where Ascom Network Testing will participate.

You can also follow Ascom Network Testing on Facebook, LinkedIn and YouTube, aswell as subscribe to our RSS feed. Links are provided in the “Follow Us” section atwww.ascom.com/networktesting.

Page 6: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 6/40

© Ascom (2014) Document :NT14-32322 3(37)

2 New Features and Functionality

2.1 What’s New in TEMS Automatic 10.2TEMS Automatic 10.2 supports the following new features. For more details, pleaserefer to the separate document “TE MS Automatic 10.2 – What’s New”.

Samsung Galaxy S5

o Samsung’s LTE Category 4 (150 Mbit/s) model Galaxy S5 SM-G900FQ,intended for the Turkey market, is now connectable to TEMS Automatic for on-device testing.

On- device service testing using smartphone’s own clients:

o Call setup (without MOS scores)

o WCDMA multi-RAB

o Parallel PS data testing

2.2 What Was New in TEMS Automatic 10.1

The new features in the TEMS Automatic 10.1 release are described in more detail inthe separate document “TEMS Automatic 10.1 – What’s New”. Below is a summary ofthese features.

Samsung Galaxy S4

o

Samsung’s Cat egory 4 (150 Mbit/s) model Galaxy S4 GT-I9506 connectable toTEMS Automatic for on-device testing.

On-device service testing using smartphone ’s own clients:

o HTTP Web kit (browsing)

o HTTP Get/Post

o Streaming HTTP (YouTube)

o Ping

o ABM, Blixt TM (Speed testing)

Multiple Device Unit (MDU), a ruggedized box holding up to four smartphonedevices for on-device testing. Designed to be connected to an RTU-5 Control Unit(a configuration suited to more rigorous requirements on measurement efficiency).

RTU-5 Control Unit (RCU), a unit tasked specifically with data upload, devicesynchronization and other control activities. It is designed to be used together withan MDU, but can also have RMUs or standalone smartphones connected. TheRCU solution is intended to meet strong requirements on device availability,measurement efficiency, and unattended measurements.

TEMS Automatic is capable of managing a mixed fleet of probes containing bothRTU 4 and RTU 5 units, as well as RCUs with smartphones connected (optionallymounted in an MDU box).

Page 7: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 7/40

© Ascom (2014) Document :NT14-32322 4(37)

2.3 What Was New in TEMS Automatic 10.0

The new features in the TEMS Automatic 10.0 release are described in more detail inthe separate document “TEMS Automatic 10.0 – What’s New”.

Below is a summary of the new features in TEMS Automatic 10.0, valid for a systemfielding RTU 5 units with Windows 7 (not valid for probes running Windows XP).

RTU-5 standalone edition, making it possible to operate an RTU-5 locally in thefield using ProbeController.

RMU (Ruggedized Measurement Unit), a single-device box holding one SamsungGalaxy S4 GT-I9505 configured with TEMS Pocket Remote software.

FleetManager, a new tool introduced for remote probe administration. In thisrelease it is used for TEMS Pocket Remote units, including ones housed in RMUs.

2.4 What Was New in TEMS Automatic 9.2

The new features in the TEMS Automatic 9.2 release are described in more detail inthe separate document “TEMS Automatic 9.2 – What’s New”. Below is a summary of the new features in TEMS Automatic 9.2, valid for a systemfielding RTU 5 units with Windows 7 (not valid for probes running Windows XP).

Windows 7 with support for dynamic TCP/IP, enabling enhanced stress testing (fileupload/download).

HTTP file upload: an add-on to our existing HTTP file download capability.

Streaming testing over TCP/IP, using a public server like YouTube, with MOSquality scores calculated by the VQmon algorithm.

Iperf 3.0 support, addressing the need for more efficient stress testing.

Email (SMTP, POP3/IMAP) service testing, optionally with attachments.

Operator Console TEMS Automatic 10.1

RTU RCU

RCU with MDU

TEMS Automatic 10.1

Pocket Remote RMU with Pocket Remote

CallGenerator

server

Fleet Manager TEMS Automatic 10.1

Page 8: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 8/40

© Ascom (2014) Document :NT14-32322 5(37)

Multi-RAB mobile-originated call setup enhanced to support voice testing incombination with testing of any PS service and computation of associated KPIs,bringing tests closer to real-life end user behavior. Both mobile-to-mobile and

mobile-to-fixed connections can be tested. Scanning with PCTEL SeeGull MX, a multi-technology scanner. Either one MX or

two EX units can be connected to the RTU 5. The MX requires its own direct powersupply, while the EX can be powered from the RTU 5.

Support for workflows, a TEMS common component for design and verification oftest scripts. For quicker access, the workflow designer is integrated with theOperator Console.

The RTU 5 supports the new TRP logfile format. Please note that *.trp logfilesrequire TEMS Discovery for post-processing.

The RTU 5 can house the following measurement devices:

o PCI-e Ericsson F3607 EU & US – UMTS

o PCI-e Sierra Wireless MC7700/MC7710 EU & US – UMTS/LTE

The RTU software platform is multi-technology ready, being capable of supportingother devices as well as other technologies (such as CDMA or TD-LTE) on request.For TEMS Automatic 9.2 this is offered as a service; please contact an Ascomsales representative for further details.

Market-specific devices supported (TEMS Automatic 9.2.1):

o ZTE MF683 USB modem, UMTS DC (idle mode)

o Sierra Wireless MC7750 PCI-e, CDMA/LTE (idle mode)

o Sierra Wireless MC5728 PCI-e, CDMA (idle mode)

o Huawei UML397 USB modem, CDMA/LTE (idle mode)

The Operator Console is capable of managing a mixed RTU fleet containing bothRTU 5 units running Windows 7 (TEMS Automatic 9.2) and older RTUs configured withWindows XP (TEMS Automatic 9.0).

For post-processing, TEMS Discovery is required to support logfiles uploaded fromRTU 5 units with Windows 7.

Page 9: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 9/40

© Ascom (2014) Document :NT14-32322 6(37)

3 Overview of TEMS AutomaticFor data service as well as voice testing, whether for benchmarking or general-purpose

quality monitoring, TEMS Automatic uses measurement probes: RTUs (Remote Test Units) having support for USB modems, PCI-e mini cards, and

external scanners

MDUs (Multiple Device Units) for ruggedized deployment of smartphone testing

TEMS Pocket Remote units for handheld smartphone testing.

These are autonomous data-collecting devices installed in vehicles traveling thenetwork area, or alternatively in fixed locations such as airports and shopping malls.

Measurement probes interact with quality test nodes for voice telephony and dataservices. A built-in GPS unit records driving routes.

Remote Probe Administration is done from FleetManager or Operator Console,which can be operated through a Web interface. A key part of this administration is theassignment of work orders to measurement probes, telling them where, when, andhow to perform their testing.

Measurement probes make regular contact with the fixed side of the system in order toupload logfiles and receive new instructions. The logfiles are subsequently stored in aTEMS Discovery relational database for post-processing.

TEMS Automatic system overview. Regarding details about measurement probes, see section 4.3.

TEMS Automatic deserves its name in a multitude of ways, one basic design principlebeing that the system should do a maximum of work while requiring a minimum of userintervention. Automation therefore pervades all the chief tasks performed: fromregistration of new probes (done by the unit of its own accord), through measurementand testing (handled autonomously by the probes as instructed in work orders), todelivery of collected data (uploads are initiated by the probe themselves according towhatever schedule has been laid down).

Mobile probes,mounted in vehicles

(RTUs, MDUs, RMUs)

Fixed-mountedProbes (RTUs)

Fixed part of TEMSAutomatic system

Remote probeadministration

Handheldprobes(TEMSPocket

Remote)

Page 10: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 10/40

© Ascom (2014) Document :NT14-32322 7(37)

TEMS Automatic is easy to learn and use , employing a familiar operating system andstandardized system components. Administration is straightforward and hassle-free:from the FleetManager, which can optionally be accessed through a Web interface,

users have a complete overview of test units, work orders, and server applications.From the Operator Console the performance of each probe can be monitored in closereal time, and depending on probe capability the units can be upgraded remotely withnew software and device firmware.

Page 11: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 11/40

© Ascom (2014) Document :NT14-32322 8(37)

4 How TEMS Automatic WorksThis chapter goes into more detail regarding the core functionality of TEMS Automatic:

Testing capabilities – voice, data, scanning

Administration – FleetManager/Operator Console

Measurement probes – RTUs, TEMS Pocket Remote units, and others

Local GUI – ProbeController

Quality Test Nodes – including CallGenerator

The chapter is rounded out with a sketch of the post-processing tool TEMS Discovery.

For technical details on TEMS Pocket Remote, please refer to the TEMS PocketTechnical Product Description.

4.1 Testing Capabilities

Device-specific capabilities are described in chapter 5.

4.1.1 Tethered vs. On-device Testing

The traditional service testing setup in TEMS Automatic is one where the measurementdevice provides a tethered connection to the RTU. The software client controlling themeasurement resides on the RTU. This setup is suitable when the focus is on judgingnetwork performance rather than emulating the experience of users.

TEMS Automatic also offers on-device testing, a capability designed for smartphones.In this case, the software client is installed on the smartphone itself. In the currentversion of TEMS Automatic, on-device measurement is available for most commonservices like HTTP browsing, HTTP Get/Post, streaming over HTTP, Ping and Call Setup verification. Since the on-device client is optimally adapted to the device, it is idealfor tests that aim to reproduce real-life user experience .

4.1.2 Voice Testing

4.1.2.1 Mobile-to-mobile vs. Mobile-to-fixed

Circuit-switched voice can be tested in a variety of configurations: mobile-to-mobile between measurement probes, or between devices contained within the same probe;or mobile-to-fixed with devices engaging a CallGenerator connected to a PSTNnetwork, using analog PSTN or digital E1 (ISD) voice boards.

Mobile- originated and mobile- terminated calls are distinct categories, andcomprehensive data is logged from both caller and receiver.

Voice calls can be combined with concurrent data sessions in multi-RAB WCDMAtesting. The main objective here is usually to find out how the data traffic affects theperformance of the CS voice service. Any of the supported data services can beinvolved in multi-RAB testing.

Page 12: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 12/40

© Ascom (2014) Document :NT14-32322 9(37)

4.1.2.2 Quality Measurement

TEMS Automatic has several algorithms for assessing audio quality in general andspeech quality in particular:

POLQA (Perceptual Objective Listening Quality Assessment), standardized as ITURecommendation P.863. POLQA is measured in a mobile-to-mobile configuration – probe to probe, or probe to Mobile CallGenerator – , and operates in eithernarrowband (300 –3400 Hz) or super-wideband (50 –14000 Hz) mode.

PESQ (Perceptual Evaluation of Speech Quality), standardized as ITURecommendation P.862.1. PESQ is measured in a mobile-to-fixed configuration(probe to CallGenerator) as well as in a mobile-to-mobile configuration (probe toprobe, or probe to Mobile CallGenerator 1).

SQI (Speech Quality Index), which uses radio link parameters to calculate theperceived speech quality on a radio channel.

Both PESQ and POLQA are designed to mimic human speech perception. Throughouttest calls, a speech sentence is played on the voice channel. The two algorithmscompute a quality estimate by comparing the transmitted sentence with the undistortedreference, also taking the fixed-side equipment into account.

PESQ and POLQA are both part of a larger package of audio quality measurements(AQM) that also includes echo delay and attenuation, speech path delay, voice jitter,volume level, and silent call detection.

By using PESQ/POLQA and SQI together it is possible to detect non-radio problemsthat affect speech quality (suggested by a good SQI and a bad PESQ/POLQA valueoccurring simultaneously).

POLQA offers differentiated narrowband and super-wideband modes, which make itpossible to compare PSTN and ISDN speech quality to that achieved with allcommonly used speech codecs in mobile networks (for example, AMR-WB).

4.1.3 Data Service Testing

4.1.3.1 General: KPIs and Events

TEMS Automatic measures throughput and decode error/retransmission rates for datatransfer in UMTS (including HSPA/HSPA+) and LTE. Throughput figures alwaysinclude the application-level throughput, that is, that experienced by the user operatingthe FTP client, streaming client, or HTTP Web browser.

For packet-switched data transfer, TEMS Automatic offers a set of KPIs for rigorouslydescribing the performance of PS data services as perceived by the end-user. Theseinclude PS end-to-end access time, mean throughput, and transfer time. Further KPIsindicate failure rates: PS end-to-end non-accessibility and data transfer cut-off ratio.

A couple of measures at a lower level are KPIs in their own right (PS unavailability,attach time, attach failure ratio). Other measures of a similar nature, such as PSservice access time, are given as PIs (performance indicators).

1

The Mobile CallGenerator is simply a modified RTU 4Gs unit, playing precisely the same role in voicetesting as the stationary CallGenerator. See section 7.1.2.

Page 13: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 13/40

© Ascom (2014) Document :NT14-32322 10(37)

Various events report on the status of the data connection, such as PS Attach/Detach,PDP Context Activation/Deactivation, and Routing Area Update.

4.1.3.2 IP Data Logging

TEMS Automatic has the capability to record application layer signaling for PS services(IP data logging). This is an important tool for troubleshooting PS services. Within awork order, the function can be switched on and off for each PS data service testingaction.

The IP packets are recorded in the PCAP format, which is used by several open-source packet sniffer applications including Wireshark. TEMS Automatic archives theIP data together with the regular TEMS logfiles holding RF data, and the IP and TEMSdata are time-aligned in the process.

4.1.3.3 Video StreamingTEMS Automatic can test video streaming over HTTP from video upload sites on theWeb (public servers), using Internet Explorer 9 as Web browser.

The viewer-perceived streaming quality is evaluated using the VQmon algorithm.Developed by Telchemy, VQmon bases its scoring on a parametric model taking IPsniffing data (among other things) as input. The algorithm is content-sensitive, whichmeans that it allows properties of the streamed video to influence the quality scores,preventing inexpertly shot or edited footage from unduly biasing the scores. Forexample, VQmon detects blank or frozen images as well as suspiciously blurry footagethat might result from the camera not being properly controlled.

4.1.3.4 Messaging

TEMS Automatic comes with comprehensive support for testing of SMS, MMS, andemail messaging, where messages are exchanged between probes. Crucialperformance metrics calculated include average transfer time and send failure rate.

For receiving of email, IMAP is offered as an option alongside POP3. The IMAP(Internet Message Access) protocol for email retrieval is a refinement of POP3, which itis gradually supplanting. Emails may optionally contain attachments.

4.1.3.5 Throughput and Latency Measurements

The throughput limits of the network can be probed using a number of services, notablyFTP or Iperf. The latter service is specifically designed to gauge maximum TCP andUDP bandwidth performance by interacting with an Iperf server.

Network latency is conveniently measured with Ping.

4.1.3.6 Web Browsing

HTTP sessions can be conducted either with Internet Explorer (version 7 or 9) or withthe measurement probes own internal Web browser. For tests aiming to imitate userbehavior and operating conditions as closely as possible, it is advantageous to use acommercial browser like Internet Explorer. The probe-internal browser, on the other

Page 14: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 14/40

© Ascom (2014) Document :NT14-32322 11(37)

hand, is more suitable when the focus is on judging network performance rather thanon emulating the user’s experience.

4.1.4 Available Bandwidth Measurements: Blixt™ Ascom has devised a method of available bandwidth measurement (ABM) in state-of-the-art wireless networks such as LTE. The patent-pending ABM algorithm,trademarked as “Blixt”, helps operators track the bandwidth being offered to theirsubscribers with great precision and millisecond resolution. It has also been carefullydesigned for minimum intrusiveness , that is to say, to have the smallest possibleimpact on the quality-of-experience of paying network users.

What creates the need for a novel ABM algorithm is the rapid evolution of recentmobile telecom technologies such as LTE and HSPA, with their vastly higher data ratesand complex configuration options. For these technologies, traditional ABM methods

are no longer adequate; what is required are metrics and measurement techniquesdesigned specifically for the wireless environment.

Ascom’s Blixt technology for ABM is characterized by:

High peak load – low average load. Test data is sent in short, intense bursts(“chirps”) with much l onger pauses in between. The peak load is high enough to hitthe network’s theoretical maximum, while the average load is kept low. Thisscheme allows sounding out the available bandwidth while still making minimumuse of network resources.

Fast adaptation in time domain. The data bursts that probe the network are shortenough to track changes in radio conditions on a millisecond time scale. In this waya high-resolution profile of the available bandwidth is obtained.

Adaptation to network configuration. The amount of data sent is adjustedaccording to the network’s maximum throughput (for example, when the UE movesbetween LTE and HSPA networks), while keeping the level of intrusiveness to aminimum at all times.

Server-based design. The device that is performing ABM communicates with aserver which reflects the packets back to the device, including timestamps andother data in the packets. That means it is easy to test different parts of the networkby having the device access different servers. A timestamping protocol calledTWAMP is used.

4.1.5 Scanning

Scanning of radio frequency carriers is useful, for example, in comparing frequencyplans with the reality of the live network. With TEMS Automatic, this can easily be doneacross wide areas of UMTS (GSM as well as WCDMA) and LTE networks.

GSM scanning in TEMS Automatic encompasses BSIC decoding, System Informationdecoding, and C/I measurement.

In WCDMA it is possible to do Top-N CPICH scanning on up to 12 UARFCNs at a time,as well as BCH (SIB) decoding.

System Information/SIB data underlies the generation of missing neighbor events.

Basing neighbor analysis on broadcast information is a robust approach in that it does

Page 15: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 15/40

© Ascom (2014) Document :NT14-32322 12(37)

not rely on cell f iles, which have to be kept rigorously up-to-date to provide good inputto the analysis.

Some examples of LTE scanning options are: RSSI scanning, signal scanning,spectrum scanning, and enhanced power scanning.Example of configuration options: For enhanced power scanning, the bandwidth of anEARFCN to be scanned can be selected from 100 kHz up to 20 MHz, and theresolution can be adjusted in steps of 2.5 kHz.

For details of available scanning devices and their capabilities, turn to section 5.3.7.

4.2 Remote Probe Administration

Remote administration and monitoring of measurement probes are handled with eitherFleetManager or the Operator Console. Both of these are Web-based client

applications and incorporate a design tool for composing test scripts (workflows).Geographically positioned data is collected from the probes and presented in maps andgrids.

Other tasks handled from these application include monitoring of server applications aswell as various system administration tasks.

4.2.1 Workflows: Test Script Administration

Every operation of a test probe is controlled by a workflow , specifying what measurements to make, where and when to make them, and for how long. Thestructure of the workflow supports sequential as well as parallel testing, the latter

including multi-RAB testing (concurrent voice and data sessions). A workflow may consist of a simple task or multiple tasks, whose execution may begoverned by control logic: loops, branching, if – else conditions, and more.

Also notable in this context is the possibility of running multiple PS data sessions withinthe same PDP context , with fixed or random-length pauses between the sessions.

The user can also control whether or not PS Attach and PS Detach will be performedfor every measurement and included in the logfile. If the user enables the work orderoption “Always PS Attached”, several data sessions can be run consecutively, and noDetach/Attach sequence is performed between measurements (for example: PS Attach→ PDP Context Activation → Measurement → PDP Context Deactivation → PDPContext Activation → Measurement ...). This pattern provides a closer mimicking ofend-user behavior: an entire testing sequence can be conducted within the same PDPcontext, just as a commercial smartphone would.

In the script designer, a workflow is assembled by picking measurement activities fromthe left-hand pane and inserting them by drag and drop at the desired position, asexemplified in the screenshot that follows.

Page 16: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 16/40

© Ascom (2014) Document :NT14-32322 13(37)

Workflow scripts are currently compatible with RTU 5 units equipped with TEMS Automatic 9.2 software or later. Earlier probes use the older work order structure fortest instructions.

4.2.1.1 Data Recording

During execution of a work order, radio parameters in combination with IP traceparameters are recorded; during data service testing, the performance of the data connection is measured in parallel.

As a stress test, an FTP transfer can be conducted for a fixed length of time (forexample, 30 seconds) using a very large file which will not be exhausted within thattime. The average application throughput is then computed for the session.

Certain functions such as audio quality measurement are optional , and their use istherefore specified in the work order. Some other aspects of test unit behavior, oneexample being speech codec preferences, are also set in each work order.

4.2.1.2 Measurement Triggers

When and where to execute a work order is governed by a set of triggers . Specifically,the execution may be restricted to particular time intervals or particular areas, or beconditioned by the values of network parameters. Work orders also have a parametergoverning how frequently the work order should be executed.

4.2.2 Probe Administration

Here is an overview of tasks handled from the Operator Console.

Page 17: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 17/40

© Ascom (2014) Document :NT14-32322 14(37)

4.2.2.1 Configuration

For each measurement probe, the following information can be inspected in theOperator Console:

Parameters constituting the unique identity of the test unit

SIM settings

SIM switch settings: Installed SIM cards and hardware capabilities

APN settings

TCP/IP settings

Workflow assignment, current and previous

When not needed for the testing currently being done, probe devices can be switchedoff remotely from the Operator Console to free up system resources and enhance theperformance of testing with other devices.

4.2.2.2 Monitoring

The system monitors status reports from fielded probes and indicates the status ofeach unit in the Operator Console.

An error condition reported by a test unit is signaled in the Operator Console interfaceby tagging the test unit icon with a red or yellow bell.

A further probe “health check” can be done by inspecting the log of events reported byeach test unit.

Finally, the Operator Console also displays probe usage statistics: up time, measuringtime, GPS coverage, and more.

4.2.2.3 Software Upgrades

The software of probes and the firmware of probe devices can be upgraded remotelyfrom the Operator Console interface.

All available software and firmware releases are arranged in a tree structure, wherethey are sorted by release number, cellular technology, and supporting hardware. Asoftware upgrade is made by drag-and-drop to the target probe group. The versionnumbers of the software and firmware currently running on a probe can be inspected inits properties dialog.

4.2.2.4 Data Upload

Probe data upload behavior, too, is specified by the Operator Console user. A range ofoptions is provided: the probe may be set to upload at a fixed time of day, or right aftereach test is fi nished, or when the vehicle ignition is turned off. Regarding the “wake -up”upload, see section 4.3.3.

There is also the possibility of uploading selected logfiles manually, from selectedprobes. This is done with the Manual Upload Tool, launched from the OperatorConsole.

Page 18: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 18/40

© Ascom (2014) Document :NT14-32322 15(37)

4.2.3 System Administration

Among system administration functions may be mentioned the ability to control anddifferentiate user access to the Operator Console. New users can be assigned topredefined user groups with set privileges.

4.3 Measurement Probes

TEMS Automatic offers a range of different measurement probes. We begin thissection with properties common to all types of probe (sections 4.3.1 –4.3.3) . The probetypes are identified and described from section 4.3.4 onward.

4.3.1 Deployment: Mobile vs. Fixed Probes

Our probes are primarily intended as unattended mobile probes to be installed invehicles, preferably ones that are in intensive circulation and cover a lot of ground,such as taxis, company cars, or buses used for public transportation. Trains andferries, too, may be suitable as probe carriers.

Traveling outdoors, the probes will usually have line-of-sight to GPS satellites, enablingpositioning of measurement data using the probe ’s built -in GPS or a connectedexternal GPS.

While designed mainly for outdoor use, probes can also be deployed indoors . Theyare then installed in fixed locations with known coordinates: in airports,subway/railway/bus stations, shopping malls, sport and entertainment venues, or otherpublic places.

4.3.2 Radio vs. Ethernet Testing

The core area of application of TEMS Automatic is testing of mobile networks, andspecifically their radio interfaces in their successive incarnations – UMTS, CDMA/EV DO, and LTE.

Following the trend of handsets interacting with both fixed and mobile telephonynetworks, TEMS Automatic has the ability to do PS data service testing over anEthernet connection , using fixed-mounted probes.

4.3.3 Data Upload

The probes automatically upload their data to the fixed side on a regular basis,according to user-specified rules. Compare section 4.2.2.4. An advanced option ofspecial interest is the “ wake-up ” upload, where the probe starts up independently ofregular operation (for example, at night) to transfer its data, and then goes back tosleep.

Uploads take place over any device that is currently assigned to this task. The uploaddevice can be either dedicated , in which case it is not used for measurement, orshared , which means it is tasked with both upload and measurement (though notsimultaneously).

For stationary probe, the Ethernet port can be used when available for data testing and

even for data upload of logfiles.

Page 19: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 19/40

© Ascom (2014) Document :NT14-32322 16(37)

4.3.4 Overview of Measurement Probe Types

Data-collecting devices can be organized in a number of ways in TEMS Automatic,being enclosed in and/or coordinated by various larger hardware units. An overview isgiven below.

RTU, Remote Test Unit: This is a wholly self-contained probe containing bothdata-collecting devices (smartphones or data modems), an upload device, a GPS,and a controlling CPU, all integrated within the same housing. Further devices canbe connected via USB, like: external scanner.

RCU, RTU Control Unit: This box contains an upload device, a GPS, and acontrolling CPU, but no data-collecting devices. The RCU is intended for use withsmartphones, and these are connected externally via USB, in one of the followingways:

o Each smartphone connected directly to the RCU.

o Each smartphone encased in an RMU, Ruggedized Measurement Unit , whichin turn is connected to the RCU. This is a solution intended for TEMS PocketRemote units.

o Multiple smartphones mounted in one MDU, Multiple Device Unit , which isconnected to the RCU.

These are described in turn in the remainder of section 4.3.

Page 20: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 20/40

© Ascom (2014) Document :NT14-32322 17(37)

Principal measurement probe and device configurations in TEMS Automatic.

RTU

Mini Card measurement devices

External scanner(optional) GPS Data

uploaddevice

RCU

RCU

RMU

Datauploaddevice

GPS

Datauploaddevice

GPS

Smartphones

Smartphone

MDU DM

Smartphone

DMs

Page 21: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 21/40

© Ascom (2014) Document :NT14-32322 18(37)

4.3.5 RTU (Remote Test Unit)

The RTU is based on a ruggedized computer platform , accommodating up to fourmeasurement devices in its four internal PCI-e slots, and further equipped with twoUSB ports where external measurement devices can be connected.

Additionally, the RTU is configured with an in-built 8-slot SIM switch , seamlesslyshared across all measurement devices and accessible from the outside, so that SIMscan be easily changed.

The RTU also includes an internal GPS , essential for mobility. Alternatively, the RTUcan connect to an external GPS, which can of course be one with dead reckoningfacilities.

RTUs can be cascade connected , which is ideal when several RTUs are installed atthe same location: the test units can then share a GPS and be monitored with thesame Remote Status Indicator application.

All of the above strengths render the RTU base unit flexible and scalable and hencefit for a variety of benchmarking and quality monitoring scenarios. Benchmarkingbecomes scrupulously fair by employing the same measurement devices for all partiesbeing compared.

Embedded measurement devices (PCI-e modules) commonly used at present areEricsson F3607gw Mobile Broadband Modules and Sierra Wireless MC7700/MC7710data cards.

External devices supported using the USB ports are PCTEL EX and MX, andsimplifying the installation they can be mounted onto the RTU by means of a specialmounting plate.

The RTU has an external power outlet , through which it can power supply externaldevices such as a PCTEL EX scanner. Please note that the PCTEL MX scanner musthave its own direct power supply; it cannot use the RTU external power outlet.

External accessories like antenna combiners and uninterruptible power supply (UPS)can be mounted onto the RTU by means of a special mounting plate.

Protective covers can be fastened onto the front and rear panels of the RTU toprotect cables and cable connectors, making the RTU installation even more reliableand robust.

The RTU is stackable : Up to four RTUs can be mounted effortlessly on top of eachother by means of a simple stacking kit with spring pins, without any need for tools.

See the image on the right below.For demanding tasks like stress tests or lab tests, any RTU devices not in use can beswitched off remotely from the Operator Console to free up system resources andenhance performance.

For further technical detail on the RTU and its capabilities, please refer to section 5.5. Please refer to the Product Package Description for further details on configurationoptions and performance characteristics.

Page 22: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 22/40

© Ascom (2014) Document :NT14-32322 19(37)

Top left: Remote Test Unit (RTU 5), front panel. Bottom left: RTU 5, rear panel. Right: Two RTUs(RTU 4Gs model) stacked using the stacking kit. Note the spring pins, which make for easymounting. On the RTU 5, all cables exit through the rear panel, further simplifying the mountingprocedure.

4.3.6 RTU Control Unit (RCU)

The RTU Control Unit (RCU), similar to the RTU base unit in terms of exterior design,is a computer platform to which measurement devices are connected externally through USB ports. The RCU is primarily designed for use with smartphones , either

enclosed in a Multiple Device Unit ( MDU) or in Ruggedized Measurement Units(RMUs ), or else connected directly via USB cables.

The main purpose of the RCU is to relieve measurement devices of all tasks otherthan measuring. The RCU offers advanced device control functionality with quickrecovery handling, minimizing device downtime and safeguarding the highest possiblemeasurement efficiency . It also enables time-based test synchronization forbenchmarking, something which is useful when having several devices connected andtesting in parallel, as well as support for remote software upgrade via FleetManager orthe Operator Console.

Additionally, the RCU is by default configured with an in-built PCI-e module for dataupload and remote administration of work orders. This device is shared across all

smartphone devices connected via either an MDU or an RMU, offloading smartphonesand helping to free up more time for measurement.

The RCU also includes an internal GPS . The GPS is shared among all measurementdevices so that only one GPS antenna is required, making installation and deploymentpainless.

The RCU has the capability to power supply both an RMU and an MDU by means ofits specially designed combined power/data cable.

Like RTUs, RCUs can be cascade connected using a router, or stacked on top of eachother. More generally, they share the same virtues of flexibility and scalability .

External accessories and protective covers can be mounted just as for the RTU.

Page 23: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 23/40

© Ascom (2014) Document :NT14-32322 20(37)

4.3.7 Multiple Device Unit (MDU) for Smartphone Testing

The Multiple Device Unit (MDU) is a ruggedized, hardware-enclosed, four-in-a-boxsmartphone solution primarily designed for automated benchmarking activities. Itenables operators to efficiently and scalably monitor and test smartphone-based on-device services from an end-user ’s perspective.

Like the RTU, the MDU is intended to be installed in vehicles , preferably in thecustomer’s own company cars so that phones can be easily accessed when required.

The MDU supports connecting an external RF antenna with diversity and is equippedwith an external SIM slot , accessible from the front plate.

The MDU does not have a central processing unit; it is intended to be used inconjunction with an RCU.

External accessories and protective covers can be mounted just as for the RTU.

MDUs are stackable , like RTUs.For more technical detail on the MDU, please refer to section 5.2.3.

4.3.8 Ruggedized Measurement Unit (RMU) for Smartphone Testing

The Ruggedized Measurement Unit (RMU) is a hardware unit configured forautomated, 24/7 operation and primarily designed to hold a TEMS Pocket Remote smartphone.

Like RTUs, RMUs are intended as unattended mobile probes to be installed invehicles, preferably ones that are in intensive circulation. Traveling outdoors, RMUs willusually have line-of-sight to GPS satellites, enabling positioning of measurement datausing the TEMS Pocket phones ’ built-in GPS or a connected external GPS.

While designed mainly for outdoor use, RMUs can also be deployed indoors . They arethen installed in fixed locations with known coordinates.

The RMU does not have a central processing unit; it is intended to be used inconjunction with an RCU.

For details on TEMS Pocket Remote capabilities, please refer to the TEMS PocketTechnical Product Description.

4.4 In-field Probe Administration : “Local GUI”

Measurement probes operate autonomously without requiring human interaction.Nonetheless, it may sometimes be desirable to monitor the status of probes moreclosely. For this purpose, TEMS Automatic offers Local GUI as an option with probes.This is an auxiliary application installed on a PC laptop or tablet which displays statusinformation on the probes connected to it. Such a setup enables the vehicle driver toeffortlessly supervise all data collecting units.

The Local GUI application is particularly useful during directed testing, such asbenchmarking sessions where the tester is assigned to perform a predeterminednumber of calls. It is then easy to verify that the correct number of calls is in fact made.

The Local GUI monitors the probes’ measurement activities (CS, PS, scanning), the

status of each internal and external device, data uploads, GPS coverage, DSP status,

Page 24: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 24/40

© Ascom (2014) Document :NT14-32322 21(37)

memory usage, and software upgrading. A set of line charts tracks important radioparameters. Finally, a map view is provided to allow inspection of vehicle drivingroutes.

The Local GUI can connect to probes either via a router or through a LAN cable usinga daisy-chain configuration. Data can be displayed for up to 18 connected devices.

4.5 Service Quality Test Nodes

The quality test nodes in the TEMS Automatic system are used for end-to-end testingof customer-perceived voice and data service quality.

4.5.1 CallGenerator

The CallGenerator is a stationary component based on a commodity server platform. It

has processing power to concurrently calculate test scores for a whole fleet ofmeasurement probes calling in. The test calls, which can be both mobile-originated(MO) and mobile-terminated (MT), are carried by telephone lines connected to digital orPSTN (analog) voice boards.

The CallGenerator configuration very thoroughly supports CS voice testing, bothnarrowband and wideband, with a rich set of KPIs being computed which are alignedwith ETSI definitions. Among these are MOS scores calculated for PESQ and POLQA.

Additionally, the CallGenerator has the capability to measure things like echo delay andattenuation, speech path delay, voice jitter, volume level, as well as the TEMS-specificSQI quality index. It also detects silent calls.

To enable calculation of PESQ/POLQA, authentic speech sentences are played on thevoice channel during test calls. The CallGenerator computes the quality scores for theuplink, while the probe handles the downlink calculation.

Recordings scoring sufficiently low on the PESQ or POLQA scale (the user sets thethreshold) are saved to a special directory, where they can be inspected and replayedusing suitable software. The recordings are A-law quantized with 8 bits and have 8 kHzsampling frequency.

The CallGenerator also has a facility for recognition of tone signals emitted by themobile station. Registered tone signals are recorded in the database.

PCI Express or PCI boards are used in the CallGenerator to allow greater flexibility inselecting PC hardware, either digital E1 (ISDN) boards or PSTN boards.

4.5.2 Mobile CallGenerator (MCG)

The Mobile CallGenerator is a mobile unit (a modified RTU-5) whose function is entirelyanalogous to the stationary CallGenerator. That is, test units dial the MCG givinginstructions for the voice test that is to follow, and the MCG responds by calling back. Itneeds to be noted that the call handling capacity of the MCG is limited by the numberof devices it has installed.

Page 25: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 25/40

© Ascom (2014) Document :NT14-32322 22(37)

4.5.3 PS Data Test Nodes

Data test nodes can be located within th e operator’s network or anywhere in theInternet. They consist of a computer running Microsoft IIS FTP server or Microsoft IISWeb server. Data test nodes for streaming are named streaming data nodes.

By deploying data test nodes both within their own cellular network and elsewhere inthe Internet, operators can determine whether communication problems reside in theirown infrastructure or have external causes.

Over a packet-switched connection, all supported data services can be tested.

When testing FTP, the data test node will be the RAS/FTP server in the TEMS Automatic system, or any Microsoft IIS FTP server that allows the test unit to readand write data.

When testing HTTP download, the data test node can be any Web site.

For HTTP file upload, the destination can be any HTTP server, which howeverneeds to have a special script installed.

Iperf testing is done against a server running Iperf software.

Streaming using public servers is designed to work with most commonly usedstreaming sites.

Email has support for both POP3 and IMAP on the receiving side, while the senderuses SMTP.

For further details, please refer to the tables in section 5.3.2.

4.5.4 Available Bandwidth Measurements: Blixt™ Test Nodes A device that is performing ABM communicates with a server which reflects thepackets back to the device, including timestamps and other data in the packets. Thatmeans it is easy to test different parts of the network by having the device accessdifferent servers (one or several, up to four), which are hosted by Ascom.

4.6 Post-processing with TEMS ™ Discovery

TEMS Discovery is Ascom’s state -of-the-art post-processing tool for wireless networkdata, including data from TEMS Automatic. This product is covered in its own TechnicalProduct Description, to which we refer; here, we will only state a few highlights ofTEMS Discovery.

Unmatched range of processed data. No competing product can match thevariety of information elements that TEMS Discovery handles, allowing thoroughanalysis of the data collected.

Easy and extensive customization capabilities: The various views and dataexplorers can be arranged in countless combinations. Data can be presented inmultiple sub-views for easy side-by-side comparison, or in more conventional viewswith maps, time series, messages, tables, histograms, and reports – the choice isyours. In addition, TEMS Discovery includes a fully customizable report templatebuilder, key information settings, analysis sets for specific tasks, and much more.

Page 26: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 26/40

© Ascom (2014) Document :NT14-32322 23(37)

Low total cost of ownership: The software can be deployed with minimal ITsystem requirements and with minimal dependence on third-party software. Largevolumes of data are handled with low memory demand, and the intuitive, easy-to-

learn interface speeds up analysis. There is also integrated online access to free orlow-cost GIS data sources.

Flexible deployment architecture: The network configuration is easy with minimalplatform requirements, allowing engineers to collaborate across functional roles andlocations. The processed data, refined into highly organized information with anunlimited number of composite data sets, is instantly accessible throughout theorganization.

Page 27: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 27/40

© Ascom (2014) Document :NT14-32322 24(37)

5 Product Package, System Components

5.1 Product Package OverviewThe standard product package consists mainly of the following components:

TEMS Automatic system license (comprising licenses for all TEMS Automaticcomponents)

User documentation DVDs.

Please note that DVDs with TEMS Automatic software and requisite third-partyapplications are not included in the product package, since these applications areinstalled on-site for the customer by Ascom Network Testing staff.

Measurement probes are likewise not part of the TEMS Automatic product package but

are ordered separately, along with the accessories required for in-vehicle installation. At the probe level, too, a number of features are options which are ordered separatelyfor each probe, including the data card and licenses for connecting various externaldevices, for mobile-to-mobile voice testing, for PESQ/POLQA voice qualitymeasurement, and for testing various other services.

5.2 Measurement Probes

5.2.1 RTU Configuration

The RTU supports up to four measurement devices, which are installed in its fourinternal PCI-e slots, and is also equipped with two USB ports where externalmeasurement devices can be connected.

Embedded measurement devices (PCI-e modules) commonly used at present are:

Ericsson F3607gw Mobile Broadband Modules

Sierra Wireless MC7700/MC7710 data cards

External devices supported using the USB ports are:

PCTEL EX – GSM/WCDMA/LTE

PCTEL EXflex – GSM/WCDMA/LTE

PCTEL MX – GSM/WCDMA/LTEPlease note that the overall performance of the RTU is dependent on its deviceconfiguration. For testing at very high throughputs, it is wise to disable any RTUdevices that are not needed for that particular test (see section 4.3.5) .

For further details about RTU configuration and dimensioning, please refer to theTEMS Automatic Product Package Description.

Page 28: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 28/40

Page 29: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 29/40

© Ascom (2014) Document :NT14-32322 26(37)

5.3 Testing Capabilities

5.3.1 CS Voice Testing

RTU 5 Standalone Ed.with TA 10.0 using

ProbeController

RTU with Mini Cards,TA 10.1

RCU with MDU(Smartphones),

TA 10.1/10.2

RMU with TEMSPocket Remote(Smartphone)

CapabilitiesEricssonF3607gw

SierraWirelessMC7700/

7710

EricssonF3607gw

SierraWirelessMC7700/

7710

SamsungGalaxy

S4 GT-I9506,S5 SM-G900FQ

SamsungGalaxy S4GT-I9506

Test mode Tethered Tethered Tethered On-device

Call setuptime

N/A N/A

Call successrate

N/A N/A

Voice SQI N/A N/A N/A N/A

Voice PESQ N/A N/A –

Voice POLQANB/SWB

N/A N/A Planned

Mobile to fixed

N/A

N/A MOC/DL only

Mobile tomobile

N/A N/A

Echo, mobileto fixed

– N/A – N/A – –

Volume N/A N/A

Silent call N/A N/A

Speech pathdelay

N/A

N/A

Page 30: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 30/40

© Ascom (2014) Document :NT14-32322 27(37)

5.3.2 PS Data Testing

RTU 5 Standalone Ed.

with TA 10.0 usingProbeController

RTU with Mini Cards,TA 10.1

RCU with MDU

(Smartphones),TA 10.1/10.2

RMU with TEMS

Pocket Remote(Smartphone)

CapabilitiesEricssonF3607gw

SierraWirelessMC7700/

7710

SamsungGalaxy

S4 GT-I9506,S5

SM-G900FQ

SierraWirelessMC7700/

7710

SamsungGalaxy

S4 GT-I9506,S5

SM-G900FQ

SamsungGalaxy S4GT-I9506

Test mode Tethered Tethered On-device On-device

PDP activate/deactivate

N/A

Alwaysconnected

FTP DL/UL – –

HTTPbrowsing

IE9/TEMS

Browser

IE9/TEMS

Browser

IE9/TEMS

Browser

IE9/TEMS

Browser

Web kit

HTTP Get

HTTP file DL

HTTP file UL

Ping

SMS

withoutUL/DLmatch

withoutUL/DLmatch

withoutUL/DLmatch

withoutUL/DLmatch

Send

MMS –

Planned

Planned

Planned –

Planned

– –

WAP 1/2 – – – – – –

Video

streaming(VSTQ)

N/A N/A

VideostreamingHTTP(VQmon)

– –

VQmon notsupported

with HTTPS

VQmon notsupported

with HTTPS

VQmon notsupported

VQmon notsupported

Email: SMTP,POP3/IMAP

– –

Iperf 3.0(UDP/TCP)

– –

Page 31: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 31/40

© Ascom (2014) Document :NT14-32322 28(37)

RTU 5 Standalone Ed.with TA 10.0 using

ProbeController

RTU with Mini Cards,TA 10.1

RCU with MDU(Smartphones),

TA 10.1/10.2

RMU with TEMSPocket Remote(Smartphone)

CapabilitiesEricssonF3607gw

SierraWirelessMC7700/

7710

SamsungGalaxy

S4 GT-I9506,S5

SM-G900FQ

SierraWirelessMC7700/

7710

SamsungGalaxy

S4 GT-I9506,S5

SM-G900FQ

SamsungGalaxy S4GT-I9506

ABM (Blixt) – – – –

5.3.3 Interference Measurements

RTU 5 Standalone Ed.with TA 10.0 usingProbeController

RTU with Mini Cards,TA 10.1

RCU with MDU(Smartphones),TA 10.1/10.2

RMU with TEMSPocket Remote(Smartphone)

CapabilitiesEricssonF3607gw

SierraWirelessMC7700/

7710

SamsungGalaxy S4GT-I9506

SierraWirelessMC7700/

7710

SamsungGalaxy

S4 GT-I9506,S5 SM-G900FQ

SamsungGalaxy S4GT-I9506

Test mode Tethered Tethered On-device On-device

C/I (GSM) N/A N/A N/A N/A

C/A (GSM) – N/A – N/A N/A N/A

Ec/No(WCDMA)

SIR (WCDMA)

SIR Target(WCDMA)

– – – –

5.3.4 Measurement Control Capabilities

RTU 5 Standalone Ed.with TA 10.0 using

ProbeController

RTU with Mini Cards,TA 10.1

RCU with MDU(Smartphones),

TA 10.1/10.2

RMU with TEMSPocket Remote(Smartphone)

Capabilities EricssonF3607gw

SierraWirelessMC7700/

7710

SamsungGalaxy S4GT-I9506

SierraWirelessMC7700/

7710

SamsungGalaxy

S4 GT-I9506,S5 SM-G900FQ

SamsungGalaxy S4GT-I9506

Test mode Tethered Tethered On-device On-device

RAT lockGSM

Page 32: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 32/40

© Ascom (2014) Document :NT14-32322 29(37)

RTU 5 Standalone Ed.with TA 10.0 using

ProbeController

RTU with Mini Cards,TA 10.1

RCU with MDU(Smartphones),

TA 10.1/10.2

RMU with TEMSPocket Remote(Smartphone)

CapabilitiesEricssonF3607gw

SierraWirelessMC7700/

7710

SamsungGalaxy S4GT-I9506

SierraWirelessMC7700/

7710

SamsungGalaxy

S4 GT-I9506,S5 SM-G900FQ

SamsungGalaxy S4GT-I9506

RAT lockWCDMA

RAT lockUMTS(non-LTE)

N/A – Planned

N/A

RAT lock LTE N/A N/A

Band lockGSM

Band lockWCDMA

Band lock LTE N/A N/A

Disable EDGE – – – – – –

Disable HSPA – – – – – –

GSM vocoderselection

– N/A – N/A N/A N/A

WCDMAvocoderselection

– N/A – N/A N/A N/A

C/I (GSM) Always on

– Always on

– – –

C/A (GSM) – – – – – –

Scanning – – – –

Set HSDPAcategory(WCDMA)

N/A – N/A – – –

Set HSUPAcategory(WCDMA)

N/A – N/A – – –

Set LTEcategory

N/A N/A N/A N/A N/A N/A

Page 33: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 33/40

© Ascom (2014) Document :NT14-32322 30(37)

5.3.5 Measurement Trigger Capabilities

RTU 5 Standalone Ed.

with TA 10.0 usingProbeController

RTU with Mini Cards,TA 10.1

RCU with MDU

(Smartphones),TA 10.1/10.2

RMU with TEMS

Pocket Remote(Smartphone)

Capabilities EricssonF3607gw

SierraWirelessMC7700/

7710

SamsungGalaxy S4GT-I9506

SierraWirelessMC7700/

7710

SamsungGalaxy

S4 GT-I9506,S5 SM-G900FQ

SamsungGalaxy S4GT-I9506

Test mode Tethered Tethered On-device On-device

Date/time N/A N/A

Area N/A N/A

CGI (Cell Id) N/A N/A – – – –

Rx Level N/A N/A – – – –

RSCP N/A N/A – – – –

Distance N/A N/A

5.3.6 Data Upload Trigger Capabilities

RTU 5 Standalone Ed.with TA 10.0 using

ProbeController

RTU with Mini Cards,TA 10.1

RCU with MDU(Smartphones),

TA 10.1

RMU with TEMSPocket Remote(Smartphone)

Capabilities EricssonF3607gw

SierraWirelessMC7700/

7710

EricssonF3607gw

SierraWirelessMC7700/

7710

RCU withSierra Wireless

MC7700/7710

SamsungGalaxy S4GT-I9506

Test mode Tethered Tethered On-device On-device

Interval N/A N/A

Start-up N/A N/A

Shutdown N/A N/A

Fixed time ofday

N/A N/A

After action N/A N/A

Managed as anaction activity

Page 34: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 34/40

© Ascom (2014) Document :NT14-32322 31(37)

RTU 5 Standalone Ed.with TA 10.0 using

ProbeController

RTU with Mini Cards,TA 10.1

RCU with MDU(Smartphones),

TA 10.1

RMU with TEMSPocket Remote(Smartphone)

CapabilitiesEricssonF3607gw

SierraWirelessMC7700/

7710

EricssonF3607gw

SierraWirelessMC7700/

7710

RCU withSierra Wireless

MC7700/7710

SamsungGalaxy S4GT-I9506

Manual, fromLocal GUI

Probe

Controller

Probe

Controller

RSI

RSI

RSI

Manual, fromOperatorConsole

N/A N/A – – –

5.3.7 Scanning Capabilities of RTU Devices/External Scanners

The PCTEL EX column is valid for both EX, EX mini and EXflex scanners.

CapabilitiesEricssonF3607gw

PCTELSeeGull EX

(incl. EX miniand EXflex)

PCTELSeeGull MX

GSM scanning capabilities

RSSI scanning – static ARFCN set

RSSI scanning – BSIC decoding

RSSI scanning – C/I measurement –

RSSI scanning – System Info decoding –

Spectrum analysis –

WCDMA scanning capabilities

Pilot scanning – static SC set –

Pilot scanning – Top N

Pilot scanning – SIB decoding (continuous)

Pilot scanning – SIB decoding (snapshot) – –

Pilot scanning – high speed/high dynamic –

P-SCH + S-SCH –

Max number of UARFCNs 12 12 12

Page 35: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 35/40

© Ascom (2014) Document :NT14-32322 32(37)

CapabilitiesEricssonF3607gw

PCTELSeeGull EX

(incl. EX mini

and EXflex)

PCTELSeeGull MX

SCH timeslot scanning – – –

RSSI scanning –

Spectrum analysis –

Network analysis – –

LTE scanning capabilities

RSSI scanning N/A

Signal scanning N/A

Enhanced signal scanning N/A –

Spectrum scanning N/A

Enhanced power scanning N/A

Page 36: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 36/40

© Ascom (2014) Document :NT14-32322 33(37)

5.4 Device Capabilities

The table below lists some important attributes and capabilities of measurement

devices.

DeviceCapability

EricssonF3607gw

Sierra WirelessMC7710/MC7700

Samsung GalaxyS4 GT-I9506,

S5 SM-G900FQ

WCDMA band 850/1900/2100 MHz

or

900/1900/2100 MHz

900/2100 MHz

or

800/850/1900/2100MHz

850/900/1900/2100

GSM band 850/900/1800/1900

MHz

900/1800/1900 MHz

or

850/900/1800/1900MHz

850/900/1800/1900

MHz

LTE band – DD800/1800/2100/2600 MHz

or

700/1700/2100 MHz

800/850/900/1800/2100/2600 (depends on

market)

GSM/WCDMAvoice

AMR-WB, AMR-FR, AMR-HR, EFR, FR, HR

N/A AMR-WB, AMR-FR, AMR-HR, EFR, FR, HR

GSM/GPRS/EDGE Multislot class 10(GPRS, EDGE)

Multislot class 12(GPRS, EDGE)

Multislot class 12(GPRS, EDGE)

WCDMA R99/HSPA HSDPA Categoriesup to 7.2 Mbit/s(Category 1 –8)

HSUPA Categoriesup to 2.0 Mbit/s

(Categories 1, 3, 5)

HSDPA Categoriesup to 21.1 Mbit/s

(Category 14, EvolvedHSPA), or up to 42.2

Mbit/s with Dual Carrier(Category 24)

HSUPA Categoriesup to 5.76 Mbit/s

(Category 6)

HSDPA Categoriesup to 21.1 Mbit/s

(Category 14, EvolvedHSPA), or up to 42.2

Mbit/s with Dual Carrier(Category 24)

HSUPA Categoriesup to 5.76 Mbit/s

(Category 6)

LTE – LTE Categories up to100 Mbit/s DL and up to

50 Mbit/s UL, with 20MHz bandwidth

(Category 3, MIMO)

LTE Categories up to150 Mbit/s DL and up to

50 Mbit/s UL, with 20MHz bandwidth

(Category 4, MIMO)

Page 37: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 37/40

© Ascom (2014) Document :NT14-32322 34(37)

5.5 Technical Capabilities

5.5.1 Probe Capabilities

Capabilities

RTU 5Standalone

Edition with TA10.0 using

ProbeController

RTU with MiniCards (PCI-e

Modules)

RCU with MDU(Smartphones)

RMU with TEMSPocket Remote(Smartphone)

Upload device –

Manual uploadfrom

ProbeController

Configurable(slots 1 –4)

RCU: Slot 4

Shared withmeasurement

device

External SIM Access

SIM switch formeasurementdevices

4 slots + peer-to-peer PCI-e slot

8 slots – –

SIM for upload N/A

Optional: sharedwith

measurementdevice

Shared withmeasurement

device

Disable deviceremotely –

N/A

Set as fixed test unit – Planned

Set low voltage limit – – Planned

GPS Ethernetsynch (setmaster/slaveremotely)

– N/A

GPS Ethernetsynch, daisy-chainconnected

– – – N/A

GPS Ethernetsynch, routerconnected

Peer-to-peerconfigured withProbeController

N/A

GPS externalantenna

Page 38: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 38/40

© Ascom (2014) Document :NT14-32322 35(37)

Capabilities

RTU 5Standalone

Edition with TA

10.0 usingProbeController

RTU with MiniCards (PCI-e

Modules)

RCU with MDU(Smartphones)

RMU with TEMSPocket Remote

(Smartphone)

Set SBAS supportfor GPS

RF externalantenna

RF diversity

Set power-off delay N/A N/A

5.6 Technical Specifications

Property RTU/RCU MDU RMU

Operating system Windows EmbeddedStandard 7

N/A N/A

Input voltagerange

6.0 ... 32.0 V DCMax. 6 A

10.0 ... 32.0 V DCMax. 6 A

6.0 ... 32.0 V DCMax. 6 A

Power

consumption

RTU with 2 internal

measurement devices:31.1 W

RTU with 3 internalmeasurement devices:

34.6 W

RTU with 3 internal +2 external devices:

Max. 60 W

RTU with 4 internal +1 external device:

Max. 60 W

MDU with 4 devices:

Max. 60 W

RTU with 1 internal

measurement devices: 25 W

Dimensions(h w d)

50 × 260 × 176 mm 82 × 475 × 323 mm 50 × 260 × 176 mm

Weight 2.6 kg 2.15 kg 2.6 kg

Operatingtemperature

– 30ºC ... +50ºC 1 – 0ºC ... +45ºC 2 – 0ºC ... +45ºC 2

CPU Intel Core i7 N/A N/A

1 Maximum temperature may be affected by technology and measurement device used.

2 Maximum temperature may be affected by technology and measurement device used; e.g. Samsung Galaxy S III GT-I9505 max 40°C.

Page 39: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 39/40

© Ascom (2014) Document :NT14-32322 36(37)

Property RTU/RCU MDU RMU

Internal memory 2.0 GB N/A N/A

Non-volatilememory

8.0 GB N/A N/A

Number of GPSchannels

16 N/A N/A

Conformity CE, compliant with FCCrules, CFR 47, Part 15,Subpart C, Intentional

radiator, Paragraph 15.209

FCC Part 15 B Class B Limit

CE Marking (R&TTEDirectives for European

Smartphone)

FCC Part 15 B Class B Limit

CE Marking (R&TTEDirectives for European

Smartphone)

Environmentalspecification

RoHS compliant 1 RoHS compliant RoHS compliant(Directive 2002/95/EC)

5.7 TEMS Pocket Device Capabilities

For further technical details on the capabilities of the TEMS Pocket device (SamsungGalaxy S4 GT-I9506), please refer to the TEMS Pocket Technical Product Description.

1 That is, it satisfies the requirements in the Restriction of Hazardous Substances directive adopted by the EU.

Page 40: TEMS Automatic 10.2 Technical Product Description

8/9/2019 TEMS Automatic 10.2 Technical Product Description

http://slidepdf.com/reader/full/tems-automatic-102-technical-product-description 40/40

6 TEMS Automatic System Configuration

6.1 Scalability Options A TEMS Automatic system can be configured in different ways to suit a wide variety ofcustomer needs. The dimensioning of the back-end part is dependent on manyparameters, most importantly the number of test units and the measurement tasks tobe performed. For small networks, a compact server that supports up to four test unitsis available; from this minimum size, the TEMS Automatic system can be expanded tosuit any network. Please contact us for further information on scaling and customizationof TEMS Automatic.

6.2 Hardware and Software Requirements

The TEMS Automatic system components (Operator Console/Call Generator/RemoteStatus Indicator) run on Windows-based platforms. The requirements for the serversand PCs to be used to run TEMS Automatic are determined by the TEMS Automaticconfiguration selected. Processor speed, RAM, and disk space requirements willtherefore be identified by a customer-specific installation project in each case.

General OS requirements are as follows:

Server OS: Windows Server 2012/SQL DB 2012

Client applications: Windows 7.

6.3 Intra-system Communication All components of the TEMS Automatic system communicate over standard datacommunication networks based on TCP/IP. This enables a wide variety of configurationsolutions.

The communication between the test units and the communication server is based onthe mobile data communication link.