testing technologies in a 5g test nw - ucaat.etsi.org · • apache storm • apache spark •...
TRANSCRIPT
![Page 1: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/1.jpg)
Sophia Antipolis, French Riviera20-22 October 2015
TESTING TECHNOLOGIES IN A 5G TEST NWTeemu Kanstrén, Juho PeräläVTT Technical Research Center of Finland
© All rights reserved
![Page 2: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/2.jpg)
Background
2
• The 5GTN project started early 2015, with VTT, UoOand 15 industry partners, evolves over time
• Partners from different domains• HW providers• Test & monitoring tool vendors• Research & Analytics• Business & NW operations
©All rights reserved
![Page 3: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/3.jpg)
Background
3
• Example high‐level use cases:• Technical tests for 5G components• Test tool integration & use in realistic network environment• Dynamic small cell topologies & network adaptation• IoT devices and services testing
• Testing tech.support tests execution and analytics• New applications, services and networking solutions• 3rd party applications, services, algorithms, systems testing• Virtualized services
©All rights reserved
![Page 4: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/4.jpg)
5GTN Overview
4 © All rights reserved
![Page 5: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/5.jpg)
5GTN in Context
5 © All rights reserved
![Page 6: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/6.jpg)
Example Test Tools
• Traffic generation• HTTP(S) upload/download/ browsing, (S)FTP
• Video streaming• Voice/Video calls• TCP/UDP data streams• Traffic/user profiles (MBT)
• Test control:• Traffic gen. and meas. control on distributed NW
• Adapting to responses
6 © All rights reserved
• Monitoring tools (QoS)• UL/DL delay, jitter, packetloss, load
• Voice/video quality• Traffic details, e.g., HTTP/TCP
• Call setups, handovers, etc.
![Page 7: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/7.jpg)
Example Analytics Tools
• Visualizations• ElasticSearch/Kibana• InfluxDB/Grafana• Custom/Partner solutions, e.g. coverage/qos maps
• Stream/BD Analytics• Apache Storm• Apache Spark• Custom/Partner solutions, e.g. specific logs/faults
7 © All rights reserved
• Example use cases• Application profiling
• Performance• Resource use• NW load impact
• Optimization• QoS parameters on NW and
service level
• Input to other phases• NW management
![Page 8: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/8.jpg)
Example Test Scenarios
• Antenna Testing:• Different types of antennasinstalled on indoor smallcells
• Traffic generation and QoSparameter measurementfor different configurations
• Analysis of results, QoSvisualizations
8 © All rights reserved
• IoT service testing:• IoT service with backendserver and sensors
• Data streaming overdifferent network pathsusing diverse protocols, e.g. through gateways oversmall cells
• Analysis of service QoSattributes, networkparameters impact, guidedload generation
• LTE‐M etc.QosMet
![Page 9: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/9.jpg)
Process
9 © All rights reserved
Definescenario
Executetests
Visualize
Createstream/BDanalytics
Improve
![Page 10: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/10.jpg)
10 © All rights reserved
IoT Gateway Example
Monitor• Sensor data is passedthrough the GW
• We capture all eventspublished on the GW
• Aggregate on time‐window (e.g. sum in 1s)
• Publish stats over Kafka
Generate• Use profiles to create”real” data
Generate
Monitor
![Page 11: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/11.jpg)
11 © All rights reserved
Application Specific Monitoring
• Server side monitoring alsoused in production
• Tester vs server frequency• Clients delay variationincrease as more sessions
• Communication error ratesincrease with sessions
• Here we increase load in different environments, monitor applications, servers, clients, network,…
![Page 12: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/12.jpg)
12 © All rights reserved
Feedback‐directed test generation
• Poll the data stream for metrics of interest
• Use this to direct how testflow
• E.g., increase sessions untilCPU load > 90%• OS limits,• Dangling sessions,• NW element limits
• Add more params, analytics, etc.
![Page 13: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/13.jpg)
13 © All rights reserved
Some Data Analytics Concerns
• Often not clear what data weneed or how to get it,
• Different purposes requiredata at different granularity• Which can be limited• E.g., how do you find causes?
• Visualization is good but notalways enough alone
1min
5s
1s
errors
Router load vs NW errors?
NW bandwidth use
![Page 14: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/14.jpg)
14 © All rights reserved
Example measurements/sources
General• SNMP• QoSMet• Telegraf• Openstack API’s• Core network interfaces• NW device interfaces
Specific• Web traffic, e.g. Seleniumdriver with proxy• Request count, size, etc.
• IoT gateway sensor eventstatistics
• Application specific ,e.g., • sessions,• power use,
![Page 15: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/15.jpg)
Conclusions
• An environment for testing attributes such as performance, interoperability
• As a service for project partners to try test tools, test services, test products (e.g., IoT)
• Tools for test generation, monitoring, analytics• Development and additional scenarios ongoing• For a broader overview, see:
• M. Latva‐Aho, A. Pouttu, A. Hekkala, I. Harjula, J. Mäkelä, “Small Cell Based 5G Test Network (5GTN)”, 12th Int’l. Symp. on Wireless Comm. Systems, Brussels, Belgium, 25‐28.8.2015.
• www.5gtn.fi, www.5gtnf.fi
15 © All rights reserved
![Page 16: TESTING TECHNOLOGIES IN A 5G TEST NW - ucaat.etsi.org · • Apache Storm • Apache Spark • Custom/Partner solutions, e.g. specific logs/faults 7 ©Allrightsreserved • Example](https://reader034.vdocuments.us/reader034/viewer/2022042220/5ec6b3b763a53b6c3429a17f/html5/thumbnails/16.jpg)
TECHNOLOGY FOR BUSINESS