OpenTAP Introduction to Test Composition and Automation
Lars Nielsen Keysight Technologies5G-VINNI WP4 030320
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
Agendabull OpenTAP overview
ndash Conceptndash Architecture
bull Main concepts for usendash UIsndash Workflow
bull Practical example from test composition to resultsndash Demo
03032020 OpenTAP Introduction to test composition and automation 2
OPENTAP OVERVIEWIntroduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 3
What is OpenTAPbull OpenTAP Open(source) Test Automation Platformbull OpenTAP is a light weight sequencing enginebull OpenTAP has a highly modular structure
ndash Everything (including GUIs) is seen as a plugin
bull Configure DUTsSUTs toolsndash via instruments and test steps contained in plugins
bull OpenTAP provides a low entry barrier for development and usagendash Quick development of plugins and test steps tailored to individual needsndash Simple dragrsquonrsquodrop of test steps in test plan composition
bull It is possible to ldquorulerdquo all the tools (not only Keysightrsquos) and DUTs
03032020 OpenTAP Introduction to test composition and automation 4
Why OpenTAP for Test Automationbull Simplicity
ndash Low technical barrier of entry TAP is not ldquoyet another programming languagerdquo
ndash Does just what you need not trying to be ldquoeverything for everyonerdquondash Simple for everyone programmers non-programmers and operators
bull Scalabilityndash Modular software architecture centered around a core sequencing enginendash IP encapsulated as plugins Build solutions through re-use not re-inventionndash Plugins can be shared and reused
bull Speedndash Optimized for manufacturing (speed time = $) yet robust for RampD usagendash Powerful analytics such as Timing Analyzer continuously amp efficiently improvendash Get to market fasterhellipaccelerate your deployments outpace the competition
03032020 OpenTAP Introduction to test composition and automation 5
Result Listeners
User Interfaces
Instrument Plugins
DUT Plugins
Test Step Plugins
How does the architecture look likeDEPENDENCY
PathWave
Automation Engine
DB Storage
CLI
DesktopEditor
Text Log
RabbitMQ
VNF DUT
Custom DUT
Custom Step
ConfigureTool
Custom Inst Custom RL
Custom UI
TUIWeb
Editor
Hawkeye Yardstick
IxLoad
Traffic load step
REST API
From a Userrsquos Perspective
03032020 OpenTAP Introduction to test composition and automation 7
Results Viewer
Run ExplorerTiming Analyzer
Editor
Package Manager
Community Edition Developer GUI
bull Free to use for non-commercial
organizations amp open source projects
bull Download via OpenTAPio or
Keysightcom
bull Ready to use in under 85 seconds
bull Quickly create amp edit test plans without any
programming experience
bull Experiment with demo plugins requiring no
hardware
httpsgitlabcomOpenTAP
Join ndash The Community
MAIN CONCEPTS FOR USE OF OPENTAP
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 10
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
Agendabull OpenTAP overview
ndash Conceptndash Architecture
bull Main concepts for usendash UIsndash Workflow
bull Practical example from test composition to resultsndash Demo
03032020 OpenTAP Introduction to test composition and automation 2
OPENTAP OVERVIEWIntroduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 3
What is OpenTAPbull OpenTAP Open(source) Test Automation Platformbull OpenTAP is a light weight sequencing enginebull OpenTAP has a highly modular structure
ndash Everything (including GUIs) is seen as a plugin
bull Configure DUTsSUTs toolsndash via instruments and test steps contained in plugins
bull OpenTAP provides a low entry barrier for development and usagendash Quick development of plugins and test steps tailored to individual needsndash Simple dragrsquonrsquodrop of test steps in test plan composition
bull It is possible to ldquorulerdquo all the tools (not only Keysightrsquos) and DUTs
03032020 OpenTAP Introduction to test composition and automation 4
Why OpenTAP for Test Automationbull Simplicity
ndash Low technical barrier of entry TAP is not ldquoyet another programming languagerdquo
ndash Does just what you need not trying to be ldquoeverything for everyonerdquondash Simple for everyone programmers non-programmers and operators
bull Scalabilityndash Modular software architecture centered around a core sequencing enginendash IP encapsulated as plugins Build solutions through re-use not re-inventionndash Plugins can be shared and reused
bull Speedndash Optimized for manufacturing (speed time = $) yet robust for RampD usagendash Powerful analytics such as Timing Analyzer continuously amp efficiently improvendash Get to market fasterhellipaccelerate your deployments outpace the competition
03032020 OpenTAP Introduction to test composition and automation 5
Result Listeners
User Interfaces
Instrument Plugins
DUT Plugins
Test Step Plugins
How does the architecture look likeDEPENDENCY
PathWave
Automation Engine
DB Storage
CLI
DesktopEditor
Text Log
RabbitMQ
VNF DUT
Custom DUT
Custom Step
ConfigureTool
Custom Inst Custom RL
Custom UI
TUIWeb
Editor
Hawkeye Yardstick
IxLoad
Traffic load step
REST API
From a Userrsquos Perspective
03032020 OpenTAP Introduction to test composition and automation 7
Results Viewer
Run ExplorerTiming Analyzer
Editor
Package Manager
Community Edition Developer GUI
bull Free to use for non-commercial
organizations amp open source projects
bull Download via OpenTAPio or
Keysightcom
bull Ready to use in under 85 seconds
bull Quickly create amp edit test plans without any
programming experience
bull Experiment with demo plugins requiring no
hardware
httpsgitlabcomOpenTAP
Join ndash The Community
MAIN CONCEPTS FOR USE OF OPENTAP
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 10
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
OPENTAP OVERVIEWIntroduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 3
What is OpenTAPbull OpenTAP Open(source) Test Automation Platformbull OpenTAP is a light weight sequencing enginebull OpenTAP has a highly modular structure
ndash Everything (including GUIs) is seen as a plugin
bull Configure DUTsSUTs toolsndash via instruments and test steps contained in plugins
bull OpenTAP provides a low entry barrier for development and usagendash Quick development of plugins and test steps tailored to individual needsndash Simple dragrsquonrsquodrop of test steps in test plan composition
bull It is possible to ldquorulerdquo all the tools (not only Keysightrsquos) and DUTs
03032020 OpenTAP Introduction to test composition and automation 4
Why OpenTAP for Test Automationbull Simplicity
ndash Low technical barrier of entry TAP is not ldquoyet another programming languagerdquo
ndash Does just what you need not trying to be ldquoeverything for everyonerdquondash Simple for everyone programmers non-programmers and operators
bull Scalabilityndash Modular software architecture centered around a core sequencing enginendash IP encapsulated as plugins Build solutions through re-use not re-inventionndash Plugins can be shared and reused
bull Speedndash Optimized for manufacturing (speed time = $) yet robust for RampD usagendash Powerful analytics such as Timing Analyzer continuously amp efficiently improvendash Get to market fasterhellipaccelerate your deployments outpace the competition
03032020 OpenTAP Introduction to test composition and automation 5
Result Listeners
User Interfaces
Instrument Plugins
DUT Plugins
Test Step Plugins
How does the architecture look likeDEPENDENCY
PathWave
Automation Engine
DB Storage
CLI
DesktopEditor
Text Log
RabbitMQ
VNF DUT
Custom DUT
Custom Step
ConfigureTool
Custom Inst Custom RL
Custom UI
TUIWeb
Editor
Hawkeye Yardstick
IxLoad
Traffic load step
REST API
From a Userrsquos Perspective
03032020 OpenTAP Introduction to test composition and automation 7
Results Viewer
Run ExplorerTiming Analyzer
Editor
Package Manager
Community Edition Developer GUI
bull Free to use for non-commercial
organizations amp open source projects
bull Download via OpenTAPio or
Keysightcom
bull Ready to use in under 85 seconds
bull Quickly create amp edit test plans without any
programming experience
bull Experiment with demo plugins requiring no
hardware
httpsgitlabcomOpenTAP
Join ndash The Community
MAIN CONCEPTS FOR USE OF OPENTAP
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 10
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
What is OpenTAPbull OpenTAP Open(source) Test Automation Platformbull OpenTAP is a light weight sequencing enginebull OpenTAP has a highly modular structure
ndash Everything (including GUIs) is seen as a plugin
bull Configure DUTsSUTs toolsndash via instruments and test steps contained in plugins
bull OpenTAP provides a low entry barrier for development and usagendash Quick development of plugins and test steps tailored to individual needsndash Simple dragrsquonrsquodrop of test steps in test plan composition
bull It is possible to ldquorulerdquo all the tools (not only Keysightrsquos) and DUTs
03032020 OpenTAP Introduction to test composition and automation 4
Why OpenTAP for Test Automationbull Simplicity
ndash Low technical barrier of entry TAP is not ldquoyet another programming languagerdquo
ndash Does just what you need not trying to be ldquoeverything for everyonerdquondash Simple for everyone programmers non-programmers and operators
bull Scalabilityndash Modular software architecture centered around a core sequencing enginendash IP encapsulated as plugins Build solutions through re-use not re-inventionndash Plugins can be shared and reused
bull Speedndash Optimized for manufacturing (speed time = $) yet robust for RampD usagendash Powerful analytics such as Timing Analyzer continuously amp efficiently improvendash Get to market fasterhellipaccelerate your deployments outpace the competition
03032020 OpenTAP Introduction to test composition and automation 5
Result Listeners
User Interfaces
Instrument Plugins
DUT Plugins
Test Step Plugins
How does the architecture look likeDEPENDENCY
PathWave
Automation Engine
DB Storage
CLI
DesktopEditor
Text Log
RabbitMQ
VNF DUT
Custom DUT
Custom Step
ConfigureTool
Custom Inst Custom RL
Custom UI
TUIWeb
Editor
Hawkeye Yardstick
IxLoad
Traffic load step
REST API
From a Userrsquos Perspective
03032020 OpenTAP Introduction to test composition and automation 7
Results Viewer
Run ExplorerTiming Analyzer
Editor
Package Manager
Community Edition Developer GUI
bull Free to use for non-commercial
organizations amp open source projects
bull Download via OpenTAPio or
Keysightcom
bull Ready to use in under 85 seconds
bull Quickly create amp edit test plans without any
programming experience
bull Experiment with demo plugins requiring no
hardware
httpsgitlabcomOpenTAP
Join ndash The Community
MAIN CONCEPTS FOR USE OF OPENTAP
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 10
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
Why OpenTAP for Test Automationbull Simplicity
ndash Low technical barrier of entry TAP is not ldquoyet another programming languagerdquo
ndash Does just what you need not trying to be ldquoeverything for everyonerdquondash Simple for everyone programmers non-programmers and operators
bull Scalabilityndash Modular software architecture centered around a core sequencing enginendash IP encapsulated as plugins Build solutions through re-use not re-inventionndash Plugins can be shared and reused
bull Speedndash Optimized for manufacturing (speed time = $) yet robust for RampD usagendash Powerful analytics such as Timing Analyzer continuously amp efficiently improvendash Get to market fasterhellipaccelerate your deployments outpace the competition
03032020 OpenTAP Introduction to test composition and automation 5
Result Listeners
User Interfaces
Instrument Plugins
DUT Plugins
Test Step Plugins
How does the architecture look likeDEPENDENCY
PathWave
Automation Engine
DB Storage
CLI
DesktopEditor
Text Log
RabbitMQ
VNF DUT
Custom DUT
Custom Step
ConfigureTool
Custom Inst Custom RL
Custom UI
TUIWeb
Editor
Hawkeye Yardstick
IxLoad
Traffic load step
REST API
From a Userrsquos Perspective
03032020 OpenTAP Introduction to test composition and automation 7
Results Viewer
Run ExplorerTiming Analyzer
Editor
Package Manager
Community Edition Developer GUI
bull Free to use for non-commercial
organizations amp open source projects
bull Download via OpenTAPio or
Keysightcom
bull Ready to use in under 85 seconds
bull Quickly create amp edit test plans without any
programming experience
bull Experiment with demo plugins requiring no
hardware
httpsgitlabcomOpenTAP
Join ndash The Community
MAIN CONCEPTS FOR USE OF OPENTAP
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 10
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
Result Listeners
User Interfaces
Instrument Plugins
DUT Plugins
Test Step Plugins
How does the architecture look likeDEPENDENCY
PathWave
Automation Engine
DB Storage
CLI
DesktopEditor
Text Log
RabbitMQ
VNF DUT
Custom DUT
Custom Step
ConfigureTool
Custom Inst Custom RL
Custom UI
TUIWeb
Editor
Hawkeye Yardstick
IxLoad
Traffic load step
REST API
From a Userrsquos Perspective
03032020 OpenTAP Introduction to test composition and automation 7
Results Viewer
Run ExplorerTiming Analyzer
Editor
Package Manager
Community Edition Developer GUI
bull Free to use for non-commercial
organizations amp open source projects
bull Download via OpenTAPio or
Keysightcom
bull Ready to use in under 85 seconds
bull Quickly create amp edit test plans without any
programming experience
bull Experiment with demo plugins requiring no
hardware
httpsgitlabcomOpenTAP
Join ndash The Community
MAIN CONCEPTS FOR USE OF OPENTAP
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 10
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
From a Userrsquos Perspective
03032020 OpenTAP Introduction to test composition and automation 7
Results Viewer
Run ExplorerTiming Analyzer
Editor
Package Manager
Community Edition Developer GUI
bull Free to use for non-commercial
organizations amp open source projects
bull Download via OpenTAPio or
Keysightcom
bull Ready to use in under 85 seconds
bull Quickly create amp edit test plans without any
programming experience
bull Experiment with demo plugins requiring no
hardware
httpsgitlabcomOpenTAP
Join ndash The Community
MAIN CONCEPTS FOR USE OF OPENTAP
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 10
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
Community Edition Developer GUI
bull Free to use for non-commercial
organizations amp open source projects
bull Download via OpenTAPio or
Keysightcom
bull Ready to use in under 85 seconds
bull Quickly create amp edit test plans without any
programming experience
bull Experiment with demo plugins requiring no
hardware
httpsgitlabcomOpenTAP
Join ndash The Community
MAIN CONCEPTS FOR USE OF OPENTAP
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 10
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
httpsgitlabcomOpenTAP
Join ndash The Community
MAIN CONCEPTS FOR USE OF OPENTAP
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 10
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
MAIN CONCEPTS FOR USE OF OPENTAP
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 10
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
OpenTAP GUI Components - Desktop
03032020 OpenTAP Introduction to test composition and automation 11
Test Step Panel
Log Panel
Settings PanelTest plan Panel
Resource BarInstruments DUTs result listeners
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal
including Docker containers
03032020 OpenTAP Introduction to test composition and automation 12
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
Example of OpenTAP Workflowbull Prerequisites
ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB
bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana
03032020 OpenTAP Introduction to test composition and automation 13
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
Generic Example of Vertical Application
Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to
prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status
live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in
terms of functionality and performance
03032020 OpenTAP Introduction to test composition and automation 14
Network to test
Hospital
Ambulance
API API
5G
Test scripts
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
Generic Example of Vertical Application
Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag
and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests
03032020 OpenTAP Introduction to test composition and automation 15
Network to test
Hospital
Ambulance
API API
5G
AmbulancePlugin
HospitalPlugin
OpenTAPplan
OpenTAPEngine
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
PRACTICAL OPENTAP USAGE EXAMPLE
Introduction to OpenTAP
03032020 OpenTAP Introduction to test composition and automation 16
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints
ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring
bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations
Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes
ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests
bull Supporting wide range of measurement types and application layer traffic emulation
03032020 OpenTAP Introduction to test composition and automation 17
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Configure test
Pushresults
TestTraffic
HawkeyeServer
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
Overview of Planned Test ndash OpenTAP Managed
bull Create OpenTAP plan using test steps from Hawkeye plugin
bull Configure tests and runbull Pull results from serverbull Post results in DB via Result
Listenerbull Visualize results in Grafana
dashboard
03032020 OpenTAP Introduction to test composition and automation 18
DB
HawkeyeEndpoint 1
HawkeyeEndpoint 2
Network to test
Postresults
Fetchresults
Run test
Pull results
Configure test
Pushresults
TestTraffic
OpenTAP Editor
Grafana
HawkeyeServer
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
DEMOUse OpenTAP to Run Hawkeye Tests
03032020 OpenTAP Introduction to test composition and automation 19
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu
Thank you for your attention
QampA
This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279
ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu