latency- and resilience-aware networking · 2019. 5. 6. · profiling and latency analysis for...

35
Latency- and Resilience-Aware Networking SPP 1914: “Cyber-Physical Networking” http://larn.systems Andreas Schmidt , Thorsten Herfet Telecommunications Lab Saarland Informatics Campus - Saarbrücken Stefan Reif , Timo Hönig, Wolfgang Schröder-Preikschat Department of Computer Science 4 (Distributed Systems and Operating Systems) Friedrich-Alexander-Universität Erlangen-Nürnberg October 19th, 2017

Upload: others

Post on 05-Mar-2021

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Latency- and Resilience-Aware NetworkingSPP 1914: “Cyber-Physical Networking”http://larn.systems

Andreas Schmidt, Thorsten HerfetTelecommunications LabSaarland Informatics Campus - Saarbrücken

Stefan Reif, Timo Hönig, Wolfgang Schröder-PreikschatDepartment of Computer Science 4 (Distributed Systems and Operating Systems)Friedrich-Alexander-Universität Erlangen-Nürnberg

October 19th, 2017

Page 2: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Recapitulation: Goals

Hardware

Operating System

PRRT

ApplicationTailor PRRT to control applications

Improve PRRT’s performance

OS for predictable communication

Tailor network to control applications

2 / 17

Page 3: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outcome

Software, Hardware & AlgorithmsX-Lap Cross-Layer Timing Analysis

PRRT Predictable Reliable Real-time Transport protocol- Latency & Jitter Analysis (with X-Lap)- APIs / Integrations: Python, Gstreamer- Hardware Timestamping Support

TTS Transparent Transmission Segmentation- TCP Relay, RTP Relay

RNA Reliable Networking Atom- Linux Image & Orchestration Code (including PRRT, ...)- Showcase Applications (Video-Stream, Sine-Controller)

NEAT Network Experiment Automation Tool

3 / 17

Page 4: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outcome

Software, Hardware & AlgorithmsX-Lap Cross-Layer Timing AnalysisPRRT Predictable Reliable Real-time Transport protocol

- Latency & Jitter Analysis (with X-Lap)- APIs / Integrations: Python, Gstreamer- Hardware Timestamping Support

TTS Transparent Transmission Segmentation- TCP Relay, RTP Relay

RNA Reliable Networking Atom- Linux Image & Orchestration Code (including PRRT, ...)- Showcase Applications (Video-Stream, Sine-Controller)

NEAT Network Experiment Automation Tool

3 / 17

Page 5: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outcome

Software, Hardware & AlgorithmsX-Lap Cross-Layer Timing AnalysisPRRT Predictable Reliable Real-time Transport protocol

- Latency & Jitter Analysis (with X-Lap)- APIs / Integrations: Python, Gstreamer- Hardware Timestamping Support

TTS Transparent Transmission Segmentation- TCP Relay, RTP Relay

RNA Reliable Networking Atom- Linux Image & Orchestration Code (including PRRT, ...)- Showcase Applications (Video-Stream, Sine-Controller)

NEAT Network Experiment Automation Tool

3 / 17

Page 6: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outcome

Software, Hardware & AlgorithmsX-Lap Cross-Layer Timing AnalysisPRRT Predictable Reliable Real-time Transport protocol

- Latency & Jitter Analysis (with X-Lap)- APIs / Integrations: Python, Gstreamer- Hardware Timestamping Support

TTS Transparent Transmission Segmentation- TCP Relay, RTP Relay

RNA Reliable Networking Atom- Linux Image & Orchestration Code (including PRRT, ...)- Showcase Applications (Video-Stream, Sine-Controller)

NEAT Network Experiment Automation Tool

3 / 17

Page 7: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outcome

Software, Hardware & AlgorithmsX-Lap Cross-Layer Timing AnalysisPRRT Predictable Reliable Real-time Transport protocol

- Latency & Jitter Analysis (with X-Lap)- APIs / Integrations: Python, Gstreamer- Hardware Timestamping Support

TTS Transparent Transmission Segmentation- TCP Relay, RTP Relay

RNA Reliable Networking Atom- Linux Image & Orchestration Code (including PRRT, ...)- Showcase Applications (Video-Stream, Sine-Controller)

NEAT Network Experiment Automation Tool

3 / 17

Page 8: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outline

Status

RNA

X-Lap

Conclusion

4 / 17

Page 9: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

RNA: Demo

Video-Stream Control Application

5 / 17

Page 10: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

RNA: Details

Hardware▶ Odroid XU4

▶ Samsung Exynos5422 Cortex-A15 2Ghz and Cortex-A7 Octa core CPUs▶ Mali-T628 MP6 (OpenGL ES 3.1/2.0/1.1 and OpenCL 1.2 Full profile)▶ 2Gbyte LPDDR3 RAM PoP stacked▶ Gigabit Ethernet port

▶ VU7 Plus Display (7inches, 1024x600 pixels, HDMI, 5-finger touch)

Software▶ Ubuntu 16.04.3 LTS, Kernel 4.9▶ Mate Desktop (for receiver/display unit)▶ PRRT (Git: http://prrt.larn.systems)▶ RNA-Master VM (DNS, DHCP, Orchestration, PTP, IP gateway, ...)

6 / 17

Page 11: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

RNA | Integrations: Gstreamer

Sender

gst-launch-1.0 filesrc location=~/Video.mp4 \! typefind \! queue \! prrtsink host=10.8.0.102 port=5000

Receiver

gst-launch-1.0 prrtsource port=5000 \! queue ! decodebin \! queue ! videoconvert \! queue ! ximagesink

7 / 17

Page 12: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

RNA | Integrations: Python

Sender (Controller)

import timeimport prrtimport controller

s = prrt.PrrtSocket(port=6000,isSender=True)

s.target_delay = 50 * 1000 # uss.connect("10.8.0.102", 5000)

while True:x = time.time()y = controller.control(x)s.send((x,y))

Receiver (Plant)

import prrtimport plant

s = prrt.PrrtSocket(port=5000,isSender=False)

while True:x,y = s.recv()plant.act(x,y)

8 / 17

Page 13: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outline

Status

RNA

X-Lap

Conclusion

9 / 17

Page 14: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

X-Lap | Introduction

Idea: Identify root causes for latency and jitter in PRRT.

X-L

ap

Application

Transport protocol

Operating system

Channel

▶ Packet creation▶ Error correction▶ ...

▶ Inter-process communication (IPC)▶ Resource management▶ ...

▶ Transmission delay▶ Propagation delay▶ ...

10 / 17

Page 15: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

X-Lap | Introduction

Idea: Identify root causes for latency and jitter in PRRT.

X-L

ap

Application

Transport protocol

Operating system

Channel

▶ Packet creation▶ Error correction▶ ...

▶ Inter-process communication (IPC)▶ Resource management▶ ...

▶ Transmission delay▶ Propagation delay▶ ...

10 / 17

Page 16: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

X-Lap | Architecture

jk

Run-time evaluationjk

▶ Timestamping functions▶ ⇒ Timestamps▶ C codejk

Off-line analysisjk

▶ Data analysis▶ ⇒ Latency and jitter▶ Python code

*.csv

▶ Trace every packet▶ Minimize run-time

interference▶ Embedded into protocol

source code

▶ Collect traces▶ Combine trace data▶ Single-packet traces▶ Jitter amongst packets▶ Outlier analysis▶ Correlation analysis

11 / 17

Page 17: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

X-Lap | Architecture

jk

Run-time evaluationjk

▶ Timestamping functions▶ ⇒ Timestamps▶ C codejk

Off-line analysisjk

▶ Data analysis▶ ⇒ Latency and jitter▶ Python code

*.csv

▶ Trace every packet▶ Minimize run-time

interference▶ Embedded into protocol

source code

▶ Collect traces▶ Combine trace data▶ Single-packet traces▶ Jitter amongst packets▶ Outlier analysis▶ Correlation analysis

11 / 17

Page 18: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

X-Lap | Architecture

jk

Run-time evaluationjk

▶ Timestamping functions▶ ⇒ Timestamps▶ C codejk

Off-line analysisjk

▶ Data analysis▶ ⇒ Latency and jitter▶ Python code

*.csv

▶ Trace every packet▶ Minimize run-time

interference▶ Embedded into protocol

source code

▶ Collect traces▶ Combine trace data

▶ Single-packet traces▶ Jitter amongst packets▶ Outlier analysis▶ Correlation analysis

11 / 17

Page 19: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

X-Lap | Architecture

jk

Run-time evaluationjk

▶ Timestamping functions▶ ⇒ Timestamps▶ C codejk

Off-line analysisjk

▶ Data analysis▶ ⇒ Latency and jitter▶ Python code

*.csv

▶ Trace every packet▶ Minimize run-time

interference▶ Embedded into protocol

source code

▶ Collect traces▶ Combine trace data

▶ Single-packet traces▶ Jitter amongst packets▶ Outlier analysis▶ Correlation analysis

11 / 17

Page 20: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

X-Lap | Packet Trace

0 20 40 60 80

Time [us]

EndToEnd

SenderTotal

Send

Submit

SenderIPC

Enqueue

SenderEnqueued

PrrtTransmit

LinkTransmit

ReceiverTotal

HandlePacket

ReceiverIPC

Feedback

12 / 17

Page 21: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

X-Lap | Trace Jitter

0 20 40 60 80 100

Time [us]

EndToEnd

SenderTotal

Send

Submit

SenderIPC

Enqueue

SenderEnqueued

PrrtTransmit

LinkTransmit

ReceiverTotal

HandlePacket

ReceiverIPC

Feedback

13 / 17

Page 22: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outline

Status

RNA

X-Lap

Conclusion

14 / 17

Page 23: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outcome

Publications▶ Reif, Stefan; Hönig, Timo; Schröder-Preikschat, Wolfgang: “In the Heat of

Conflict: On the Synchronisation of Critical Sections”, IEEE InternationalSymposium on Real-Time Distributed Computing (ISORC), Toronto, Canada,May 2017

▶ Reif, Stefan; Schmidt, Andreas; Hönig, Timo; Herfet, Thorsten;Schröder-Preikschat, Wolfgang: “X-Lap: A Systems Approach for Cross-LayerProfiling and Latency Analysis for Cyber-Physical Networks”, 15thInternational Workshop on Real-Time Networks (ECRTS RTN), Dubrovnic,Croatia, June 2017

▶ Schmidt, Andreas; Herfet, Thorsten: “Transparent Transmission Segmentationin Software-Defined Networks”, IEEE Conference on Network Softwarization(NetSoft), Bologna, Italy, July 2017

▶ Schmidt, Andreas; Herfet, Thorsten: “NEAT: Network ExperimentAutomation Tool”, 1. KuVS Fachgespräch ”NetworkSoftwarization”(KuVS-FG-NetSoft), Tübingen, Germany, October 2017

15 / 17

Page 24: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outcome

Publications▶ Reif, Stefan; Hönig, Timo; Schröder-Preikschat, Wolfgang: “In the Heat of

Conflict: On the Synchronisation of Critical Sections”, IEEE InternationalSymposium on Real-Time Distributed Computing (ISORC), Toronto, Canada,May 2017

▶ Reif, Stefan; Schmidt, Andreas; Hönig, Timo; Herfet, Thorsten;Schröder-Preikschat, Wolfgang: “X-Lap: A Systems Approach for Cross-LayerProfiling and Latency Analysis for Cyber-Physical Networks”, 15thInternational Workshop on Real-Time Networks (ECRTS RTN), Dubrovnic,Croatia, June 2017

▶ Schmidt, Andreas; Herfet, Thorsten: “Transparent Transmission Segmentationin Software-Defined Networks”, IEEE Conference on Network Softwarization(NetSoft), Bologna, Italy, July 2017

▶ Schmidt, Andreas; Herfet, Thorsten: “NEAT: Network ExperimentAutomation Tool”, 1. KuVS Fachgespräch ”NetworkSoftwarization”(KuVS-FG-NetSoft), Tübingen, Germany, October 2017

15 / 17

Page 25: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outcome

Publications▶ Reif, Stefan; Hönig, Timo; Schröder-Preikschat, Wolfgang: “In the Heat of

Conflict: On the Synchronisation of Critical Sections”, IEEE InternationalSymposium on Real-Time Distributed Computing (ISORC), Toronto, Canada,May 2017

▶ Reif, Stefan; Schmidt, Andreas; Hönig, Timo; Herfet, Thorsten;Schröder-Preikschat, Wolfgang: “X-Lap: A Systems Approach for Cross-LayerProfiling and Latency Analysis for Cyber-Physical Networks”, 15thInternational Workshop on Real-Time Networks (ECRTS RTN), Dubrovnic,Croatia, June 2017

▶ Schmidt, Andreas; Herfet, Thorsten: “Transparent Transmission Segmentationin Software-Defined Networks”, IEEE Conference on Network Softwarization(NetSoft), Bologna, Italy, July 2017

▶ Schmidt, Andreas; Herfet, Thorsten: “NEAT: Network ExperimentAutomation Tool”, 1. KuVS Fachgespräch ”NetworkSoftwarization”(KuVS-FG-NetSoft), Tübingen, Germany, October 2017

15 / 17

Page 26: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Outcome

Publications▶ Reif, Stefan; Hönig, Timo; Schröder-Preikschat, Wolfgang: “In the Heat of

Conflict: On the Synchronisation of Critical Sections”, IEEE InternationalSymposium on Real-Time Distributed Computing (ISORC), Toronto, Canada,May 2017

▶ Reif, Stefan; Schmidt, Andreas; Hönig, Timo; Herfet, Thorsten;Schröder-Preikschat, Wolfgang: “X-Lap: A Systems Approach for Cross-LayerProfiling and Latency Analysis for Cyber-Physical Networks”, 15thInternational Workshop on Real-Time Networks (ECRTS RTN), Dubrovnic,Croatia, June 2017

▶ Schmidt, Andreas; Herfet, Thorsten: “Transparent Transmission Segmentationin Software-Defined Networks”, IEEE Conference on Network Softwarization(NetSoft), Bologna, Italy, July 2017

▶ Schmidt, Andreas; Herfet, Thorsten: “NEAT: Network ExperimentAutomation Tool”, 1. KuVS Fachgespräch ”NetworkSoftwarization”(KuVS-FG-NetSoft), Tübingen, Germany, October 2017

15 / 17

Page 27: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Work in Progress

RNA▶ Advanced control applications▶ Wireless communications

X-Lap

▶ Hardware timestamping

PRRT▶ Congestion control and delivery rate estimation▶ Optimized error control for embedded platforms▶ Python API: Specify more application parameters

We need control applications that benefitfrom predictable delay and predictably high reliability!

16 / 17

Page 28: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Work in Progress

RNA▶ Advanced control applications▶ Wireless communications

X-Lap

▶ Hardware timestamping

PRRT▶ Congestion control and delivery rate estimation▶ Optimized error control for embedded platforms▶ Python API: Specify more application parameters

We need control applications that benefitfrom predictable delay and predictably high reliability!

16 / 17

Page 29: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Work in Progress

RNA▶ Advanced control applications▶ Wireless communications

X-Lap

▶ Hardware timestamping

PRRT▶ Congestion control and delivery rate estimation▶ Optimized error control for embedded platforms▶ Python API: Specify more application parameters

We need control applications that benefitfrom predictable delay and predictably high reliability!

16 / 17

Page 30: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Work in Progress

RNA▶ Advanced control applications▶ Wireless communications

X-Lap

▶ Hardware timestamping

PRRT▶ Congestion control and delivery rate estimation▶ Optimized error control for embedded platforms▶ Python API: Specify more application parameters

We need control applications that benefitfrom predictable delay and predictably high reliability!

16 / 17

Page 31: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Conclusion

jkNetworkjk

3 PRRT – Predictable protocol

Operating System

3 X-Lap– Timing measurement

RNA

+

▶ Integration▶ Optimisation

Thank you for your attention. Questions?

17 / 17

Page 32: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Conclusion

jkNetworkjk

3 PRRT – Predictable protocol

Operating System

3 X-Lap– Timing measurement

RNA

+ ▶ Integration▶ Optimisation

Thank you for your attention. Questions?

17 / 17

Page 33: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Conclusion

jkNetworkjk

3 PRRT – Predictable protocol

Operating System

3 X-Lap– Timing measurement

RNA

+ ▶ Integration▶ Optimisation

Thank you for your attention. Questions?

17 / 17

Page 34: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

Backup

17 / 17

Page 35: Latency- and Resilience-Aware Networking · 2019. 5. 6. · Profiling and Latency Analysis for Cyber-Physical Networks”, 15th International Workshop on Real-Time Networks (ECRTS

RNA: Prices

Server (~134EUR)

▶ Odroid XU4 (with fan) + Power Plug: ~72EUR▶ Case (Black/Clear/Blue): ~6EUR▶ eMMC Module (32GB): ~46EUR

Desktop (~238EUR)

▶ RNA Server (without case): ~128EUR▶ VU7 Plus Display: ~77EUR▶ VU7 Case: ~33EUR

17 / 17