development of photonic layer and its services in … cef networks workshop sept. 11th, 2017 josef...

Sept. 11th, 2017 9th CEF Networks Workshop

Josef Vojtěch

Optical Networks Department, CESNET a.l.e.

Development of Photonic Layer and its Services in CESNET2 network

Dedication

Dr. Stanislav Šíma (*1944 - †2015) Author and promoter of many concepts important for networking:

• Customer Empowered Networks

• CEF networks workshop, since 2004

• Open DWDM and intensive usage of Alien Waves

• Single fibre bidirectional transmission, Nothing in Line

• Photonic services

• General environment for testing of new technologies and services (testbed, experimental facility)

Sept. 11th, 2017 2

9th CEF Networks Workshop

Outline • Development of CESNET2 photonic infrastructure

• Increase of fibre utilization • Accurate time and frequency infrastructure

• Self-protection of infrastructure

• Open Line System - Czech Light • SDN concept

• High speed testing

• Conclusion

Sept. 11th, 2017 3


Photonic Infrastructure

Sept. 11th, 2017 4


Photonic Infrastructure • Single fibre lines: 22 to 25 %

• Open Line System Czech Light: 59 to 65 %

Sept. 11th, 2017 5


65%

9%

26%CzechLight

noDWDM

Cisco

5890km

3840km1510km

540km

Photonic Infrastructure • New PoP CESNET2 in Prague

• Redundancy

• Security Increase

• Placed in DC Tower, České Radiokomunikace

• 2 pairs of fibre, 11 and 13 km (independent)

Sept. 11th, 2017 6


Photonic Infrastructure

• In critical points CL-VMUX for remote control and monitoring Brno – Ostrava, Brno – Česke Budejovice, Praha – Ustí n.L., Plzen – Ustí n.L.

• West circuit

WSS based CL-ROADM (1U chassis)

Sept. 11th, 2017 7


CBF Triangle AT-CZ-SK • ACOnet (AT), CESNET (CZ), SANET (SK),

• Open Line System Czech Light • Prepared for advanced photonic services, backuped capacity at least 8 x

200 Gbit/s

• Crossborder fibres 519 km a 134 dB

Sept. 11th, 2017 8


Photonic Infrastructure Special Requirements on Fibre Routes

• Search for locations with permanent disturbing source of vibration: bridges, metro, rail, aircraft on runway, etc.

• Location of a one time vibration source - detecting fiber disruption

• Searching for locations with seismic activity - early detection

• Utilization: • Measuring systems

• Monitoring of pipelines

• Telecommunication

• Navigation systems, etc.

Sept. 11th, 2017 9


25 Apr 2017 – 4.1 deg, epicentre loc. 20 km SW from Vienna

Utilization Increase

Sept. 11th, 2017 10


Time and Frequency Infrastructure • Development started in 2011

• Interconnection UFE (Institute of Photonics and Electronics) in Prague and BEV (Federal Office of Metrology and Surveying) in Vienna, 550 km, support of Open DWDM CL family

• 2013 - CESNET becomes the central point –

• 2014 • 300km line Prague-Brno, single medium bidirectional propagation • Parallel transmission of time and frequency

• 2016 • ELI (Extreme Light Infrastructure) • Upgraded to CLA BiDi (Czech Light Amplifier Bidirectional) - security

risks significantly limited (hacker attacks)

9th CEF Networks Workshop Sept. 11th, 2017 11

Time and Frequency Infrastructure


Time and Frequency Infrastructure • All fibres shared with data, reserved bandwidth 400/800 GHz

• Total length 2476 km, deployed 1664 km [1]


[1] J. VOJTĚCH et al; „Joint accurate time and stable frequency distribution infrastructure sharing fiber footprint with research network,“ Optical Engineering,56,2,027101.1-027101.7

• 2017 – CLONETS started


Time and Frequency Infrastructure • 2017

• Agreement with PSNC: CBF to be used for Prague–Poznan transmission

• New bidirectional channel between Brno and Ostrava 240 km

• Subsequent contractual research in the field of transmission of

extremely stable quantities

• Connection ISI in Brno with INR in Řež and Temelín Power NPP


Self Protecting Infrastructure

• CESNET internal statistics last year


Metro networks experience 13 cuts annually for every 1000 miles of fiber

[1]

The most common causes of fiber cuts –

digging aktivity (58%) [2]

CESNET experienced 50 outages between

8-12.2016 and 71 outages from 1 to

7.2017.

[1] W. D. Grover, “Mesh-Based Survivable Networks: Options and Strategies for Optical, MPLS, SONET and ATM Networking”, PrenticeHall PTR, Upper Saddle River, 2004. [2] Orange (France Telecom) in France (January 2010-March 2011).

• J. E. Simsarian and P. J. Winzer, "Shake before break: Per-span fiber sensing with in-line polarization monitoring," 2017 Optical Fiber Communications Conference and Exhibition (OFC), Los Angeles, CA, 2017, pp. 1-3.

Number of outages caused by fiber cuts

(>10%).



What is it …

• A new service that is rapidly evolving and very desirable.

• Active monitoring of all vibrations near a fibre cable.

Why is it important …

• Enabling proactive protection

• In combination with SDN and NetOS allows to reduce network outage times.

• Using existing routes, including those with active data traffic.

How it can be done…

• Heavy equipment digging near a fibre will shake a fibre cable before break it.

• Mostly based on evaluation of phase/polarization/ backscatter of the light.

Self Protecting Infrastructure • DOBI - Grant provided by ministry of interior

• Comparison of detection methods




Localisation with uncertainty tens of meters over distance of 70 km

Hammer strokes, distance 12 km

Self Protecting Infrastructure • Evaluation of interaction of 100 Gbps DP-QPSK (Coriant Groove) with high-power

sensing system (up to +27 dBm), 100 GHz channel spacing


[1] P. Munster, J. Radil, J. Vojtech, O. Havlis, T. Horvath, V. Smotlacha, E. Skaljo, "Simultaneous transmission of the high-power phase sensitive OTDR, 100Gbps dual polarisation QPSK, accurate time/frequency, and their mutual interferences", Fiber Optic Sensors and Applications XIV, 27 April 2017 [2] P. Munster, T. Horvath, O. Havlis, J. Vojtech, J. Radil, R. Velc, E. Skaljo, "Simultaneous transmission of standard data, precise time, stable frequency and sensing signals and their possible interaction", Optical Sensors 2017, 16 May 2017

Czech Light

Sept. 11th, 2017 21


What Czech Light is

Sept. 11th, 2017 22


Switching / Routing Cisco

Juniper Alcatel (Nokia)

Infinera …

Czech Light (Open DWDM line system)

Fibers

Czech Light in CESNET2 • Complete open line transmission system

• It uses commercially available transceivers

• Over 12 years of development

• Deployed more than 130 devices CL family on the backbone network

• Better use of fibre capacity (overlap of C + L + BiDi systems)

• More than 13 patents including CZ, EU, US


VMUX • The terminal device for effective “touchless” equalization and

monitoring of DWDM channels

• 100/50 GHz grid (40/80 optical channel)

• CLI, Web GUI for equalization and monitoring DWDM channels

• NETCONF API under development

• Deployment • Newly on Slovakia and Austria CBF (Cross Board fiber) Brno-Bratislava, Brno-Viden

• Brno–Ostrava, Brno–Ceske Budejovice, Praha–Usti, Plzen–Usti (via Cheb)


ROADM/WSS • Half-degree or multi-degree

• Flex-grid, Colorless, Directionless

• Integrated OCM and OSC

• CLI, Web GUI

• Multi-degree stackable pizza box under development • Effective arrangement of optical components, solution to 1U chassis

• NETCONF and YANG control


ROADM/WSS


Broadcast&Select Route&Select

0.5RU per degree 1RU per degree (line direction)

Broadcast

Drop

SelectWSS

Add

tootherdegrees

fromotherdegrees

Broadcat&Select

Drop

SelectWSS

Add

tootherdegrees

fromotherdegrees

Route&Select

RouteWSS

CLA BiDi


• Developed EDFA Bi-directional amplifier for special applications

• Transmission of ultra stable quantities (accurate and stable frequency)

• Currently in service over more than 1100 km of lines

• Stability 2 ps (TDEV)

• Allows transmission in one of fiber as well as a pair of fibers

CLA PM


• CLA PM (Polarization Maintaining)

• Transmission of ultra stable quantities (accurate and stable frequency)

• Cooperation with ISI

• Measurement shows better system stability

• Developed in new optical developmental laboratory in Brno

Support NETCONF/YANG


• It required remodelling of the internal structure SW

• NETCONF serves as the primary control API

• We are going to SDN, we want standard YANG schemes

• https://www.liberouter.org/technologies/netconf/

• Modernization of infrastructure and SW

• Netopeer2, libyang, libnetconf2, sysrepo

Telecom Infra Project: Open Optical Packet Transport


• CESNET has been advocating this for years

• Users should understand the DWDM layer

• Open, software-driven access to L0

• Sharing the infrastructure among services – data, time and frequency, sensing, …..

• Leveraging internal expertise to reduce vendor lock-in

Telecom Infra Project: Highlighting Working Groups


• Open Optical Packet Packet Transport

• Optical Line System • such as CzechLight

• any vendor can produce conforming hardware

• software control over standard APIs

• Physical Layer Simulation Environment • understand how separate DWDM signals are going to interact with

each other

• safety of Alien Waves

High speed systems testing • 100G started in 2011/2012, results presented at TERENA 2012 • https://tnc2012.terena.org/core/presentation/48

• Rather complex – ALU 1830PSS, Cisco 15454 MSTP, Czech Light ® Open DWDM system.

• Filtration tests – very important today in 2017 because of high speed channels over legacy 50/100 GHz muxes!

• All optical reach verifications.

• Other tests to verify sensitivity, nonlinear thresholds...

• Why all these experiments? Datasheets should be enough.

• Not really, some results not clear or available – like interaction of 10G and coherent signals.

• And this is very important for new photonic applications.

Sept. 11th, 2017 32


High speed systems testing

Sept. 11th, 2017 33


• Results of testing crucial for new photonic applications like accurate time transfer (ATT) and ultra stable frequency transfer (USFT), also sensing - Fibre as a Sensor (FaaS).

• So those tests and experiments started already in 2012 helped us successful participation in 2015 (DOBI) and CLONETS (2017).

• Such results are very important for CESNET, of course situation in every NREN is different.

• But such experiments/testing are really important for real networking scenarios, not just experiments for experiments.

High speed systems testing • Filtration tests – this figure from 2012 and 100Gb/s but also valid

for 150G and 200G speeds. The spectrum has the same bandwidth.

• Nothing from the past is lost:-)

• Linear effects like chromatic dispersion can be compensated by electronics linear math) but no nonlinearities!

Sept. 11th, 2017 34


High speed systems testing • 2015:

• 2x200G ALU http://www.lightwaveonline.com/articles/2015/06/cesnet-tests-400g-optical-transmission-with-alcatel-lucent.html

• 200G ECI over 2000km (for 20 years of CESNET celebration:-). http://www.lightwaveonline.com/articles/2015/12/czech-r-e-net-cesnet-trials-eci-400g-flex-grid-blade.html

• Not easy even this configuration was 1 lambda only.

• Fibre Bragg gratings were deployed, tested and tuned.

Sept. 11th, 2017 35


High speed systems testing • 2016: 400G (DP-64QAM) Nokia.

• 64QAM sensitive to noise and nonlinearities. Reach limited.

• 2016/17: 200G Coriant bidirectional 200G coherent over single fibre. http://www.lightwaveonline.com/articles/2017/08/cesnet-tests-coriant-groove-g30-for-czech-republic-research-and-education-network.html

• 2017: 200G open Voyager box planned for autumn/winter.

• 2017: 400G Ciena as part of GN4 testing. • Interesting 1RU box with true 400G modulation.

• Next step 600G. Perhaps in 2017-18.

• 1 terabit rather difficult (or just expensive)

• 1 terabit still distant...or not?

• Any real experience?

Sept. 11th, 2017 36


High speed systems testing

Sept. 11th, 2017 37


• Interesting and useful results – participation in new fresh projects.

• Support for new applications – no more ‚lost warranty‘ from some vendors.

• Data transmission is just normal standard. Not enough anymore.

• Fibre as a sensor is serious nowadays (CESNET results will be presented at NGON US, San Francisco, 2017).

• Europe is no longer at the forefront – prime example can be quantum technologies, e.g. cryptography.

Conclusion • For NRENs it is very important to gain and maintain access to all

layers of their network

• Fibre layer – it is generally accepted fact

• Transmission • Danger of (single) vendor lock in

• Open Line Systems

• New aplications • T/F

• Quantum optics

• Sensing projects

• …….

Sept. 11th, 2017 38


Acknowledgement Lada Altmannová, Michal Altmann, Ondřej Havliš, Michal Hažlinský, Tomáš Horváth, Jan Kundrát, Martin Míchal, Jan Nejman, Petr Münster, Jan Radil, Pavel Škoda, Martin Šlapák, Radek Velc, Rudolf Vohnout

Jan Gruntorád, Vladimír Smotlacha, Jakub Mer, Václav Novák, Karel Slavíček

Ondřej Číp, Šimon Řeřucha, Jan Hrabina, Martin Čížek, Miloslav Filka


Thank You for Kind Attention!

Questions?

[email protected]


Stable Optical Frequency and Precise Time Transfer over 406 km - Study

• Allow long-term measurement of the stability and shape deviation of the containment buildings

• 2 000 MWe of total installed capacity two PWR reactors, each protected by the containment building

• Precise measuring methods based on Fibre Bragg Gratings strain gauges

9th CEF Networks Workshop Sept. 11th, 2017



Terminal 1 Terminal 1 Terminal 2 Terminal 2 WSS 1 degree 3

ROADM 1 degree 2

ILA 1

Joint Bidirectional Amplified Time+Frequency Transfer


• Operational since 2014, 800 GHz in green

• 306 km ~ 85.1 dB one way

• Contains 26 dB span

Sept. 11th, 2017

Joint Amplified Time+Frequency Transfer


Credit: Cizek16

Sept. 11th, 2017

Comparison of Passive and Amplified Transmissions


Single path passive 78 km link

Single path bidirectional amplified 306 km link

• TDEV < 20 ps

Sept. 11th, 2017

development of photonic layer and its services in … cef networks workshop sept. 11th, 2017 josef...

Documents