WELCOME!

The NDIX-networkTechnical developments

#NDIX

NDIX Relatiedag, 12 juni 2013, Grolsch Veste Enschede

#NDIX

#NDIXrelatiedag

In this presentation

• The NDIX network

• Latest developments and facts

• New Marketplace locations and international carriers

• Increasing the availability of our network• Increasing the availability of our network

• NDIX and WDM techniques

• NDIX and WIFI

• Customer-premises equipment

• Professionalization internal NDIX processes and

support

• Continuity Improvements

The NDIX network

• Brocade NetIron MLX series routers in the core and semi-core

The NDIX network cont.

• Brocade NetIron CER and CES routers are used to expand our MPLS network

– On some Marketplace locations we replaced the Edge switches

– On some Marketplace locations we added the MPLS router to handle the

backbone connectionsbackbone connections

• Brocade FastIron SX, SuperX, Fesx and ICX as Edge switches– SX and ICX are the current used switches

– SX is a 8 slot chassis based edge switch (up to 168 customer ports)

The NDIX network cont.

• MRV for active WDM and signal regeneration– Media conversion: Converting normal optical signal to WDM optical signal

– 3R signal regeneration: Retransmission, Reshaping and Retiming for long distance connections

• Opticonnect for passive WDM (Optical ADD/DROP Multiplexers)

Latest developments

Migrating to a new network topology

Star-network topology Ring-network topology Full Mesh-network topology

Latest develoments cont.

Western

ring

Almost 60 locations make the NDIX network.

Creation of multiple network rings

CORE

ring

Three

southern

rings

Middle

ringEastern

ring

Latest develoments cont.

Upscaling locations to Semi-CORE locations• growing number of NDIX Marketplaces

• growing number of backbone connections

• growing demand of bandwidth (multiple 10Gbps connections)

Brocade NetIron MLX serie routers just like our CORE routers• Chassis based router

• Multiple 10Gbps support (up to 24 10Gbps ports on a linecard)

• More reliable due to redundant switchfabric and management

Core and semi-core locations are used• Expand our network with new Marketplaces

• Add additional backbone connections

• Expand link capacity

New Marketplace locations

NEW

• Maastricht (Cofely datacentre)

• Dronten (Serverius datacentre)

• Amsterdam (Interxion AMS3 datacentre)

• Ahaus

Coming up

• Vreden (moving to new location)

• NovioTech campus Nijmegen

• ………………………………………………

International carriers

More and more international carriers

connected with NDIX

• euNetworks

• VTL WaveNet

• Cogent

• Negotiations with level3 are in progress

Connecting customers to the NDIX network

Certified to MEF standards

Facts

• Over 70% of our network locations are connected to our backbone with a minimum of 10Gbps.

• Round a bout 45% of our locations have 20Gbps or more available available

• The actual used bandwidth of our backbone connections is below the 25%

– This guarantees a NON-blocking network

• At the beginning of this year we upgraded our network to support a MTU of 9100 octets (jumbo frame support)

– Standard Ethernet supports only 1500 octets of data in a frame

– Possibility to transport more data at once this gives a higher throughput

• We are investigating the possibilities to support Q-in-Q tunnels (IEEE 802.1ad)

Increasing the availability of our network

A couple of principles• Effectively use the available networkrings in our

network

• Standard Layer 2 VLANs (Virtual networks) to create • Standard Layer 2 VLANs (Virtual networks) to create

customer connections

• Automated restore of customer connections in case

of a network problem (.. Fiber breakage)

– In the old Layer2 network VLANs had a predefined route through the network

– Reconfiguring/Restoring hundreds of VLAN connections manually takes to must time

Increasing the availability of our network cont.

NDIX has an open network and maintains a strict separation

of infrastructure and services. Therefor NDIX only operates

in the first two of seven layers of the OSI-model

Physical

Link

Network

Transport

Session

Presentation

Application

2

1

3

4

5

6

7

NDIXVLANs / Mac-adress

IP

TCP

Infrastructure

Services

Increasing the availability of our network cont.

• We needed a network protocol that automatically and

instantly reroutes customer connections over the

remaining and available network connections

• And we cannot use traditional routing protocols to

reroute customer connections because they operate

at layer 3 of the OSI-model

Increasing the availability of our network cont.

Application7

We found a protocol suited to transport VLANs through a

routed network and that is MPLS (Multi Protocol Label

Switching)

Physical

Link

Network

Transport

Session

Presentation

Application

2

1

3

4

5

6

7

NDIX VLANs / Mac-adress

IP

TCP

Infrastructure

Services

MPLS2,5

Increasing the availability of our network cont.

A MPLS network: how does it work?

• With MPLS a tunnel is created to transport customer connections (VLANs) through the MPLS network(VLANs) through the MPLS network

• Every MPLS router has an unique Router-ID that is used as destination for the tunnel

• Every MPLS router keeps track how to get to the destination in the most efficient way

• So how the tunnel runs through the MPLS network is decided by the MPLS network itself (no NOC interference)

How does MPLS work for NDIX

Customer

Router-ID10.10.10.35

Increasing the availability of our network cont.

MPLS NETWORK

Customer

Service

Provider

Router-ID10.10.10.4

Increasing the availability of our network cont.

Advantages of a MPLS network

• The network is less affected by fiber maintenance

and network defects

• Uptime guarantee of connections through our MPLS

network increases to five nines (99.999%)

– This does not include the local tail to the customer. If the customer wants to have higher availability we can make that possible

NDIX and WDM techniques

What is WDM?

• Wavelength-division multiplexing

• Multiplexing a number of optics signals to a • Multiplexing a number of optics signals to a

single optical fiber using different

wavelengths

WDM optics

↓ Multiplexer

Fiber pairone for A to B

And one for B to A

Multiplexer ↓

WDM optics

A-side B-side

NDIX and WDM techniques cont.

• There are two kinds of WDM

– CWDM (Coarse WDM)

– DWDM (Dense WDM)

• CWDM has limitation of 16 channels short

range and 8 channels long range

• DWDM has up to 160 channels short and

long range (160 only if fiber conditions are

perfect)

NDIX and WDM techniques cont.

WDM advantages

• Easy to upgrade bandwidth of a network connection

(Upgrade to 20Gbps link by adding an extra 10Gpbs)

• Less expensive fibers needed

• In combination with MPLS extreme flexibility building

temporarily connections for maintenance purposes

• Possibility to build dedicated customer connections

NDIX and WDM techniques cont.

• At the end of 2014 we are aiming to have

80% of the NDIX network connections

converted to WDMconverted to WDM

• All existing CWDM will in time be converted to

DWDM

NDIX and WIFI

NDIX is expanding its network wireless.

• First project in the center of Enschede (Still in

progress)

NDIX and WIFI cont.

NDIX is expanding its network wireless.

• Maintaining separation of infrastructure and services • Maintaining separation of infrastructure and services

by using wireless networks (SSID’s) as VLAN’s

• One SSID used for offering internet

• Open network… Multiple SSID’s available for other

services

• Professional 24*7 support

• The success of this project will determine if we

continue with WIFI

Customer-premises equipment

• More and more NDIX customers using NDIX CPE’s

– Moving demarcation point from the customerport at the NDIX POP to the customer location

– In case of connection problems. One contact (out NOC) for the total connection between customer and other customers/Service Providers

– 24*7 NOC support

– Rate limiting on VLAN level

– Ability to connect a primary and a secondary NDIX connection. Automatic failover in case of link-loss. (special type of CPE needed)

– Easier to use NDIX connection with multiple Service Providers

Customer-premises equipment cont.

Four types of CPE’s available

• Genexis DRG711– 4 10/100/1000 Copper ports

– Single fiber uplink to NDIX network

Customer-premises equipment cont.

• MRV OptiSwitch 606

– 100Mbps version and a 1Gbps version available

– 4 10/100/(1000) Copper ports

– Rack mountable– Rack mountable

– 1 SFP customer port (also usable as redundant NDIX uplink)

Customer-premises equipment cont.

• Approximately 95% of all failures on the NDIX network is a result of Fiber breakage

• We can offer redundant NDIX connection and automated failover in case of link failure using port reflection (LIN - Link integrity)integrity)

Service

Provider

Customer-premises equipment cont.

• Connections are increasingly becoming a

part of real estate

– Property developers and building owners can

become a NDIX Business-Complex-CPE (NDIX become a NDIX Business-Complex-CPE (NDIX

mini POP)

– Up to 10 customer ports (Fiber or Copper)

– Usable with normal CPE units for each customer

Professionalization internal NDIX processes and support

• Due to rapid growth and priority of a large number of

network technical improvements the improvement of

internal processes were slightly left behind

• We’re rapidly improving our internal processes and • We’re rapidly improving our internal processes and

service management

– Improved change management

– Tighter protocols regarding the delivery of customer connections

– More process-based approach for network management

– Uniform communication with the customer (working according to a fixed-mail templates)

• One of the improvements is a new Ticketing system

Continuity Improvements

• Increase uptime NDIX locations in case of a power

failure by purchasing mobile emergency power

generator

– For NDIX locations without a no break system – For NDIX locations without a no break system

• Together with TReNT we are investigating the

possibilities of an EMERGENCY POP

– Mobile container

– Multiple Telco Fiber patchracks

– More then 300 meter Fiber backbone cable

– Fully equipped NDIX POP

– Emergency power generator

– First network connection restore within 8 hours. Full functionality restore within 24 hours

We think availability, continuity and quality

Is there any functionality missing?Is there any functionality missing?