© 2018 National Institute of Informatics

New International Connectivities of SINET5

― SINET 100G Global Ring ―

Mar 28th, 2018 at APAN45

Motonori NakamuraNational Institute of Informatics (NII), Japan

© 2018 National Institute of Informatics

Information Circulation

Nationwide 100-Gbps backbone networkDirect international lines to USA, Europe, and AsiaAdvanced network services for research and education

Cloud

Network (SINET5)

Enhancement of research and education environment by tailored cloud services

Promotion of open access of academic information

Promotion of Open Science

ID FederationCollaborative enhancement

of authentication between universities

Academic Infrastructure operated by NIIOur infrastructure has a nationwide 100-Gbps backbone network, supports cloud

services, addresses security issues, promotes academic information circulation, and encourages a range of upper-layer services with federated identity management.

1

Cyber-Security

Network flow analysis and raise of security level for SINET users

High-performance VPN servicesGakuNin-

Cloud

© 2018 National Institute of Informatics

SINET is a Japanese academic backbone network for about 900 universities and research institutions, and for about 3 million users.

The latest network, SINET5, started its full-scale operation in April 2016.

2

Science Information Network (SINET)

To Los Angeles

To Singapore

To London: Domestic line (100Gbps or more)

: International line (100Gbps)

: International line (10Gbps)

National Universities

MunicipalUniversities

PrivateUniversities

JuniorColleges

Colleges of Technology

Inter-Univ. Research Institutes

Labs and Others Total

Number of Organizations

86(100%)

80(89%)

384(64%)

76(23%)

56(98%)

16(100%)

188 886

(As of Feb. 2018)

Sapporo

Fukuoka

Osaka

Tokyo

: SINET node

To New York

© 2018 National Institute of Informatics

NII designed a new high-performance and highly-reliable network architecture and implemented the network in cooperation with vendors and telecom carriers.

3

Network Architecture of SINET5

: Wavelength Path (100Gbps)

: ROADM: Optical Fiber

: Logical Path (Primary)

: VLAN Path

: IP Router

: User Router/Switch

: Access Line

: Logical Path (Secondary)

OpticalTransmissionLayer

PacketTransmissionLayer

InternetL3VPNL2VPNL2ODSDN

IP/MPLS Layer(Fully-meshed)

User Organizations

Protection

100Gbps, 40Gbps, 10Gbps, and 1Gbps

Five Network Slices

Secondary path

Primary path

Logical topologyNetwork

Controller

© 2018 National Institute of Informatics

New Services over SINET5

4

We always co-design and co-create new services in collaboration with our users.

Service Menu Note

L3 Service

Internet （IPv4/IPv6 Dual）Full Route Provision IP Multicast (+QoS)Flow-based QoS controlL3VPN (+QoS)

L2 Service

L2VPN/VPLS (+QoS)Virtual Campus LAN AvailableL2 On-demand (Basic) AvailableL2 On-demand (REST) AvailableL2 On-demand (NSI) In Trial

L1 Service Wavelength-based Leased Line

Access Line RedundancyMulti-homingLink AggregationRedundant Trunk Group Available

Stable Network Operation DDoS Mitigation (BGP FlowSpec) AvailableNetwork Softwarization NFV Service In Trial

Performance EnhancementPerformance Measurement AvailableHigh-speed File Transfer Software Available (Limited Bandwidth)

© 2018 National Institute of Informatics

Move functions into the NFVto improve reliability/performance andto reduce costs

Recent Trials in SINET5

5

2) 8K Video Streaming/L2 Ondemand Service

On-demandRoute Pinning

Sapporo

144Gbps

Osaka Tokyo

On-demandController

UserEnd Points, Route, Bandwidth, etc.

JGN

1) DDoS Mitigation using BGP flow spec

: Firewall Filter

Victim Server

Detection&Operation

Filter route

SINET Controller

Filter route

Filter route

Filter route

RouteReflector

SINET5

100Gbps×２

SINET NFV Infrastructure

NFV OrchestratorL2OD

Cloud Controller

Monitoring

VNFPNF

UserPortal Site

SINETRouters

Fukuoka Osaka Tokyo Hokkaido

3a) SINET Network Function Virtualization

SINET

Internet

VPN

Ｌ２ＳＷ

WiFi-AP

e-Learning CPU Storage

Applications

vMailvPortal

vFW

ｖDNS vNTPｖR

NFV Plathome

Coud Services

VMvLB

Router/FW/LB, etc.

(e-Learning, etc.)

3b) An Example of NFV Applications

© 2018 National Institute of Informatics

Current International Lines

6

REUNA

RedCLARA

New York

ESnetCalREN

Los Angeles

CAnet4

Internet2

AARnet

Asi@Connect

Singapore

MANLAN

GÉANT

NORDUnet

Tokyo PacificWave

: 100-Gbps line: 10-Gbps line

From April 2016 to March 2019

Belle II(U.S.A)

LHC(Swiss)

eVLBI(Europe)

ITER(France)

ALMA(Chile)

eVLBI(U.S.A.)

Belle II(Japan)ITER

(Remote Site)

eVLBI(Japan)

SURFnet

London

SINET5 has direct international lines to Europe, USA, and Asia.• Europe: Two 10-Gbps lines to London for small latency via Russia• USA: 100-Gbps line to Los Angeles, 10-Gbps line to New York, and 10-Gbps backup line • Asia: 10-Gbps line to Singapore

© 2018 National Institute of Informatics

Fast Data Transfer (MMCFTP) Experiment in SC17

7

Massively Multi-Connection File Transfer Protocol

© 2018 National Institute of Informatics

The result of SC17 experiment

8

• At the last day of SC17 Exhibition (16 Nov), we tried 7 M2M transfers of 10 TB data. • MMCFTP allows you to specify the ratio of the number of TCP connections to be

allocated to each route for multi-home data transfers.• For these transfers, we set the ratio of 1:1:4 (via Seattle : via Los Angeles : via

Singapore) to compensate different distances

The results

The experiment’s bandwidth usage on the router at SC17 venue

© 2018 National Institute of Informatics

LHCONE peering configuration

9

TEIN (HK)

JGN (HK)

KREONET (KR)SINET (JP)

SINET (LD)GEANT

SINET (LA)

ESnet

CANARIE

SINET (NY) GEANT

backup

backupSINET LD-JP20G SINET NY-JP

10G

100GSINET LA-JP

JGN HK-JP100G

SINET (SG)

ASGC (TW)JGN HK-SG

100G

Internet2

Supported by JGN since Oct. 2017

TP/PW 100G

© 2018 National Institute of Informatics

REUNA

RedCLARA

New York

ESnetCalREN

Los Angeles

CAnet4

Internet2

Singapore

MANLANGÉANT

NORDUnet

Tokyo

PacificWave

SURFnet

Amsterdam

Upgrade Plan in 2019

10

Asi@Connect

SINET will upgrade the Europe-Japan line to 100 Gbps (to Amsterdam)SINET will also have a 100-Gbps line from Tokyo to New York via Los Angeles

• Direct 10-Gbps Tokyo-New York line will be terminatedSINET will probably have a 100-Gbps line between Amsterdam and New York SINET will have a 100-Gbps Tokyo-Singapore line (upgrade from 10 Gbps) The Europe-Japan line will be operational in February 2019 and the other lines in March 2019.

: New 100-Gbps line

: Existing 100-Gbps line

© 2018 National Institute of Informatics

REUNA

RedCLARA

New York

ESnetCalREN

Los Angeles

CAnet4

Internet2

Singapore

MANLANGÉANT

NORDUnet

Tokyo

PacificWave

SURFnet

Amsterdam

Upgrade Plan in 2019

12

Asi@Connect

SINET will upgrade the Europe-Japan line to 100 Gbps (to Amsterdam)SINET will also have a 100-Gbps line from Tokyo to New York via Los Angeles

• Direct 10-Gbps Tokyo-New York line will be terminatedSINET will probably have a 100-Gbps line between Amsterdam and New York SINET will have a 100-Gbps Tokyo-Singapore line (upgrade from 10 Gbps) The Europe-Japan line will be operational in February 2019 and the other lines in March 2019.

: New 100-Gbps line

: Existing 100-Gbps line

SINET 100G Global Ring

© 2018 National Institute of Informatics

REUNA

RedCLARA

New York

ESnetCalREN

Los Angeles

CAnet4

Internet2

Singapore

MANLANGÉANT

NORDUnet

Tokyo

PacificWave

SURFnet

Amsterdam

Upgrade Plan in 2019

13

Asi@Connect

SINET will upgrade the Europe-Japan line to 100 Gbps (to Amsterdam)SINET will also have a 100-Gbps line from Tokyo to New York via Los Angeles

• Direct 10-Gbps Tokyo-New York line will be terminatedSINET will probably have a 100-Gbps line between Amsterdam and New York SINET will have a 100-Gbps Tokyo-Singapore line (upgrade from 10 Gbps) The Europe-Japan line will be operational in February 2019 and the other lines in March 2019.

: New 100-Gbps line

: Existing 100-Gbps line

SINET 100G Global Lasso?

© 2018 National Institute of Informatics

REUNA

RedCLARA

New York

ESnetCalREN

Los Angeles

CAnet4

Internet2

Singapore

MANLANGÉANT

NORDUnet

Tokyo

PacificWave

SURFnet

Amsterdam

Upgrade Plan in 2019

14

Asi@Connect

SINET will upgrade the Europe-Japan line to 100 Gbps (to Amsterdam)SINET will also have a 100-Gbps line from Tokyo to New York via Los Angeles

• Direct 10-Gbps Tokyo-New York line will be terminatedSINET will probably have a 100-Gbps line between Amsterdam and New York SINET will have a 100-Gbps Tokyo-Singapore line (upgrade from 10 Gbps) The Europe-Japan line will be operational in February 2019 and the other lines in March 2019.

: New 100-Gbps line

: Existing 100-Gbps line

© 2018 National Institute of Informatics

New Cloud-Oriented Platforms SINET5 is encouraging new platforms, such as a network softwarization platform

using NFV for campus LANs, an Image data analysis platform using AI for clinical and medical research, and a research data management platform for Open Science.

15

Medical Societies

AI image analysisdeep learning

AI/InformaticsResearchers

Medical Researchers

Medical image data

[Anonymized]

High-performance GPU Server

AI image analysisdeep learning

SocietyServer

AMED ProjectAI: Artificial Intelligence, AMED: Japan Agency for Medical Research and Development, NFV: Network Functions Virtualization

Medical image data

[Anonymized]

Medical image data

[Anonymized]

High-performanceStorage

HotStorage

HotStorage

HotStorage

ColdStorage

ColdStorage

ColdStorage

ArticlePrivate Shared Public

Exp Data

Researchers

Open ScienceNFV Project

vPortal vMail vLB

vFW

vDNS

vDPI

L2 Switch

Wi-Fi-AP

VPN

Inte

rnet

VPN

VPN

vRouter/Switch

Medical image data

[Anonymized]AI image analysis

deep learning

Internet

Campus LAN

VPN

Softwarization

© 2018 National Institute of Informatics 16

Thank you very much!