© 2019 Juniper Networks Confidential
LEVERAGING 400 GBE
JJ Jamison
JET Meeting
May 21, 2019
Improving Network Economics While Driving Performance
-.
© 2019 Juniper Networks Confidential
ETHERNET SPEEDS t•-11.6TbE
1T-+------+------+------+-----+---.111111oP,-,-, ... __ , 800GbE
400G-------------" 10 OG -+-------1-------1-------1
~ ~ 40G--a-------1------~ ...., ~ 10G-+-----+----~ cu cu a. 1G------u, ~ C ·- 100M -----...J
10M 1980 1990 2000 2010
Standard Completed
2020 2030
Ethernet Speed
-, ~-' Possible Future Speed
© 2019 Juniper Networks Confidential
DRIVERS FOR 400GBE
-.
© 2019 Juniper Networks Confidential
WHAT DRIVES JUNIPER’S SOLUTIONS FOR R&E NETWORKS?
The drivers for the solutions we position, and I evangelize, for R&E networks come from other markets.
Fast/Reliable/Low Cost Routers (Carriers)*
IPv6 (Carriers)
Multicast (Wall Street)
Express Path on Firewalls (Wall Street)
perfSONAR (read 3rd party apps) on routers and switches (Social Media)
Node Slicing in R&E Peering Points (Carriers)
400 GE for R&E Networks (Datacenters)
© 2019 Juniper Networks Confidential
TRENDS DRIVING 400 GE UPTAKE IN DATA CENTERS
• High Compute Intensive Applications to be run extremely fast on parallel clusters
• Proliferation of Devices resulting in exponential growth of internet data traffic
• Enterprise workloads (Compute and Collaboration)
• Consumer workloads (Video Streaming and Social Networking)
• Digital Transformation of businesses across the entire global spectrum
• Data Center Applications Requirements of HyperScalars:
• Facebook relies on improved User Experience in spite of ever-growing traffic
• Amazon relies on Cost control – Minimum Cost incurred per Gigabyte of internet traffic
•Google, Baidu, Alibaba and Tencent – All rely on Faster Response to queries
Rapid Adoption Forecast: A Dell’ Oro Research Report forecasts 400G to comprise 20% of data-center switching revenue by 2020*
© 2019 Juniper Networks Confidential
TRENDS THAT WILL BE DRIVING 400GE UPTAKE IN R&E
• Elephant Flows
• Massive instruments dumping ridiculous amounts of data where the preference is not to process locally*
• Massive instruments dumping ridiculous amounts of data that is to expensive to process locally
• Proliferation of Science DMZs and DTNs
• More Elephants and Bigger Elephants on the Horizon100 G 100 G 100 G 100 G 100 G
400 G
© 2019 Juniper Networks Confidential
ECONOMICS OF 400GBE*
-.
© 2019 Juniper Networks Confidential
WITH OPTICS ECONOMIES OF SCALE ARE NOT COMPELLING
• Traditionally, Costs of Optical Transceivers driven down solely by Volume Economies of Scale. Suppliers Depend on Demand for more optics to drive down costs.
• In contrast, 100 times larger silicon chip supply chain benefited from shared
• design methodologies
• automated wafer manufacturing
• shared packaging approaches
• common test infrastructure
to deliver unparalleled economies of scale for computing and networking equipment. (Moore’s Law)
• Juniper has been successful in lowering cost per bit of its own product portfolio, but dependent on vendors to lower cost of optical interconnects.
• So Juniper acquired Aurrion Inc. in 2016 to build in-house silicon photonics technology.
© 2019 Juniper Networks Confidential
SILICON PHOTONICS
• Silicon photonics leverages benefits of silicon chip ecosystem:
• Shared design methodologies
• Outsourced wafer manufacturing to achieve economies-of-scale.
• Juniper’s Differentiation:
• Integration of all photonic elements of an optical transceiver— lasers, detectors etc. — within a single silicon photonics die.
• Integrating Indium phosphide materials into a silicon process flow right on the silicon wafer gives us the ability to amplify or generate light on chip.
• The ability to incorporate all optical components within a single, common silicon die fundamentally changes and simplifies how an optical transceiver can be assembled and tested, dramatically reducing costs.
© 2019 Juniper Networks Confidential
“OPTO-ASIC”
Juniper Networks’ silicon photonics enabled “Opto-ASIC,” a fully integrated transceiver package (left), surface mounted to module board (center left), board assembly placed within module housing with fiber attached (center right), and final QSFP module assembly (right).
,. I,
© 2019 Juniper Networks Confidential
“OPTO-ASIC” FUTURES
• Juniper’s fully integrated “Opto-ASIC” transceiver
• densely packages electronic and photonic die in a single, low-cost package
• completely agnostic to being packaged in existing module form factors (QSFP, QSFP-DD, OSFP, COBO, etc.)
• Network processors (PFEs: Packet Forwarding Engines)
• Packet Processing capabilities keep increasing exponentially
• But, are limited by ability to push that much bandwidth in and out of them electrically –Shannon’s Law*
• Throughput Increase – Possible by integrating photonics & network processor on one Package
• Juniper’s Silicon Photonics technology offers immense potential:-
• Integration into the PFE, along with Penta Silicon and Triton Silicon, improves scaling performance at the line card and system level, to enable petabit-per-sec total system capacity
• Combining silicon photonics technology with network processors increases system level capacity and performance while decreasing power consumption
* Shannon's law: defines the theoretical maximum rate at which error-free digits can be transmitted over a bandwidth-limited channel in the presence of noise.
© 2019 Juniper Networks Confidential
400GBE IN R&E (SO FAR)
-.
© 2019 Juniper Networks Confidential
JUNIPER 400 GE @ SC18
Juniper
MX10008
Internet2
MX960
SCinet NOCInternet2 Dallas PoP400 S Akard
Juniper
PTX 10003
100 GE
400GE
400 GE
4 x 100 GE4 x 100 GE
6,100 feet
Juniper
QFX 10003
QSFP56-DDQSFP-100GBASE-LR4 QSFP-100GBASE-LR4
mgmtmgmt
QFX-SFP-1GE-LX
I perfS♦NAR
© 2019 Juniper Networks ConfidentialKBHCCD D326 IDF
SCinet
NOC 2450
CalTech 1413
Akard St. POP, Dallas
General Conference Support
StarLight 2851 SCinet DNOC 2644 SCinet DNOC 4026SCinet DNOC 2316SCinet DNOC 1034SCinet DNOC 420
Chicago, IL
10 Gigabit Ethernet
40 Gigabit Ethernet
100 Gigabit Ethernet
400G DCI
1 Gigabit Ethernet
Wi-Fi Access Point
Network Architecture
v18 - November 10, 2018
Lance Hutchinson
800G DCI
DWDM OTN
400 Gigabit Ethernet
noc-att-1
Botsink 5100
3617
-A:
Le
no
vo
845
-A:
ET
RI
92
7-A
: X
ilin
x
100
5-A
: P
urd
ue U
niv
ers
ity
10
15-A
: P
ION
IER
10
27
-A:
Vir
gin
ia T
ec
h
12
04
-A:
Mig
hig
an
Sta
te U
niv
.
12
17
-A:
Ge
org
ia I
ns
titu
te o
f Te
ch
no
log
y
12
26-A
: F
uji
tsu
Lim
ite
d
22
7-A
: C
lem
so
n U
niv
ers
ity
313-A
: E
mu
Te
ch
no
log
y
32
1-A
: D
-Wav
e S
ys
tem
s
32
7-A
: N
ICT
32
7-B
: N
ICT
34
5-A
: N
ati
on
al
Ins
t. o
f In
form
ati
cs
42
7-A
: To
ky
o I
ns
t. o
f Te
ch
.
527-A
: O
ne S
top
Sys
tem
s
53
9-A
: C
ore
Hiv
e C
om
pu
tin
g
605
-A:
Ne
tAp
p
63
1-A
: R
ed
Riv
er
Co
mp
ute
r C
o.
739
-A:
Ins
t o
f In
du
str
ial
Sci.
Un
iv. o
f To
ky
o
16
04-A
: G
oo
gle
1608
-A:
Pe
ng
uin
Co
mp
uti
ng
161
3-A
: P
an
asa
s
162
8-A
: F
rau
nh
ofe
r IT
WM
181
6-A
: L
ou
isia
na S
tate
Un
iv.
182
8-A
: U
niv
. o
f U
tah
2019
-A:
Ma
thW
ork
s
20
22
-A:
Ari
sta
20
28
-A:
Pit
tsb
urg
h S
up
erc
om
pu
tin
g C
tr.
212
5-A
: S
ilic
on
Mec
han
ics
220
6-A
: S
tan
ford
Un
ivers
ity
221
8-A
: P
GI
22
26
-B:
Un
iva
Co
rpo
rati
on
240
0-A
: In
dia
na U
niv
ers
ity
24
06
-A:
Ad
ap
tiv
e C
om
pu
tin
g
240
9-A
: A
IST
241
3-A
: C
ray
24
17-A
: N
VID
IA
24
25-A
: C
olf
ax
In
tern
ati
on
al
24
29-A
: H
PE
2609
-A:
NA
SA
28
03-A
: C
isco
Sys
tem
s
2806
-A:
Ora
cle
282
4-A
: A
MD
300
6-A
: S
up
erm
icro
30
13
-B:
SD
SC
30
25-A
: B
rig
ht
Co
mp
uti
ng
320
7-A
: M
ell
an
ox T
ec
hn
olo
gie
s
321
3-A
: D
DN
Sto
rag
e
32
23-A
: In
tel
240
0-B
: In
dia
na U
niv
ers
ity
240
0-C
: In
dia
na U
niv
ers
ity
240
0-D
: In
dia
na U
niv
ers
ity
240
0-E
: In
dia
na U
niv
ers
ity
32
23-B
: In
tel
18
33
-A:
Kin
g A
bd
ull
ah
Un
iv.
of
Sc
ien
ce
an
d T
ec
h.
18
38-A
: M
arv
ell
/Ca
viu
m
18
47-A
: G
EA
NT
20
41
-A:
SU
RF
223
8-A
: R
EN
CI
22
47-A
: In
tern
et2
243
3-A
: D
ep
art
me
nt
of
En
erg
y
243
9-A
: K
IST
I
27
44
-A:
Un
ive
rsit
y o
f To
kyo
28
33-A
: A
ltair
283
8-A
: E
xtr
em
e N
etw
ork
s
284
7-A
: C
ien
a
2855
-B:
Infi
ne
ra
285
8-A
: N
ati
on
al E
nerg
y T
ec
hn
olo
gy
Lab
.
30
43-A
: C
ors
a
30
47-A
: H
ua
wei
30
54
-A:
We
ka.i
o
32
33
-A:
NE
C
32
38
-A:
Re
d H
at
32
51
-A:
SU
SE
34
33
-A:
IBM
3447
-A:
AW
S
36
27
-A:
HL
RS
36
35-A
: N
CS
A
36
43
-A:
Na
t’l
Cen
ter
for
HP
C
365
1-A
: S
Cin
et
37
07-A
: Te
xas
Ad
v C
om
p C
tr
37
16
-A:
Un
v.
of
Te
xas
at
Dall
as
38
31
-A:
Six
Nin
es I
T
3907
-A:
Van
de
rbil
t U
niv
ers
ity
391
7-A
: Tex
as A
&M
Un
iv.
39
53
-A:
So
uth
ern
Me
tho
dis
t U
niv
.
40
47
-A:
Ly
da
Hil
l D
ep
art
me
nt
of
Bio
info
rma
tic
s,
UT
So
uth
we
st
Me
dic
al
Ctr
.
42
01
-A:
Glo
bu
s
4211-B
: U
niv
ers
ity
of
Ma
ryla
nd
4211
-C:
Un
ivers
ity o
f M
ary
lan
d
422
7-A
: Q
um
ulo
, In
c.
424
1-A
: H
PC
Syste
ms
, In
c.
43
27
-A:
Str
on
g B
ox
Da
ta S
olu
tio
ns
44
01-A
: R
utg
ers
Un
ivers
ity
44
17
-A:
Inte
rdy
sc
ipli
na
ry C
en
tre
fo
r M
ath
em
ati
ca
l
an
d C
om
pu
tati
on
al
Mo
de
lin
g,
Un
iv.
of
Wa
rsa
w
63
9-A
: P
ure
Sto
rag
e
160
0-A
: N
imb
ix,
Inc
.
202
5-A
: S
Cin
et
45
31-A
: A
ltair
45
35
-A:
Qu
mu
lo,
Inc
.
2851
-A:
Sta
rLig
ht
2851
-B:
Sta
rLig
ht
2851
-D:
Sta
rLig
ht
285
1-E
: S
tarL
igh
t
285
1-F
: S
tarL
igh
t
285
1-I
: S
tarL
igh
t
28
51-J
: S
tarL
igh
t
2851
-K:
Sta
rLig
ht
285
1-L
: S
tarL
igh
t
344
2-A
: M
icro
so
ft
3056
-A:
Tech
Da
ta C
orp
30
33
-A:
CS
RA
dnoc2644-dci
Waveserver AI
netbeez-1g-d4026
eth0
dnoc420-rtr
7280SR2140.221.237.253/32
54/1
25
26
27
28
29
30
31
32
53/1
100G Tester
XGS2-HSL
dnoc1034-rtr
SLX 9540140.221.237.252/32
54
25
26
27
28
29
53
dnoc2316-rtr
7280SR2140.221.237.251/32
54/1
14
53/1
dnoc2644-rtr
SLX 9540140.221.237.250/32
54
30
53
dnoc420-faucet
C9500-32C
1
2
dnoc4026-rtr
QFX5110140.221.237.249/32
0/0/51
0/0
/20
0/0/50
dnoc4026-dci-[1-2]
NCS 2006
1/4/1 1/5/1
dnoc1034-dci
BTI 71081/1/1 1/1/71/1/2
dnoc420-dci
ACX 6360
0/0/12 0/0/150/0/13 0/0/14
4645
ps-zotac-d4026
eth0
44
netbeez-1g-d2644
eth0
44
netbeez-1g-d2316
eth0
ps-10g-3
eth10g
4846 6
netbeez-1g-d1034
eth0
44
netbeez-1g-d420
eth0
44
dnoc2316-dci-[1-2]
NCS 2006
1/4/1 1/6/11/5/1
booth1413-dci-ws[1-3]
Waveserver
1-6
1-7
1-8
2-5
2-6
2-7
1-5
2-8
3-5
dnoc2316-faucet
Cisco C9500-48Y4C
52
12 1 13 2 3 4 14 5 6
dnoc2644-faucet
SBx908 GEN2
601
10
1
dnoc4026-faucet
Noviflow 2122
1
3 4 5 12 6 7
15
16
17
19
20
21
22
23
24
25
26
27
28
29
30 2 31
32 3 4 533
0/0
/21
0/0
/23
0/0
/26
0/0
/27
0/0
/28
0/0
/25
0/0
/0
0/0
/29
0/0
/30
0/0
/31
0/0
/1
0/0
/32
50
1
20
1
31
32
33
34
35
38
39
40
411 25
26
27
28
29 2
1/3 1/4 1/5
ps-zotac-d420
eth0
46
2/2/7 2/2/8 2/2/9 2/2/10 2/2/7 2/2/9
1
booth2851-dci-wsai
Waveserver AI
1/2
3-7
141
3-M
: C
alT
ec
h C
AC
R
dnoc1034-faucet
AT x950-28XSQ
1 2
ps-zotac-d1034
eth1
1/1/6
101
booth1413-dci-wsai
Waveserver AI
1/2
3-6
0/0
/33
1/8
36
37
31
39
-A:
Mic
roso
ft
eth1
47
eth1g
ps-10g-2
eth10g eth1g
47
eth1
eth0
46 47
prime
Prime Applianceem0
wlc2
model
nic1
nic2
wlc1
model
nic1
nic2
SWIDF-B1
EX3300140.221.246.9
0/1/3
SWIDF-B2
EX3400140.221.246.10
0/1/3
SWIDF-CEAST
EX3400140.221.246.2
0/2/3
SWIDF-CWEST
EX3400140.221.246.3
0/2/3
SWIDF-OLDMDF
EX3400140.221.246.13
0/2/3
SWIDF-D167
EX3400140.221.246.4
0/2/3
SWIDF-D175
EX3400140.221.246.5
0/2/3
SWIDF-ARENA
EX3300140.221.246.6
0/1/3
SWIDF-C2
EX3400140.221.246.14
0/2/3
SWIDF-C3
EX3400140.221.246.15
0/2/3
SWIDF-C4
EX3400140.221.246.16
0/2/3
SWIDF-C6
EX3400140.221.246.17
0/2/3
SWIDF-C7
EX3400140.221.246.18
0/2/3
SWIDF-C8
EX3400140.221.246.19
0/2/3
SWIDF-D1
EX3400140.221.246.20
0/2/3
SWIDF-D2
EX3400140.221.246.21
0/2/3
SWIDF-D3
EX3400140.221.246.22
0/2/3
SWIDF-D4
EX3400140.221.246.23
0/2/3
SWIDF-D5
EX3400140.221.246.24
0/2/3
SWIDF-D6
EX3400140.221.246.25
0/2/3
SWIDF-D7
EX3400140.221.246.26
0/2/3
SWIDF-D8
EX3400140.221.246.27
0/2/3
SWIDF-D9
EX3400140.221.246.28
0/2/3
SW-CLUST2
EX3300140.221.246.90
0/1/3
SW-CLUST3
EX3300140.221.246.91
0/1/3
SWIDF-E5
EX3400140.221.246.29
0/2/3
SWIDF-E6
EX3400140.221.246.30
0/2/3
SWIDF-E8
EX3400140.221.246.31
0/2/3
SWIDF-E9
EX3400140.221.246.32
0/2/3
SWIDF-F2
EX3400140.221.246.34
0/2/3
SWIDF-F3
EX3400140.221.246.35
0/2/3
SWIDF-F4
EX3400140.221.246.36
0/2/3
SWIDF-F5
EX3400140.221.246.37
0/2/3
SWIDF-F6
EX3400140.221.246.38
0/2/3
SWIDF-D221
EX3400140.221.246.39
0/2/3
SWIDF-MA306
EX3300140.221.246.41
0/1/3
SWIDF-CBALLF
EX3400140.221.246.11
0/2/3
SWIDF-CBALLB
EX3400140.221.246.12
0/2/3
SWIDF-NEWMDF
EX3400140.221.246.42
0/2/3
SWIDF-A107
EX3300140.221.246.7
0/1/3
SWIDF-GRIFFIN
EX3300140.221.246.8
0/1/3
SWIDF-WG120
EX3300140.221.246.40
0/1/3
SWNOC-1
EX3300140.221.246.128
0/1/3
SWNOC-2
EX2200140.221.246.129
0/0/22
SWNOC-3
EX2200140.221.246.130
0/0/22
SWNOC-4
EX2200140.221.246.131
0/0/22
SWNOC-5
EX2200140.221.246.132
0/1/3
SWNOC-6
EX2200140.221.246.133
0/0/23
SWNOC-7
EX2200140.221.246.134
0/0/23
SWNOC-8
EX2200140.221.246.135
0/0/23
SWNOC-9
EX2200140.221.246.136
0/0/23
SWNOC-10
EX2200140.221.241.137
0/0/23
SWNOC-11
EX2200140.221.241.138
0/0/23
SWNOC-12
EX2200140.221.241.139
0/0/23
0/1/0
0/0/45
0/0/46
0/0/47
0/0/45
0/0/44
0/0/43
0/0/42
0/0/41
0/0/40
0/0/46
SWIDF-F1
EX3400140.221.246.33
0/2/3
pbx-ixi-1
Vision E4049
50
pbx-corsa2
NSE 720017
1
pbx-corsa1
NSE 720016/32
1
tap
tap
tap
tap
tap
tap
tap
tap
tap
tap
conf-fw
SRX 4600
1/0/0
1/0/1
C0
6-L
EA
RN
C0
7-T
elia
tap
noc-res-[1-5]
R-Scope
0 1 2 3
noc-ixia-dist
Vision ONE
49
50
51
52
17 18 19 20
16/32
17
17-18
19-20
tap
noc-infoagg-[1-2]
R730xd
eth0
0
noc-secnre-sandia
Dell R730
em0
Security VMs
sec-exabgp
sec-scanner
sec-bhr
sec-webserver
45
0/1/0
0/1/1
pbx-taps
FlexTaps
4
utd-nre-dell
5148F-ON
C3
2
C3
4
100G Tester [1-2]
FTB 2-PRO
100G Tester [1-3]
T-BERD 5800-100G
noc-wan-ws-[1-4]
Waveserver
1_5 1_7 4_5 4_72_5 2_7 3_5 3_7
akard-wan-wsai
Waveserver AI
C2
7
C2
8
C2
9
C30
C3
1
C3
3 C17
C14
C08
C1
0
C1
2
C2
3
C25
C2
0
1/8 1/9 1/3 1/4 1/5 1/6 1/7
C2
6
C09
C11
C13
C1
5
C1
8
C19
C2
1
C2
4
C2
2
C3
7
1/10
C1
6
C3
6
C04
C02
C35
C0
5
C0
3
C0
1
C38
ciena-waveserver-chicago[1-4]
Waveserver
800
G
2/Common
2/Common
akard-wan-400g
QFX10003
1/0/7 1/0/81/0/5 1/0/6
noc-wan-400g-1
PTX10003
1/0/5 1/0/61/0/7 1/0/8
C40
noc-wan-infinera
XT/S-3624
C4
1
1.9
T
akard-wan-infinera
XT/S-3600
1-A-2-3 1-A-2-4 1-A-2-9 1-A-2-101-A-2-5 1-A-2-6 1-A-2-7 1-A-2-8 1-A-2-11 1-A-2-12 1-A-2-17 1-A-2-181-A-2-13 1-A-2-14 1-A-2-15 1-A-2-16 1-A-2-191-A-2-1 1-A-2-2
1-A-L1
1-A-2-3 1-A-2-4 1-A-2-9 1-A-2-101-A-2-5 1-A-2-6 1-A-2-7 1-A-2-8 1-A-2-11 1-A-2-12 1-A-2-17 1-A-2-181-A-2-13 1-A-2-14 1-A-2-15 1-A-2-16 1-A-2-191-A-2-1 1-A-2-2
1-A-L1
noc-ixia-100g
Vision E100
25
26
9 11 13 151-rx 3 5 7
noc-taps
FlexTaps5/T 6/T 7/T 8/T1/T 2/T 3/T 4/T
80
0G
noc-wan-wsai
Waveserver AI
1/3 1/4 1/91/5 1/6 1/7 1/8 1/10
2/Common
C39
2/Common
C2
7 S
tarlig
ht
C28
Sta
rlig
ht
C2
9 S
tarlig
ht
C3
0 S
tarlig
ht
C3
1 S
tarlig
ht
C3
2 S
tarlig
ht
C3
3 S
tarl
ight
C3
4 S
tarlig
ht
C3
7 I
2 S
ing
ap
ore
C3
8 P
acW
ave
C4
0 I2
IP
/TR
CP
S2
C41
I2 A
LS
2
C35
I2 I
P/T
R C
PS
C3
6 I
2 A
LS
C01
ES
ne
t Testb
ed
C0
2 E
Sn
et Te
stb
ed
C03
ES
ne
t IP
C0
4E
Sn
et IP
C3
9 E
Sn
et/S
tar/
IU
C0
5 L
EA
RN
C0
8 N
AS
A/N
RL
C0
9 N
AS
A/N
RL
C1
0 N
AS
A/N
RL
C11
NA
SA
/NR
L
C12
NA
SA
/NR
L
C1
3 N
AS
A/N
RL
C1
4 L
SS
T
C1
5 L
SS
T
C1
6 P
ac W
ave
C1
7 C
EN
IC
C1
8 P
ac W
ave
C19
CE
NIC
C20
Ca
ltech
C21
Ca
ltech
C22
Tra
nsP
AC
C23
Sta
rlig
ht
C24
Sta
rlig
ht
C25
Sta
rlig
ht
C2
6 S
tarlig
ht
noc-wan-400g-2
QFX5220
1/0/0 0/1/0 0/2/0
Spectrum provided by
3218
-A:
De
ll3
3
C43
C4
4
ns0140.221.249.254
eth10g
ns1140.221.249.250
eth10g
ns2140.221.249.246
eth10g
its0140.221.250.70
eth10g
its1140.221.250.71
eth10g
its2140.221.250.72
eth10g
its-nas140.221.250.73
eth10g
owamp140.221.250.111
monitor140.221.250.101
DevOps VMs
repo
scinet
syslog
LibreNMS
XYMon
perfSONAR
kiosk
meas-displays
ndt
scdl
rancid
1_5 1_74_5 4_72_5 2_73_5 3_7
USC Booth 1403
b1403-400g
400G Switch
1/2/1-2
ferst
eth0
netbeez-wifi-noc
eth0
netbeez-1g-noc
eth0
booth2851-dci-ncs1k
NCS 1002
conf-rtr
MX960140.221.239.255/32
2001:0468:1f07:ffff::0255/128
11/2/10/2/1
3/0/8
3/0/6
3/0/7
0/0/9
11/0/9
0/1/9
4/0/0 3/0/11 4/0/0 7/0/0
8/0/6
8/0/7
2/0/0
9/1/3
2/0/5
2/0/1
9/0/4
2/1/1
2/1/2
9/0/5
2/1/3
9/0/6
2/1/4
9/0/7
2/1/5
2/1/6
2/1/7
9/0/8
2/1/8
9/0/9
2/1/9
9/0/10
2/1/10
2/0/4
9/1/5
8/3/1
2/0/11
2/0/7
2/0/10
9/0/3
2/1/0
9/1/4
9/0/2
2/0/3
9/1/2
9/0/1
2/0/2
9/1/1
9/0/0
2/0/9
9/1/0
2/1/11
2/0/8
9/0/11
2/0/6
8/3/2 3/3/2
7/3/0
noc-dci-ncs1k
NCS 1002
0/0/4
0/0/10
0/0/1
0/0/0
0/0/14
line
noc-rtr-2
NCS5508140.221.239.252/32
2001:0468:1f07:ffff::0252/128
0/0/0/12
0/0/0/13
0/4/0/12
0/4/0/13
0/0/0/6
0/0/0/0 0/2/0/0 0/4/0/0 0/4/0/50/0/0/3 0/4/0/20/2/0/20/0/0/2 0/4/0/10/2/0/10/0/0/1 0/4/0/30/2/0/3 0/2/0/50/0/0/4 0/2/0/4 0/4/0/40/0/0/5
rack0-sw
EX3300
0/1/3
rack[2-9]-sw
EX3300
9/0/16 9/0/17 2/1/2
line
netbeez-wifi-d4026
eth0
47
netbeez-wifi-d2644
eth0
45
netbeez-wifi-d2316
eth0
4745
netbeez-wifi-d1034
eth0
45
netbeez-wifi-d420
eth0
noc-taps
calient-S320
S320
2.5.7 2.7.3
2.1.1 1.1.41.1.31.8.8 1.8.3 1.8.41.8.5 1.1.5
2.6.52.6.4 2.7.2
noc-rtr-1
MX10008140.221.239.253/32
2001:0468:1f07:ffff::0253/128
2/2/3
0/3/0
0/3/1
4/3/0
4/3/1
4/1/12/0/00/0/0 4/0/02/0/20/0/2 4/0/1 4/0/22/0/10/0/1 4/0/32/0/30/0/3 2/1/10/1/1 2/1/00/1/0
9/0/149/0/139/0/129/0/15
netbeez-wifi-conf
eth0
netbeez-1g-conf
eth0
0/4/0
2/4/0
4/4/0
6/4/0
tnoc-dtn-echo1
1U DTNp1p1 p4p1
tnoc-dtn-echo2
2U GPU DTNp1p1 p4p1
noc-dtn-dell[1-2]
R740xdp1p1 p4p1 p1p1 p4p1
0/1/1 0/2/0
9/1/3 0/1/2
2/1/0
11/2/0
129
0/2/3
4/2/0
0/0/0/10
0/2/0/10
0/2/0/12
0/2/0/13
2/3/0
2/3/1
0/4/0/8
noc-sw-slx9540-[1-2]
SLX 9540140.221.237.240
1_53
2_53 2_54
1_54
0/4/0/14
0/0/0/9
0/4/0/9
0/2/0/9
0/0/0/11
0/2/0/11
0/2/2
0/2/1
4/1/2
2/2/2
2/2/1
4/2/1
2/2/0 0/2/0
noc-sw-qfx5110-[1-3]
QFX5110140.221.237.244
1_0/0/50
2_0/0/50
3_0/0/50 3_0/0/51
1_0/0/51
2_0/0/51
1/6/1
b2851-400g
400G Switch
1
noc-sw-7280sr2-[1-2]
7280SR2140.221.237.246
1_53/1
2_53/1 2_54/1
1_54/1
4.3.4
4.3.3
noc-corsa
NSE 7200
37
33
8/0/5 3/0/5
11/1/8
eth0
11/1/9
eth0
4/2/3
noc-fw
SRX 56000/1/0
0/3/0
0/2/20/2/1
4137
9/T
17
2
noc-wan-spirent
N4U 12-port 100G Tester
2 3 4 5 6 7 8 9 10 11 121
5.5.1 5.5.2 5.5.3 5.5.4 5.5.5 5.5.6 5.5.7 5.5.8 5.6.1 5.6.45.6.35.6.2
1.1.2 1.8.71.1.6 1.1.7 1.1.8 1.2.1 1.2.2 1.3.21.2.4 1.2.6 1.2.7 1.2.8 1.3.1 1.1.11.8.61.7.3 1.8.21.7.81.7.61.7.4 1.8.11.7.71.7.5 1.3.5 1.7.11.2.3 1.2.5 1.3.6 1.7.21.3.3 1.3.4
noc-taps
2.5.1
2.5.8
2.5.3
2.6.3 2.6.6
2.5.2
2.6.82.6.7
2.5.4
2.5.6
2.6.22.6.1
2.5.5
4/1/0
3.3.1 3.3.7 3.4.5 3.5.23.3.4 3.4.73.4.13.3.3 3.4.63.3.83.3.2 3.4.83.4.2 3.4.43.3.5 3.4.3 3.5.13.3.6 3.5.4 3.5.3
b1413-400g
400G Switch
21
32
7-C
: N
ICT
371
6-D
: U
nv.
of
Te
xa
s a
t D
all
as
371
6-C
: U
nv.
of
Te
xa
s a
t D
all
as
2
6/1/2
1/6 1/7
6/2/1 4/2/2
0/1/2
0/2/0/70/4/0/290/4/0/6 0/2/0/29 0/2/0/64/1/36/1/3 6/2/0 0/0/0/7 0/4/0/7 0/4/0/27 0/4/0/28 0/0/0/226/3/3
noc-dci-bti
BTI 7208
1-2/2/2 1/1/6
1/1/1
1/1/2
1/1/7
0/0/0/24 0/2/0/24
0/4/0/24
0/0/0/8 0/2/0/8
noc-dci-ncs2k-[1-3]
NCS 2006
1/4/1
2/4/1
3/4/7
3/4/9
1/5/12/5/1
3/4/8
3/4/10
3/2/9
3/2/7 7/line2/line 2/2/12/6/1
noc-faucet
Noviflow 32x100G Tofino140.221.237.239/32
18
10
7
21
6 15 11
12
34
noc-dtn-z9264
Z9264F1/13 1/621/52
1/15 1/481/1
1/29
1/46
1/3
em0 em0 em0em0 1/34
1/36
6/2/2
6/2/3
6/3/1
6/3/0
6/3/2
line
0/0/7
0/0/11
0/0/3
0/0/15
0/4/0/26
0/2/0/26
0/0/0/26
0/0/0/23
line
0/0
/1
0/0
/3
0/0
/4
0/0
/7
0/0
/10
0/0
/11
0/0
/0
0/0
/14
0/0
/15
6/0/0 6/1/06/0/2 6/0/36/0/1 6/1/1 0/0/0/28 0/0/0/290/0/0/27 0/2/0/27 0/2/0/28
noc-dci-ws[1-3]
Waveserver129
2_5 2_81_81_5 3_5
2_6
2_7
1_7
1_6
3_7
3_6
2.7.1
noc-dci-wsai
Waveserver AI
1/5
1/3
3/2
3/1
2
1/7
1/4
1/6
4/3/0
1/1
1
1/1
2/1/3
noc-dci-6360
ACX 63600/1/6-7
0/0/13
0/0/14 1
0/0/12
2/1/2
1-tx
1/1/0
2.1.2
C4
2 L
EA
RN
100
G p
S
0/2/0/23
1/8
0/0/15
0/1/6-7
40
01-A
: 2C
SR
I
383
5-A
: R
ub
rik
0/0
/34
0/0
/24
0/0
/35
18
0/0/0
1/0/0
0/0/0
0/0/0
®
poseidon-controller
Poseidon
14
1
11/0/7
11/0/8
utd-ncs2006
NCS 20064/15/1/1
48
21
utd-nre-dell2
R730en1 en2
3 4 5 6
utd-nre-dell1
R840en1 en2 en1 en2
1/0/0
2.1.1 1.8.6
4/5/2
4/5/3
4/4/3
42
377
5-A
: L
uc
d0/0
/22
SW-CLUST1
EX3400140.221.246.43
0/1/1
0/2/1
0/2/0
perfsonar-100g
100g Tester p6p2
p6p1
0/4/0/30
0/4/2
0/1/8
sage2-noc
eth0
0/1/3
noc-400g
400G Switch
2 3
4
1
5 6
141
3-A
: C
alT
ec
h C
AC
R
141
3-B
: C
alT
ec
h C
AC
R
141
3-C
: C
alT
ec
h C
AC
R
141
3-D
: C
alT
ec
h C
AC
R
141
3-E
: C
alT
ec
h C
AC
R
141
3-F
: C
alT
ec
h C
AC
R
141
3-G
: C
alT
ec
h C
AC
R
141
3-H
: C
alT
ec
h C
AC
R
14
13
-I:
Ca
lTec
h C
AC
R
141
3-K
: C
alT
ec
h C
AC
R
2851
-C:
Sta
rLig
ht
2851
-G:
Sta
rLig
ht
2851
-H:
Sta
rLig
ht
perfsonar-conf
eth1
eth0 0/1/7
3
385
4-A
: A
lgo
-Lo
gic
0/0
/2
0/0
/8
0/0
/9
9;inet 1~!C18 DaUas,1 hpc
TX inspires.
© 2019 Juniper Networks Confidential
400 GE UPTAKE IN R&E NETWORKS IN 2019
Juniper Account Teams and PLM have had conversations about 400 GE 2019 deployments with:
• A major Supercomputer Center
• Research universities planning on upgrading their WAN access
• Research universities planning 400 GE Science DMZs
We also have had early 400 GE planning conversations with several R&E Network providers
400 GE is coming to R&E Networks this year!
© 2019 Juniper Networks Confidential
PLANS FOR 2 X 400 GE @ SC19*
Juniper
MX10008
IndianaUniversity
MX960
SCinet NOC DenverIndiana University
CienaWaveserver
100 GE
400GE
800GDWDM
400 GE
1 x 400G Bloomington to Chicago over an OLS
4 x 100 G DWDM Chicago to Denver
1,066 mi
QSFP56-DD
CienaWaveserver400 GE
QSFP56-DD
V V I I
perfS. NAR perfS♦NAR
© 2019 Juniper Networks Confidential
THANK YOU /QUESTIONS?
"Any opinions, findings, conclusions or recommendations
expressed in this material are those of the author(s) and do not
necessarily reflect the views of the Networking and Information
Technology Research and Development Program."
The Networking and Information Technology Research and Development
(NITRD) Program
Mailing Address: NCO/NITRD, 2415 Eisenhower Avenue, Alexandria, VA 22314
Physical Address: 490 L'Enfant Plaza SW, Suite 8001, Washington, DC 20024, USA Tel: 202-459-9674,
Fax: 202-459-9673, Email: [email protected], Website: https://www.nitrd.gov