![Page 2: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/2.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
2
Introduction to JANET
• The Education Internet in the UK• HE, FE, Schools (via LEA networks) Research
Institutes, and others• Over 1000 institutions• Complete Internet connectivity
• SuperJANET4 • 10 Gbit/s SDH backbone• Delivers service to 20 regional networks• Regional networks connect individual
institutions
![Page 3: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/3.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
3
The Requirement: Key issues
• Network reliability and resilience• RNs connected by single link remained a concern
• Demand for bandwidth• Power users• Pent up demand from FE• Enlarging the user base• The usual growth
• Protect the interests of diverse communities• Flexible provisioning• Enhance network monitoring services
![Page 4: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/4.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
4
SJ5 must deliver
• RELIABILITY
• SCALABILITY
• SEPARABILITY
• FLEXIBILITY
• VISIBILITY
END-TO-END
Achievable with a flexible transmission platform built on optical fibre
![Page 5: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/5.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
5
Infrastructure procurement
• Negotiated Procedure • We know what we want
• Flexible transmission system– Fibre and WDM equipment
• Dedicated to SuperJANET• We didn’t know how we wanted it provided
• Lease dark fibre & light it ourselves• Managed service from a Telco
• We didn’t know if the market would deliver
![Page 6: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/6.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
6
Infrastructure procurement
• Pre-qualification Q4 2004• Six suppliers short-listed• Negotiate form of ITT with all six Q1/2 of
2005
• Launch ITT June 2005• Only to short-listed suppliers
• Contract awarded to Verizon (MCI) end of 2005
![Page 7: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/7.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
7
Router procurement
• Met with MCI in mid 2003• Avici, Axiowave, Caspian, Chiaro, Hyperchip,
Procket• Informal talks with suppliers in Q3/4 2003
• RFI document issued in early 2004• Evaluate features of carrier class routers
• Hands-on testing of• Chiaro Enstara, Cisco CRS-1, Juniper T-640,
Procket PRO 8000
![Page 8: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/8.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
8
Router procurement
• Open procurement launched in Sept 2005 • Awarded to Lucent Technology January 2006• Juniper T-640 routers
• Carrier Class• >1000 in service world wide• 40 Gbit/s demonstrated by Juniper and Verizon
• Available as a product now
• Very good deal, Driving down the cost of ownership
![Page 9: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/9.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
9
Router marketplace
• To date• Axiowave, Chiaro & Hyperchip have ceased
trading• Procket bought up by Cisco
• A week before RFI test
• Caspian has moved out of the carrier space
![Page 10: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/10.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
10
Core Infrastructure
• Six C-PoPs• Like SJ4 without Cosham and Edinburgh
• Fibre network dedicated to SuperJANET5• Single pair of fibres
• Protection at the IP layer
• Dedicated WDM transmission equipment• Operated by Verizon initially
• UKERNA may manage circuit provision later in the project
![Page 11: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/11.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
11
Core Infrastructure
• Ciena Corestream DWDM equipment• 80 wavelenghts per fibre• 10Gbit/s now, 40 Gbit/s in 2008
• Pilot on SJ5 core in 2007
• Core circuits grouped into ten bands of eight• Bands add/dropped at C-PoPs or at OADM
sites
![Page 12: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/12.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
12
Core Network Design
• Core Terminal sites – Six blue locations
• Flexible OADM sites (Optical Add Drop) – Eight white locations
• Optical Amplification sites –Eleven locations, not shown
• Core Network consists of three basic components:
![Page 13: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/13.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
13
Core Traffic Provision
• 10Gbit/s circuits are provisioned using two transponders only
• No Regeneration needed • Each circuit would have to be
regenerated separately• Expensive
• Optical amplification still needed every 80 KM or so
• Telehouse & Telecity part of the core• Peerings to UK and Global
Internet
![Page 14: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/14.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
14
Connecting Regional Networks• Two IP production circuits delivered to each
RN• Delivery to diverse locations in the RN
• One 10 Gbit/s research circuit• Connected to UKLight SDH mux
• Two connection methods• Collector Arc
• Point-point fibre through RNEPs linking C-PoPs
• Single point-to-point fibre• Fibre from RNEP into the core
![Page 15: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/15.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
15
Point to point fibre
Glasgow C-PoP
Leeds C-PoP
University of Newcastle
NORMAN
University of Northumbria
VerizonEdinburgh
VerizonNewcastle
VerizonMiddlesbrough
![Page 16: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/16.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
16
Point to point fibre
Regional Network Carried over collector arc
Production 2.5 Gbit/s circuit presented on muxponder cards at NewcastleCircuit is aggregated onto a 10 Gbit/s wavelength using an aggregation card The 10 Gbit/s wavelength is added into to the core network at the Verizon node in Newcastle and transported to the Glasgow C-PoP over the Corestream equipment. It is dropped out of the Glasgow Corestram into another 4200 at the Glasgow C-PoP The 2.5 Gbit/s circuit is de-muxed by a muxponder card and presented to the core router
10 Gbit/s research circuit
Newcastle UniversityVerizon NewcastleVerizon Glasgow
Core network
![Page 17: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/17.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
17
Point to point fibre
Regional Network Carried over collector arcNewcastle UniversityVerizon NewcastleGlasgow C-PoP
Core network
Verizon Middlesbrough Northumbria UniversityLeeds C-PoP
Core network
![Page 18: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/18.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
18
Collector Arc
YHMAN Leeds
Network North West
YHMAN Leeds Met
VerizonPreston
NNWPreston
NNWManchester
LeedsC-PoP
YHMAN
Warrington C-PoP
![Page 19: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/19.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
19
Collector Arc
Warrington C-PoP Manchester Leeds Met Leeds Uni
Leeds C-PoP
Leeds Uni 10 Gbit/s Production and Research on 10 Gbit/s transponders to Leeds C-PoP
Leeds Met 10 Gbit/s Production on 10 Gbit/s transponders passing through Manchester to drop off at Warrington. Note pink amplifier cards at Leeds Uni and Manchester and there-use of the green wavelength towards Warrington from Leeds Met.
Manchester 10 Gbit/s Production and Research circuits on 10 Gbit/s transponders to drop off at Warrington.
![Page 20: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/20.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
20
NIRAN & HEAnet
Regional Network N Type A: Ciena CN4200 Author: Tom Sims
Version: 18.10.06
Ukerna Network N: Primary RNEP
NTL Kennedy Way
Verizon Glasgow
FAN
FAN400 W DC
POWER400 W DC POWER
Queens 1
NTL Shore Road
FAN
FAN400 W DC
POWER400 W DC POWER
9km/2.52dB
12km/3.36dB
M6-F
FAN
FAN400 W DC
POWER400 W DC POWER
Queens 2
M6-F
116km/29dB
FAN
FAN400 W DC
POWER400 W DC POWER
OAV-00
OAV-00
LHDC-120
LHDC-120
Newry
92km/23dB
CN2150 CN2150
OAF-00
OAF-00
LHDC-40
OAV-00
OAF-00
CN2150
F10-A (ch35)Network Tribs
F10-A (ch35)Network Tribs
F10-T (ch39)
F10-A (ch35)Network Tribs
F10-A (ch35)Network Tribs
3km / 1.5dB
CoreStream (Subsea Festoon)
SPAN 1
203Km(41dB)
FAN
FAN400 W DC
POWER400 W DC POWER
F10-A (Tune)Network Tribs
M6-F
1550nmHandoff of ch40
To CS
1 Router band (upto 8 Channels) extended to Queens 2 using the CoreStream Remote Shelf Application
Newry NTL Kennedy Way Queens 2Queens 1
NTL Shore road
Verizon Glasgow
Core StreamSubsea Span
203 KM(41 dB)
![Page 21: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/21.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
21
NIRAN & HEAnet
Regional Network N Type A: Ciena CN4200 Author: Tom Sims
Version: 18.10.06
Ukerna Warrington
Ukerna Network N: Primary RNEP
CoreStream (Subsea Festoon)
SPAN 4235Km(49dB)
Verizon Dublin
FAN
FAN400 W DC
POWER400 W DC POWER
FAN
FAN400 W DC
POWER400 W DC POWER
M6-F
HeaNet
89km/23.25dB
F10-A (ch35)Network Tribs
F10-T (ch39)
FAN
FAN400 W DC
POWER400 W DC POWER
M6-F
CN2150
F10-A (ch35)Network Tribs
FAN
FAN400 W DC
POWER400 W DC POWER
OAV-00
OAV-00
44km/12dB
Manchester
LHDC-40 LHDC-60Lytham
F10-T (ch39)
FAN
FAN400 W DC
POWER400 W DC POWER
CN2150
F10-T (ch35)Network Tribs
1550nm/1310nmHandoff of ch40, ch41
To Ukerna
F10-T (ch39)
CN2150
F10-A (ch35)Network Tribs
FAN
FAN400 W DC
POWER400 W DC POWER
CN2150
CN-BS5
Clonshaugh
11km/4.5dB
60km/15dB
OAF-00
OAV-00
LHDC-50
Clonshaugh
HEAnet
Verizon Dublin
Core StreamSubsea Span
235 KM(49 dB)
Lytham
Manchester
Warrington
![Page 22: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/22.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
22
HEAnet
• Replacement of existing connection to JANET• GE circuit presented at ESAT-X• HEAnet provisioned dark fibre between
ESAT-X and the HEAnet PoP at Erne Street
• Delivery due by 24th November• UKERNA/HEAnet acceptance testing
![Page 23: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/23.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
23
Potential research collaboration
• CERN Large Hadron Collider Project• HEP access to the UK Tier 1 centre
• Network research• Future service development • Automated path provisioning• Control plane experiments
![Page 24: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/24.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
24
Migration
• 1st Regional Networks migrated on 31st November
• Aggressive timetable• Tuesdays and Thursday mornings
• Due to complete before Christmas 2006
• SuperJANET4 to continue until March 2007• Contingency• Migrate research projects
![Page 25: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/25.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
25
Meeting the requirement: Reliability
• Reduce single points of failure• Diverse fibre routing in the core• Dual connection of Regional Networks• Carrier class optical and routing equipment
• SDH technology • In the core and out to the regional networks• Rapid failure detection and recovery• Detect latent problems
![Page 26: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/26.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
26
Meeting the requirement: Scalability
• Ability to expand capacity• Where it’s needed• When it’s needed
• 40 Gbit/s trial in early 2007• Predictable cost
• Marginal cost for transmission channels• Significant discount for router equipment
• Not clawed back in maintenance charges
![Page 27: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/27.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
27
Meeting the requirement: Separability
• Hard multiplexing of bandwidth channels• Production services firewalled from research
infrastructures
![Page 28: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/28.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
28
Meeting the requirement: Flexibility
• Deliver bandwidth quickly• In weeks rather than months
• With a variety of interfaces and bandwidths• 10 and 2.5 Gbit/s SDH• 10 and 1 GE (LAN-PHY and WAN-PHY)
• Temporary arrangements may become practical
![Page 29: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/29.jpg)
SuperJANET5 HEAnet National Networking Conference 2006
29
Meeting the requirement: Visibility
• Ability to monitor network in more detail• Operational monitoring• Research projects
• Optical taps • Monitor all router interfaces at Reading and
London• Issues of confidentiality have been addressed
![Page 30: SuperJANET5 Enabling Education and Research Roland Trice r.trice@ukerna.ac.uk](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649eb05503460f94bb6273/html5/thumbnails/30.jpg)
Questions?