DUKE U

NIV

ERSITY•

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

Ivy+ Network / Telecom Update

Bob Johnson

Kevin Miller

April 29, 2008

DUKE U

NIV

ERSITY•

Metrics

• 6,247 undergraduate

• 6,744 graduate

• 2,730 faculty

• 30,700 staff (incl. med)

• 28K telephone lines

• 7 NXXs

• 15K voicemail boxes

• ~430 ACD agents

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

• 30,700 staff (incl. med)

• 8,600 acres

– 1,400 developed

• 48,000 wired ports (excl.

med)

• 7TB/day to & from

Internet

• ~430 ACD agents

• 5K CATV drops

• 800 – 800MHz

radios

DUKE U

NIV

ERSITY•

Campus Maps•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

DUKE U

NIV

ERSITY•

OIT Organization•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•Credit: http://atom.smasher.org/construction/

DUKE U

NIV

ERSITY•

Fitzpatrick East Data Center

12,500 f2 total

Phase 1

4,000 f2 raised flr

1,000 f2 mech.

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

May 16, 2007 May 16, 2007

1,000 f2 mech.

4KW/rack

167 racks

~80% med

~20% campus

Phase 2

7,500 f2

“more” KW/rack

fewer racks

DUKE U

NIV

ERSITY•

Data Center Network•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

DUKE U

NIV

ERSITY•

Outside Plant to Data Center•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

September 6, 2007September 6, 2007

DUKE U

NIV

ERSITY•

Data Center Cold Aisle•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

December 27, 2007December 27, 2007

DUKE U

NIV

ERSITY•

Data Center Network

• Pre-term fiber; dual paths to each rack

– Minimal infrastructure copper

• Rack level network switches (Cisco 3750E)

• Distinct broadcast domain from other data

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

• Distinct broadcast domain from other data

centers

– Migrating existing network and moving hosts in old

data center

• Shared broadcast domain for VMWare/VMotion

– Asking VMWare for ‘vRouter’ functionality

DUKE U

NIV

ERSITY•

Data Center Fiber•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

DUKE U

NIV

ERSITY•

Overhead Cable Trays•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

December 27, 2007December 27, 2007

DUKE U

NIV

ERSITY•

Current Voice Projects

• Unity Voicemail

– Migrating users

– Voicemail to email

• SS-7 to PRI

• Contact Center

– Planning Cisco UCCE

– UCCX systems

operational

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

• SS-7 to PRI

conversion

– Almost complete

• Session Border

Controller

– Planning deployment

operational

• IVR

– In testing now

DUKE U

NIV

ERSITY•

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

DUKE U

NIV

ERSITY•

Firewalls, IPS virtualized for

each virtual network

(independent config, mgmt)

Migrating away from

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

Virtual networks known

as “VRF”s

DUKE U

NIV

ERSITY• Traffic is processed

outbound by DEPT1

firewallTraffic is processed

inbound by PCI

firewall & IPS

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

Example: PC talking

to credit card

server

DUKE U

NIV

ERSITY•

Example: TIP client

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

Example: TIP client

talking to TIP

server

Traffic remains within TIP VRF,

even if client and server are in

separate physical locations

DUKE U

NIV

ERSITY•

Placement of SAS layer simplifies

implementation of security policy;

enables common application of

policy to equivalent devices/users

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

DUKE U

NIV

ERSITY•

802.11n

• Current 802.11a/b/g coverage – 60% of campus

(residence halls – hotspot only)

• 1:1 replacement of all 1,700 APs with

802.11a/b/g/n

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

802.11a/b/g/n

– Completion targeted for end-of-year 2008

• Adding ~800 APs in res halls (to 100% coverage)

– Completion by August 2008

• Powered with existing 802.3af (1x3 MIMO)

– Spot upgrades to pre-802.3at (2x3 MIMO)

DUKE U

NIV

ERSITY•

802.11n Pilot Experiences

• 40%+ connecting with

802.11n

– MacBook

– Dell, Lenovo, others

• 129Mbps+ peak 15

20

25

30

35

Sp

ee

d (

Mb

ps)

Wireless Throughput

11G Client, 11G AP

11G Client, 11N AP

11N Client, 11N AP (20MHz)

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

• 129Mbps+ peak

throughput (11n clients)

• 802.11g client: 2x faster on

11n AP compared to 11g

AP

– Especially pronounced at

greater distances

0

5

10

15

25 50 75

Sp

ee

d (

Mb

ps)

Distance from AP (ft)

DUKE U

NIV

ERSITY•

Current infrastructure

1700 APs

11 WiSM

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

+800 APs – Res. Halls60% Coverage

DUKE U

NIV

ERSITY•

802.11n Finances

• Evaluation of funding approach for wired and wireless networks

– Wireless installed with one-time funds

Wired network: ongoing refresh 10000

15000

20000

25000

30000

35000

40000

45000

50000

40

60

80

100

120

140

160

180

200

Wir

ed

Po

rts

Ex

pe

nse

s

Wired Network - Expenses v. Size

Wired network expenses

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

– Wired network: ongoing refresh budget

• 802.11n upgrade: advancing planned 4 year refresh cycle

• Observation: wired network size decreases, yet cost per port will increase (GbE, 10GbE)

0

5000

10000

0

20

40

2004 2005 2006 2007 2008 2009 2010 2011 2012 2013

Wired network expenses

Wired ports

0

500

1000

1500

2000

2500

3000

3500

0

20

40

60

80

100

120

140

160

180

200

2004 2005 2006 2007 2008 2009 2010 2011 2012 2013

Wir

ele

ss A

cce

ss P

oin

ts

Ex

pe

nse

s

Wireless Network - Expenses v. Size

Wireless network expenses

Wireless access points

DUKE U

NIV

ERSITY•

Other Data Projects

• Research Network Needs

– NLR FrameNet: 1Gbps path to Fermi Lab as

prototype for LHC connections

– Establishing 10Gbps to buildings for iSCSI,

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

– Establishing 10Gbps to buildings for iSCSI,

large scale data transfer

• Commodity Internet

– Significant growth w/ peering services (NTR,

CPS)

DUKE U

NIV

ERSITY•

CATV / IPTV Options

Content Middleware CAS Viewers

Time Warner

Cable

TWC IP Feed

(SD, HD)

Minerva VeriMatrix Minerva

(Win),

Motorola STB

Cisco TWC, Satellite Minerva Widevine Minerva

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

Cisco

(Scientific

Atlanta)

TWC, Satellite

IP Feed (SD,

HD)

Minerva Widevine Minerva

(Win), SA STB

InfoValue TWC, Satellite

IP Feed (SD,

HD)

IV IV IV (Win, Mac),

Amino STB

VideoFurnace Composite /

component

video (SD)

VF VF VF (Win, Mac,

STB)

DUKE U

NIV

ERSITY•

Emergency Communications

• Integration with text message aggregator

– Emergency and non-emergency, using LDAP groups

• Outdoor alert system – Federal, installed by 8/1

• Mass email system – complete

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

• Mass email system – complete

– Get us out of the critical path (web-based initiation)

– Bypass normal queues to guarantee rapid delivery

• Infrastructure upfit

– Cell/wifi network installations ramped up for campus

• Amcom e.Notify – “top 50” notification

DUKE U

NIV

ERSITY•

Home Access

• Time Warner Cable Business Class

• Discontinuing DSL reseller relationship

– Poor customer service

•DUKE U

NIV

ERSITY

• WWW .O I T . DUK E . E DU•

– Low utilization

– Not competitive with underlying carriers

• Modem pool – 23 modems – discontinuing