11

An Overview of the TWAREN Performance Measurement Project

Che-nan YangChe-nan Yang

The National Center for High-performance ComputingThe National Center for High-performance Computing

Aug. 26, 2005Aug. 26, 2005

at APAN Taipei 2005at APAN Taipei 2005

22

TWAREN Network Infrastructure

33

TP

TC

TPHC

SINICA

NDHU

NCTU

NTHU NCHU NCNU

NSYSU

NCKU

CCU

NCU

NTU

TWAREN

Optical

Production

Research

10GESTM-64/OC-192STM-16/OC-48

C7609

C7609

C7609

C7609

C7609

C7609 C7609

C7609

C7609

C7609C7609

GSR

GSR

GSR

GSR

Production NetworkProduction Network

44

Research & Optical NetworkResearch & Optical Network

TWAREN

ONS15600 ONS15600

GSR

GSRGSR

ONS15454ONS15454

ONS15454

GSR

ONS15454

Taipei

Tainan

Taichung

ONS15600

C7609

ONS15454

NCHUC7609

ONS15454

NTHU

Hsinchu

Optical

Production

Research

10GESTM-64/OC-192STM-16/OC-48

GE

undeploy(#) # of Circuit

C7609

ONS15454

NTU

(2)

C7609

ONS15454

NCU

(2)

Sinica

C7609

ONS15454

(2)

C7609

ONS15454

NDHU

(2)

C7609

ONS15454

CCU

(2)

C7609

ONS15454

NCKU

(2)

C7609

ONS15454

NSYSU

(2)

C7609

ONS15454

NCNU

(2)

(2)

(4)

(2)

C7609

ONS15454

NCTU

(2)

(6) (6)

(6) (2)

(3)

(2)

(3)

55

TWAREN Network Design Goals

Hybrid technology: IP (routing) and optical (dark fiber, DWDM)

Dual networks: production (2430km) and research (1721km) networks

Hierarchical topology: 3 layers (core, PoPs, end nodes)

Providing multiple servicesHighly reliable, stable and flexible

66

TWAREN Active Measurement Tools

Active MeasurementRouter node

• RTT and Availability-Test among all router node pairs

• Daily, Weekly and Monthly report

Server node• RTT WeathetMap• TWAREN AMP(IPv4 and IPv6) - NLANR/MNA • Multicast Beacon• One-way delay(IPv4 and IPv6)• Throughput (IPv4 and IPv6, TCP and UDP) - Ipef

77

TWAREN Passive Measurement Tools

Passive MeasurementNetflowRouter looking glassRouter configurationUser routing policy

88

Router node RTT

99

Router node Availability

1010

Distance vs. RTT

Link Speed v.s. Latency

Link Speed 64 Bytes 1500 Bytes

64kbps 8ms 140.625ms

T1 0.331606ms 5.829016ms

T3 0.011445ms 0.20118ms

FE 0.00512ms 0.09ms

GE 0.000512ms 0.009ms

10GE 0.0000512ms 0.0009ms

Speed of Light C=3x108m/s

The speed of light in the mediumV=C/N V = C/1.5 = 2x108m/s

Distance RTT

50KM 0.5ms

100KM 1ms

200KM 2ms

300KM 3ms

400KM 4ms

1111

The Distance of Carrier Fibre

CORE CORE CHT w CHT p EBT w EBT p

TP HC 127.2 117.6 158.6 129.8

TP TN 599.9 440 403.1 370.6

HC TC 203.6 130.6

HC TN 516.1 354.6 256.7 261

TC TN 313.5 228

POP CORE CHT w CHT p EBT w EBT p

TP NTU 6.5 46 37.3 9

TP NDHU 266.3 301.6 248.4 240.5

TP NCU 93.7 127 77.2 78.5

TP AS 23.7 28.8 46.5 34.5

TC NCHU 10.6 11.4 33.5 50.7

TC NCNU 112.6 277.6

TN CCU 94.9 256.7 96.3 96.4

TN NCKU 27.9 319.3 21.1 29.8

TN NSYSU 110.4 238.6 80.1 95.8

HC NCTU 6.3 6.6 16.5 4

HC NTHU 9.6 9.6 20.2 6

1212

RTT WeatherMap-1

1313

RTT WeatherMap-2 Why TN to CCU(two-way) shows GREEN?

- Standard data compare with the Current data

- 1.396 ms vs. 2.314 ms

POP ←→ TN

TN CCU NCKU NSYSU

TN 2.325 0.416 1.463

CCU 2.314

NCKU 0.412

NSYSU 1.471

POP ←→ TN

TN CCU NCKU NSYSU

TN 1.403 0.44 1.5

CCU 1.396

NCKU 0.416

NSYSU 1.454

Current data Standard data

1414

AMP Local Mesh

Led by Tony McGregor, NLANR/MNA AMP performs site-to-site active measurements

RTT, topology, loss, and on-demand throughput Currently 17(4+11+2) of AMP Client has

Operate and service AMP-IPv4 and AMP IPv6 monitoring

1515

AMP Local Mesh Results

1616

AMP International Mesh

1717

AMP International Mesh

1818

Network performance monitoring for SDSS

http://dmzmon0.deemz.net/iepm-bw/html/wan_bw_tests.html#node1.nchc_twaren.tw

1919

TP

TC

TNHC

ASCC

NDHU

NCTU

NTHU

NCHU

NCNU NSYSU

NCKU

CCU

CCU

NTU

TWAREN

C7609

C7609

C7609

C7609

C7609

C7609

C7609

C7609

C7609

C7609C7609

GSR

GSR

GSR

GSR

Seattle GSR12410

Chicago GSR12406

AARnet(AS7575)Abilene(AS115137)CAnet4(AS6509)GEMnet2(AS23796)KREONet2(AS17579)PacificWave(AS101)

RP.

RP.

RP.

RP.RP.

RP.

Abilene(AS11537)KREONet2 (AS17579)NREN(AS24)STARTAP(AS22335)

PIM-Sparse, MBGP, MSDP protocols Multicast connections

Peer networks： 10

CCIT

NCHC-TN

NCHC-HC

YUNTECH

TWAREN Multicast deployment Status

2020

TWAREN Multicast Beacon

Active measurement of : loss (%) delay (ms) jitter (ms)

http://measurement.twaren.net/beacon

2121

TWAREN one-way-delay Monitoring

Application created by E2Epi, Internet2

Look for one-way latency, loss Long-term or on-time value query Deployed IPv4 & IPv6 one-way delay

2222

NDT

Enable users to measure performance to TWAREN directly on their desktops from website

Identify specific problem(s) that affect end users

2323

On-line Measurement Utilitiesping & ping6traceroute & traceroute6Router Looking GlassMulticast TesterMTRIPASnslookup

2424

Goals

Make performance data publicly available. Provide TWAREN users with detailed and

real-time data of performance measurements.

Enable TWAREN users to trace the performance of TWAREN backbone and end-to-end network.