ne x tworking’03 june 23-25,2003, chania, crete, greece the first cost-ist(eu)-nsf(usa) workshop...

11
NeXtworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING Challenges and issues in Measurement research Christophe Diot [email protected] www.intel-research.net

Post on 21-Dec-2015

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

Challenges and issues in Measurement research

Christophe [email protected]

Page 2: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

Why monitoring

• Monitoring should be the first step after a system has been designed– Assess performance– Control, manage, improve, engineer

• Any system should be designed with monitoring capabilities– Instead, the internet is a big black box that

seem to work well (but don’t look too close)

Page 3: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

Why monitoring

• Did God monitored Adam before designing Eve ?(clearly not if God was an Internet engineer)

• Make a system operational, then monitor it is like putting the cart before the horse.

Page 4: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

What needs to be monitored

• Managing a network based on SNMP data is like looking at the finger that points the moon

• Every possible data might be useful at some given point in time– Need to merge information– We don’t know yet what is exactly

needed

Page 5: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

Illustration

Page 6: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

A two tier monitoring system

RoutingTable

RoutingTableMemory

Monitoredlink

to networkStore &Forward

from network

Compute& export

Queries

Page 7: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

A two tier monitoring system

RoutingTableMemory

Monitoredlink

to networkStore &Forward

from network

Compute& export

Queries

Tier 1(permanent)

Page 8: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

A two tier monitoring system

RoutingTableMemory

Monitoredlink

to networkStore &Forward

from network

Compute& export

Queries

Tier 2(on-demand)

Page 9: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

Sprint CMON architecture

OC

3/1

2/4

8/1

92

OC

3/1

2/4

8/1

92

DAG DAG CardCardDAG DAG CardCard

MemoryMemory

PacketPacketHeadersHeaders

FlowFlowTableTable

Statistics &Statistics &CountersCounters

Disk ArrayDisk Array

CompressedCompressedPacket Packet TraceTrace

NIC to/from network

CPUCPU

Flow Classification

Engine

Packet TraceEncoding

ExportModule

ControlModule

StatisticsModule

Page 10: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

Related research problems

• Performance (10Gbps and more)

• Location (where to deploy)

• Control plane (Incl. Queries)

• Relevant metrics

• DoS

• Active monitoring

• Sampling

Page 11: Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Challenges and issues

NeXtworking’03 June 23-25,2003, Chania, Crete, GreeceThe First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

Enablers

• Publicly available data– ISPs, Universities, etc.– free equipment to encourage monitoring– NSF, EU MUST push.

• Multidisciplinary projects

• Academic and industry research work together