1 generating network topologies that obey power lawspalmer/steffan carnegie mellon generating...

32
1 Generating Network Topologies That Obey Power Laws Palmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer and J. Gregory Steffan School of Computer Science Carnegie Mellon University

Upload: pablo-pierpont

Post on 30-Mar-2015

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

1Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Generating Network Topologies That Obey Power Laws

Christopher R. Palmer and J. Gregory Steffan

School of Computer ScienceCarnegie Mellon University

Page 2: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

2Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

What is a Power Law?What is a Power Law?

Faloutsos et al. define four power laws:– they found laws in multiple Internet graphs

– others found similar laws, also for the Web

y = βxα

Log

Log

the Internet obeys power laws

Page 3: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

3Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

What is a Topology Generator?What is a Topology Generator?

Artificial network generation algorithm:– often used to evaluate new network schemes

Do artificial networks obey power laws?– artificial networks may not be “realistic”– conclusions could be inaccurate

can we generate these topologies?

does it matter?

Page 4: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

4Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

OutlineOutline

Do existing generators obey power laws?

• Can we generate graphs that obey power laws?

• Do power law graphs impact results?

• Related work

• Conclusions

Page 5: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

5Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Existing Topology GeneratorsExisting Topology Generators

Waxman:– place nodes randomly in 2-space– add edges with probability P(u,v)=αe-d/(βL)

N-level hierarchical:–connect random graphs in an N-level hierarchy

Page 6: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

6Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Power Laws 1 and 2Power Laws 1 and 2

PL #1: Out-degree vs. Rank– compute the out-degree of all nodes– sort in descending order

PL #2: Frequency vs. Out-degree– compute the out-degree of all nodes– compute the frequency of each out-degree

Internet graphs obey

Page 7: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

7Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

PL #1: Out-degree vs. RankPL #1: Out-degree vs. Rank

2-Level and Waxman do not obey

Waxman: ρ=0.80

2-Level: ρ=0.81

Page 8: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

8Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

PL #2: Frequency vs. Out-degreePL #2: Frequency vs. Out-degree

2-Level & Waxman REALLY do not obey!

Waxman: ρ=0.45

2-Level: ρ=0.23

Page 9: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

9Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Power Laws 3 and 4Power Laws 3 and 4

PL #3: Hopcounts – number of pairs of nodes within i hops

PL #4: Eigenvalues– compute the largest 10 eigenvalues λi

Internet graphs obey

[A][vi] = λi[vi]

Page 10: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

10Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

PL #3: HopcountsPL #3: Hopcounts

2-Level and Waxman obey

Waxman: ρ=0.96

2-Level: ρ=0.98

Page 11: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

11Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

PL #4: EigenvaluesPL #4: Eigenvalues

2-Level and Waxman obey

Waxman: ρ=0.98

2-Level: ρ=0.65

Page 12: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

12Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

OutlineOutline

Do existing generators obey power laws?

Can we generate graphs that obey power laws?– Power-Law Out-Degree (PLOD) – Recursive

• Do power law graphs impact results?

• Related work

• Conclusions

Page 13: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

13Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Power-Law Out-Degree Algorithm (PLOD)Power-Law Out-Degree Algorithm (PLOD)

FOR i:1..Nx = uniform_random(1,N)

out_degreei = βx-α

FOR i:1..MWHILE 1 r = uniform_random(1,N), c = uniform_random(1,N)

IF r != c AND out_degreer AND out_degreec AND !Ar,c

out_degreer--, out_degreec--

Ar,c = 1, Ac,r = 1BREAK

Assign exponentialout-degree credits

Place an edge inthe adjacency matrix

Page 14: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

14Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

PLOD: Example TopologyPLOD: Example Topology

32 nodes, 48 links

Page 15: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

15Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Recursive Topology GeneratorRecursive Topology Generator

β

γ

α Our Recursive Distribution:

80/20 Distribution: 80% 20%

generalize to a 2D adjacency matrix

Page 16: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

16Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Recursive Topology: GenerationRecursive Topology: Generation

Link Probabilities 10 Generated links

darker means higher probability / weight

Page 17: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

17Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Recursive Topology: ExampleRecursive Topology: Example

32 nodes, 50 low latency, 10 high latency (red) links

Page 18: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

18Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

PL #1: Out-degree vs. RankPL #1: Out-degree vs. Rank

Recursive: good power-law tail, non-power-law start

PLOD: EXCELLENT power-law

Recursive: ρ=0.89

PLOD: ρ=0.97

Page 19: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

19Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

PL #2: Frequency vs. DegreePL #2: Frequency vs. Degree

both GOOD power-laws

Recursive: ρ=0.92

PLOD: ρ=0.93

Page 20: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

20Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

PL #3: HopcountsPL #3: Hopcounts

both EXCELLENT power-laws

Recursive: ρ=0.94

PLOD: ρ=0.98

Page 21: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

21Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

PL #4: EigenvaluesPL #4: Eigenvalues

both EXCELLENT power-laws

Recursive: ρ=0.93

PLOD: ρ=0.98

Page 22: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

22Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Power-Law Summary: CorrelationsPower-Law Summary: Correlations

PL #1:

Degree

PL #2:

Deg. Freq

PL #3:

Hops

PL #4:

Eigenval

2-Level .81 .23 .98 .65

Waxman .80 .45 .96 .97

PLOD .99 .93 .98 .98

Recursive .89 .92 .94 .93

GREEN cells obey power-laws, RED cells do not

our generators have better Internet characteristics!

Page 23: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

23Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

OutlineOutline

Do existing generators obey power laws?

Can we generate graphs that obey power laws?

Do power law graphs impact results?

• Related work

• Conclusions

Page 24: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

24Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

STORM Multicast AlgorithmSTORM Multicast Algorithm

client requests repair from parent with a nack

source

client (parent)

clientnackrepair

Page 25: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

25Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Simulation MethodologySimulation Methodology

Original STORM study:– used 2-level random topology– source and clients connected to second-level

Generating comparable topologies:– equalize graph size and average out-degree– selection of high and low latency links

What impact do we expect of PL topologies?– average results will be similar– distributions will differ

Page 26: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

26Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

STORM Average Overhead STORM Average Overhead

STORM overhead averages scale for all topologies

Page 27: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

27Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

STORM Overhead DistributionSTORM Overhead Distribution

overhead distribution varies significantly by topology

2-Level

Page 28: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

28Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Loss DistributionLoss Distribution

loss distribution also varies significantly by topology

Page 29: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

29Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Related WorkRelated Work

• Barabási et al. (Notre Dame)

• BRITE (Boston University)

What causes power laws in the Internet?– incremental growth– preferential connectivity

BRITE uses these factors to generate graphs

Page 30: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

30Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

ConclusionsConclusions

• Existing generators do not obey all power-laws

• Our two topology generators do– PLOD: use power-law to generate node degrees– recursive: use 80/20 law to generate links

• Do power-law topologies have any impact?– maybe: changed distributions for STORM– maybe not: averages unchanged for STORM

moral: simulate with different generators!

Page 31: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

31Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Backup SlidesBackup Slides

Page 32: 1 Generating Network Topologies That Obey Power LawsPalmer/Steffan Carnegie Mellon Generating Network Topologies That Obey Power Laws Christopher R. Palmer

32Generating Network Topologies That Obey Power Laws Palmer/SteffanCarnegie Mellon

Generating Comparable TopologiesGenerating Comparable Topologies

Equalize graph characteristics:– number of nodes– average out-degree

Ensure connectedness:– randomly connect disconnected components

Assign high/low-latency links:– Recursive algorithm provides a distinction– method for putting low-lat. links near clients