interconnection networks

53
1 Interconnection Networks Charles E. Leiserson 6.896 Theory of Parallel Systems March 29, 2004

Upload: thor

Post on 05-Jan-2016

31 views

Category:

Documents


1 download

DESCRIPTION

Interconnection Networks. Charles E. Leiserson 6.896 Theory of Parallel Systems March 29, 2004. “Ideal” Parallel Computer. P+M. P+M. P+M. P+M. P+M. P+M. P+M. P+M. P. M. P. M. P. M. …. …. P. M. “Ideal” Parallel Computer. “Ideal” Parallel Computer. “Ideal” Parallel Computer. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Interconnection Networks

1

Interconnection Networks

Charles E. Leiserson

6.896 Theory of Parallel SystemsMarch 29, 2004

Page 2: Interconnection Networks

2

“Ideal” Parallel Computer

P+MP+M P+MP+M

P+MP+M P+MP+M

P+MP+M

P+MP+M

P+MP+M

P+MP+M

Page 3: Interconnection Networks

3

“Ideal” Parallel Computer

PP

PP

PP

PP

MM

MM

MM

MM…

Page 4: Interconnection Networks

4

“Ideal” Parallel Computer

Page 5: Interconnection Networks

5

“Ideal” Parallel Computer

Page 6: Interconnection Networks

6

“Ideal” Parallel Computer

Page 7: Interconnection Networks

7

Mesh of Trees

Page 8: Interconnection Networks

8

Mesh of Trees

Page 9: Interconnection Networks

9

Hypercube

d = 0N = 1

d = 1N = 2

d = 2N = 4

d = 3N = 8

d = 4N = 16

Page 10: Interconnection Networks

10

Hypercube

010010 011011

000000 001001

110110 111111

100100 101101

Page 11: Interconnection Networks

11

Cube-Connected Cycles

Page 12: Interconnection Networks

12

Butterfly (FFT) Network0 1 2 0

000001010011100101110111

000001010011100101110111

Page 13: Interconnection Networks

13

Butterflies

Page 14: Interconnection Networks

14

Decomposing a Butterfly

Page 15: Interconnection Networks

15

Decomposing a Butterfly

Page 16: Interconnection Networks

16

Decomposing a Butterfly

Page 17: Interconnection Networks

17

Decomposing a Butterfly

Page 18: Interconnection Networks

18

Decomposing a Butterfly II

Page 19: Interconnection Networks

19

Decomposing a Butterfly II

Page 20: Interconnection Networks

20

Decomposing a Butterfly II

Page 21: Interconnection Networks

21

Decomposing a Butterfly II

Page 22: Interconnection Networks

22

Decomposing a Butterfly II

Page 23: Interconnection Networks

23

Decomposing a Butterfly II

Page 24: Interconnection Networks

24

Decomposing a Butterfly II

Page 25: Interconnection Networks

25

Routing on a Butterfly0 1 2 0

000001010011100101110111

000001010011100101110111

Page 26: Interconnection Networks

26

Tree in Butterfly0 1 2 0

000001010011100101110111

000001010011100101110111

Page 27: Interconnection Networks

27

Tree in Butterfly0 1 2 0

000001010011100101110111

000001010011100101110111

Page 28: Interconnection Networks

28

Beneš Network

Page 29: Interconnection Networks

29

n/2Benešn/2

Beneš

n/2Benešn/2

Beneš

Decomposing a Beneš Network

Page 30: Interconnection Networks

30

Routing on a Beneš Network

01234567

50746231

Page 31: Interconnection Networks

31

Routing on a Beneš Network

01234567

50746231

Page 32: Interconnection Networks

32

Routing on a Beneš Network

01234567

50746231

Page 33: Interconnection Networks

33

Routing on a Beneš Network

01234567

50746231

Page 34: Interconnection Networks

34

Routing on a Beneš Network

01234567

50746231

Page 35: Interconnection Networks

35

Routing on a Beneš Network

01234567

50746231

Page 36: Interconnection Networks

36

Routing on a Beneš Network

01234567

50746231

Page 37: Interconnection Networks

37

Routing on a Beneš Network

01234567

50746231

Page 38: Interconnection Networks

38

Routing on a Beneš Network

01234567

50746231

Page 39: Interconnection Networks

39

Routing on a Beneš Network

50746231

01234567

Page 40: Interconnection Networks

40

Bitonic Sorting Network

Hypercube connections!

Page 41: Interconnection Networks

41

Bitonic Sort on Butterfly

Page 42: Interconnection Networks

42

Bitonic Sort on Butterfly

Page 43: Interconnection Networks

43

Bitonic Sort on Butterfly

Page 44: Interconnection Networks

44

Bitonic Sort on Butterfly

Page 45: Interconnection Networks

45

Bitonic Sort on Butterfly

Page 46: Interconnection Networks

46

Bitonic Sort on Butterfly

Page 47: Interconnection Networks

47

Bitonic Sort on Butterfly

Page 48: Interconnection Networks

48

Bitonic Sort on Butterfly

Page 49: Interconnection Networks

49

Bitonic Sort on Butterfly

Page 50: Interconnection Networks

50

Bitonic Sort on Butterfly

Page 51: Interconnection Networks

51

Bitonic Sort on Butterfly

Page 52: Interconnection Networks

52

Bitonic Sort on Butterfly

Page 53: Interconnection Networks

53

Bitonic Sort on Butterfly