cs 6143 computer architecture ii spring 2014 acm principles and practice of parallel programming,...

48
CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice ACM Principles and Practice of Parallel Programming, of Parallel Programming, PPoPP, 2006 Panel PPoPP, 2006 Panel Presentations Presentations Parallel Processing is Parallel Processing is Mainstream : Mainstream : Multi-core Processor Chips Multi-core Processor Chips

Upload: camren-cantley

Post on 31-Mar-2015

217 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

CS 6143COMPUTER ARCHITECTURE II

SPRING 2014

ACM Principles and Practice of ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Parallel Programming, PPoPP, 2006

Panel PresentationsPanel Presentations

Parallel Processing is Mainstream :Parallel Processing is Mainstream :Multi-core Processor ChipsMulti-core Processor Chips

Page 2: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 2

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 3: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 3

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 4: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 4

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 5: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 5

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 6: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 6

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 7: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 7

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 8: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 8

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 9: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 9

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 10: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 10

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 11: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 11

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 12: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 12

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 13: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 13

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 14: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 14

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 15: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 15

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 16: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 16

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 17: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 17

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 18: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 18

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 19: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 19

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 20: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 20

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 21: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 21

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 22: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 22

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 23: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 23

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 24: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 24

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 25: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 25

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 26: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 26

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 27: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 27

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 28: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 28

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 29: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 29

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 30: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 30

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 31: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 31

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 32: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 32

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 33: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 33

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 34: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 34

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 35: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 35

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 36: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 36

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 37: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 37

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 38: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 38

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 39: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 39

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 40: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 40

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 41: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 41

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 42: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 42

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 43: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 43

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 44: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 44

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 45: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 45

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 46: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 46

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 47: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 47

AC

M P

PoPP 2

006 P

anel Pre

senta

tions

Page 48: CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is

Handout 11CS 6143 Spring 2014 Page 48

How can parallel processing be mainstream ? Slide 19 by Luddy Harrison

Rules of composition are needed so that There is independence between software components and their deployment

Composing software components ? In hardware this is done now !

How can composing be implemented in software ? Communication ≡ computation ? A new computational method ? A new hardware technology leading to a new idea ? All of the above ?

Is composing enough ? Parallel processing is relatively simple now with 4 to 10 cores ! But, memory wall, soft errors, defective chips and other unforeseen problems can make parallel processing harder On the other hand, programmable chips, nanotechnology, bio-inspired computing paradigms and other unforeseen new technologies can help parallel processing

Pro

fess

or’

s C

om

ments