pavement/pio parallel i/o system for massively parallel processors

2
PAVEMENT/PIO Parallel I/O System for Massively Parallel Processors MPP (Massively Parallel Processor) Front-end Machine Multiprocessor Utilizing Multiple I/O Processors on MPP Commodity Network Media for High Cost/Performanc e Automatic/Dynamic Load Balancing among Parallel Conenections PAVEMENT/PIO provides a flexible, self load balanced and high cost/performance parallel input/output environment which enrolls surrounding front-end machines to any style of massively parallel processing system. API of PAVEMENT/PIO is very simple and easy-to-program for end user applications which require high throughput I/O interactions with file servers, visualization servers and/or other outer environments for the next generation HPC platforms. 0 2 4 6 8 10 12 14 16 0 5 10 15 N um ber of C hannels Perform ance TC P/Alpha PIO/Alpha TCP/O rigin-2000 PIO/Origin-2000 Scalability for # of connections A verage M essage Length = 512KB 0 2 4 6 8 10 12 14 16 18 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 C onnection ID R elative D ata Am m ount D YNAM IC STATIC Effect of Dynamic Load Balancing

Upload: katina

Post on 06-Jan-2016

35 views

Category:

Documents


0 download

DESCRIPTION

Front-end Machine. MPP (Massively Parallel Processor). ( Multiprocessor ). Automatic/Dynamic Load Balancing among Parallel Conenections. Utilizing Multiple I/O Processors on MPP. Commodity Network Media for High Cost/Performance. PAVEMENT/PIO - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: PAVEMENT/PIO Parallel I/O System for Massively Parallel Processors

PAVEMENT/PIOParallel I/O System for Massively Parallel Processors

MPP (Massively Parallel Processor)

Front-end Machine

( Multiprocessor )

Utilizing Multiple I/O Processors on MPP

Commodity Network Media for High Cost/Performance

Automatic/Dynamic Load Balancing among Parallel Conenections

PAVEMENT/PIO provides a flexible, self load balanced and high cost/performance parallel input/output environment which enrolls surrounding front-end machines to any style of massively parallel processing system. API of PAVEMENT/PIO is very simple and easy-to-program for end user applications which require high throughput I/O interactions with file servers, visualization servers and/or other outer environments for the next generation HPC platforms.

0

2

4

6

8

10

12

14

16

0 5 10 15Number of Channels

Per

form

ance

TCP/AlphaPIO/ AlphaTCP/Origin-2000PIO/ Origin-2000

Scalability for # of connections

Average Message Length = 512KB

0

2

4

6

8

10

12

14

16

18

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Connection ID

Rel

ativ

e Dat

a Am

mou

nt

DYNAMICSTATIC

Effect of Dynamic Load Balancing

Page 2: PAVEMENT/PIO Parallel I/O System for Massively Parallel Processors

PAVEMENT/VIZParallel Visualization Environment for Large Amount Data

Massively Parallel ProcessorCP-PACS

(2048 PUs, 128 IOUs)

Parallel Visualization ServerSGI Onyx2 (4 Processors)

Parallel File ServerSGI Origin-2000 (8 Processors)

SwitchingHUB

Parallel100Base-TX

Ethernet

……

8 links

Alpha ClusterHYADES (16 Nodes)

……

Experimental Environment of PAVEMENT (Parallel I/O and Visualization Environment)

binder AVS/Express

read module

Data Buffer(shared memory)

thread

Onyx2 (Visualizer)

PAVEMENT/VIZ is a parallelized visualization system on shared memory front-end graphic workstation, which coordinates with MPP to visualize large amount of numerical output based on PAVEMENT/PIO. Multi-threaded parallel visualization software engines like parallel volume rendering module provide high speed visualization environment. PAVEMENT/VIZ is implemented based on AVS/Express for high portability and flexibility.