pavement/pio parallel i/o system for massively parallel processors

PAVEMENT/PIOParallel I/O System for Massively Parallel Processors

MPP (Massively Parallel Processor)

Front-end Machine

（ Multiprocessor ）

Utilizing Multiple I/O Processors on MPP

Commodity Network Media for High Cost/Performance

Automatic/Dynamic Load Balancing among Parallel Conenections

PAVEMENT/PIO provides a flexible, self load balanced and high cost/performance parallel input/output environment which enrolls surrounding front-end machines to any style of massively parallel processing system. API of PAVEMENT/PIO is very simple and easy-to-program for end user applications which require high throughput I/O interactions with file servers, visualization servers and/or other outer environments for the next generation HPC platforms.

0

2

4

6

8

10

12

14

16

0 5 10 15Number of Channels

Per

form

ance

TCP/AlphaPIO/ AlphaTCP/Origin-2000PIO/ Origin-2000

Scalability for # of connections

Average Message Length = 512KB

0

2

4

6

8

10

12

14

16

18

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Connection ID

Rel

ativ

e Dat

a Am

mou

nt

DYNAMICSTATIC

Effect of Dynamic Load Balancing

PAVEMENT/VIZParallel Visualization Environment for Large Amount Data

Massively Parallel ProcessorCP-PACS

(2048 PUs, 128 IOUs)

Parallel Visualization ServerSGI Onyx2 (4 Processors)

Parallel File ServerSGI Origin-2000 (8 Processors)

SwitchingHUB

Parallel100Base-TX

Ethernet

……

8 links

Alpha ClusterHYADES (16 Nodes)

……

Experimental Environment of PAVEMENT (Parallel I/O and Visualization Environment)

binder AVS/Express

read module

Data Buffer(shared memory)

thread

Onyx2 (Visualizer)

PAVEMENT/VIZ is a parallelized visualization system on shared memory front-end graphic workstation, which coordinates with MPP to visualize large amount of numerical output based on PAVEMENT/PIO. Multi-threaded parallel visualization software engines like parallel volume rendering module provide high speed visualization environment. PAVEMENT/VIZ is implemented based on AVS/Express for high portability and flexibility.