pavement/pio parallel i/o system for massively parallel processors
DESCRIPTION
Front-end Machine. MPP (Massively Parallel Processor). ( Multiprocessor ). Automatic/Dynamic Load Balancing among Parallel Conenections. Utilizing Multiple I/O Processors on MPP. Commodity Network Media for High Cost/Performance. PAVEMENT/PIO - PowerPoint PPT PresentationTRANSCRIPT
PAVEMENT/PIOParallel I/O System for Massively Parallel Processors
MPP (Massively Parallel Processor)
Front-end Machine
( Multiprocessor )
Utilizing Multiple I/O Processors on MPP
Commodity Network Media for High Cost/Performance
Automatic/Dynamic Load Balancing among Parallel Conenections
PAVEMENT/PIO provides a flexible, self load balanced and high cost/performance parallel input/output environment which enrolls surrounding front-end machines to any style of massively parallel processing system. API of PAVEMENT/PIO is very simple and easy-to-program for end user applications which require high throughput I/O interactions with file servers, visualization servers and/or other outer environments for the next generation HPC platforms.
0
2
4
6
8
10
12
14
16
0 5 10 15Number of Channels
Per
form
ance
TCP/AlphaPIO/ AlphaTCP/Origin-2000PIO/ Origin-2000
Scalability for # of connections
Average Message Length = 512KB
0
2
4
6
8
10
12
14
16
18
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
Connection ID
Rel
ativ
e Dat
a Am
mou
nt
DYNAMICSTATIC
Effect of Dynamic Load Balancing
PAVEMENT/VIZParallel Visualization Environment for Large Amount Data
Massively Parallel ProcessorCP-PACS
(2048 PUs, 128 IOUs)
Parallel Visualization ServerSGI Onyx2 (4 Processors)
Parallel File ServerSGI Origin-2000 (8 Processors)
SwitchingHUB
Parallel100Base-TX
Ethernet
……
8 links
Alpha ClusterHYADES (16 Nodes)
……
Experimental Environment of PAVEMENT (Parallel I/O and Visualization Environment)
binder AVS/Express
read module
Data Buffer(shared memory)
thread
Onyx2 (Visualizer)
PAVEMENT/VIZ is a parallelized visualization system on shared memory front-end graphic workstation, which coordinates with MPP to visualize large amount of numerical output based on PAVEMENT/PIO. Multi-threaded parallel visualization software engines like parallel volume rendering module provide high speed visualization environment. PAVEMENT/VIZ is implemented based on AVS/Express for high portability and flexibility.