date: 0 2014/8/26
Post on 19-Mar-2016
44 Views
Preview:
DESCRIPTION
TRANSCRIPT
DATE: 04/24/23
Authors : Rock Kuo, Waue Chen, Che-Yuan Tu, Barz Hsu Collaborators / Supervisor : Steven Shiau, Jazz Wang
How to deploy GPFS nodes massively using Diskless Remote
Boot Linux
22
OutlineIBM GPFSNCHC DRBLTestbed ArchitectureDemo ScheduleReferenceQ&A
33
GPFS (General Parallel File System)IBM GPFS is High-performance shared-disk file
management solution.Provides fast, reliable access to a common set of file
data from two computers to hundreds of systems.
GPFS Architecture (From IBM)
44
NCHC DRBLDiskless Remote Boot in Linux (DRBL) provides a
diskless or systemless environment for client machines.
DRBL Logo(From DRBL)
55
Why we use DRBL to deploy GPFS?Fast and reconfigurable deployment for GPFS nodes
Just install software you need in DRBL server, then client will boot from network using image in server.
Use GPFS to utilize client disks effectively Since DRBL is diskless, you can use entire hard disk for GPFS nodes.
3. Use DRBL command to manage your GPFS enabled Storage Cluster
4. Add and remove storages dynamic with fault tolerance support
66
Our Testbed
Each node:CPU: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHzRAM: 2GB DDR2 667Disk: sda->160G, sdb->320GNIC:Intel Corporation 82566DM Gigabit Network Connection
77
Our Testbed Architecture
Total disks: 2.5 T Total disks: 3.1 T
88
Demo ScheduleInstall DRBL and GPFS
drblsrv -i ; drblpush -i (install and deploy)http://trac.nchc.org.tw/grid/wiki/GPFS_DRBL
Demo 1: Run GPFS in DRBL environmentRun GPFS on 8 nodesUse 11 disks (6*160G + 5*320G=2.5T)
Demo 2: Add new disk (Test Scalability) Dynamic add 3 disksGPFS will merge new and old disks into to one (Total disk
spaces:3.1T)
99
Demo Schedule (con.)Demo 3: Test fault-tolerance
Use DRBL command to shutdown gpfs07 (GPFS will assume gpfs07 crash)
If you enable GPFS data-replicate option, the GPFS disks will still be available for futural operation
1010
Future WorkWrite booting scripts for DRBL client to
automatically add and remove GPFS nodes
Integrate GPFS deploy function to DRBL management interface
GPFS testbed to support 3D Fly Circit Image Database
1111
ReferenceDRBL
http://drbl.sourceforge.net/GPFS
http://www-03.ibm.com/systems/clusters/software/gpfs/index.html
1212
Q&A
top related