cluster computer
DESCRIPTION
Computers that work together so that in many respects they can be viewed as a single system.TRANSCRIPT
CLUSTER COMPUTER
By: Ashraful [email protected]
Topics Covered
IntroductionHistorywhy cluster computing?ArchitectureClustering ConceptSeveral applicationOperating SystemCompanies that use itHigh performance Clusters (HPC)
2
What is cluster computing?A computer cluster consists of a set of loosely
connected computers that work together so that in many respects they can be viewed as a single system.
3
CPU CPU CPU…
High Speed Local Network
Cluster Middle ware
Cluster
APP APP APP…Cluster consists of: Nodes(master+computi
ng) Network OS Cluster middleware: It
permits compute clustering programs to be portable to a wide variety of clusters.
INTRODUCTIONConsists of many of the same or similar type of
machines.
Tightly-coupled using dedicated network connections.
The components of a cluster are usually connected to each other through fast local area networks, each node running its own instance on an operating system.
All machines share resources.
They must trust each other so that does not require a password, otherwise you would need to do a manual start on each machine.
HISTORY
The first commercial clustering product was ARCnet, developed by Data point in 1977.
Digital Equipment Corporation released their VAX cluster product in 1984 for the VAX/VMS operating system.
The ARCnet and VAX cluster products not only supported parallel computing, but also shared file systems and peripheral devices.
The idea was to provide the advantages of parallel processing, while maintaining data reliability and uniqueness.
Through CLUSTERS
Data sharing
Message passing and communication
Task scheduling
Node failure management
Parallel programming
Debugging and monitoring
Logical view
ARCHITECTURE
It consists of a collection of interconnected stand-alone computers cooperatively working together a single, integrated computing resource.
A node: a single or multiprocessor system with memory, I/O facilities, &OS
generally 2 or more computers (nodes) connected together in a single cabinet, or physically separated & connected via a LAN appear as a single system to users and applications provide a cost-effective way to gain features and benefits
ARCHITECTURE
Database Replication Clusters
The components required to the development of low cost clusters are:
Processors Memory Networking components Motherboards, busses, and other sub-systems
Start from 1994Donald Becker of NASA assembled this cluster.Also called Beowulf clusterApplications like data mining, simulations, parallel processing, weather modeling, etc
Beowulf cluster
Beowulf clusterA Beowulf Cluster is a computer design that uses parallel
processing across multiple computers to create cheap and powerful supercomputers. A Beowulf Cluster in practice is usually a collection of generic computers connected through an internal network.
A cluster has two types of computers, a master computer, and node computers.
When a large problem or set of data is given to a Beowulf cluster, the master computer first runs a program that breaks the problem into small discrete pieces; it then sends a piece to each node to compute. As nodes finish their tasks, the master computer continually sends more pieces to them until the entire problem has been computed.
12
Beowulf cluster
13
( Ethernet,Myrinet….) + (MPI)
Master: or service node or front node ( used to interact with users and manage the cluster )
Nodes : a group of computers (computing node s)( keyboard, mouse, floppy, video…)
Communications between nodes on an interconnect network platform ( Ethernet, Myrinet….)
In order for the master and node computers to communicate, some sort message passing control structure is required. MPI,(Message Passing Interface) is the most commonly used such control.
CONSTRUCTION OF A BEOWULF CLUSTER
Brief Technical Parameters: OS: CentOS 5 managed by Rochs-cluster
Service node: 1 (Intel P4 2.4 GHz)
Computing nodes: 32(Intel P4 2.4- 2.8 GHz)
System Memory: 1 GB per node
Network Platforms: Gigabit Ethernet, 2 cards per node
Myrinet 2 G Language: C, C++, Fortran, java Compiler: Intel compiler, sun Java compiler
14
Several applications on parallel processing:
15
ScienceComputatio
n
Digital Biology
Aerospace Resources Exploration
High Performance Networks/Switches
a. Ethernet (10Mbps),b. Fast Ethernet (100Mbps),c. Gigabit Ethernet (1Gbps)e. ATMf. Myrinet (1.2Gbps)g. Digital Memory Channel
ISSUES TO BE CONSIDEREDCluster NetworkingCluster SoftwareProgrammingTimingNetwork SelectionSpeed Selection
OS (Operating System )
Three of the most commonly used OS are :
Windows mainly used to build a High Availability Cluster or a
NLB(Network Local Balance) Cluster, provide services such as Database, File/Print,Web,Stream Media .Support 2-4 SMP or 32 processors. Hardly used to build a Science Computing Cluster
Redhat Linux The most used OS for a Beowulf Cluster. provides High
Performance and Scalability / High Reliability / Low Cost ( get freely and uses inexpensive commodity hardware )
SUN Solaris Uses expensive and unpopular hardware
18
a. Linux b. Microsoft NT c. SUN Solaris d. IBM AIX e. HP UX (Illinois - PANDA)
State of the art Operating Systems with companies :
High performance clusters (HPC)Sun cluster.
20
(HPC) Sun cluster.
Calculation procedure for peak performance: No of nodes 64 NO. of Master Nodes : 1Memory RAM: 4 GBHard Disk Capacity/each node : 250GBStorage Cap. 4 TB CLUSTER Software : ROCKS version 4.3No .of processors and cores: 2 X 2 =
4(dual core + dual socket)CPU speed : 2.6 GHz
21
THANK YOU
ANY
QUERIES ???