hpc in higher education

54
HPC in Higher Education and Research Dr. T. R. Lenka Asst. Professor. Dept. of ECE, NIT Silchar Email: [email protected] 1

Upload: kishor-satpathy

Post on 06-Apr-2017

353 views

Category:

Engineering


1 download

TRANSCRIPT

HPC in Higher Education

HPC inHigher Education and Research

Dr. T. R. LenkaAsst. Professor. Dept. of ECE,NIT SilcharEmail: [email protected]

OutlinesWhat is VLSI?VLSI and HPCFLOPSSerial v/s Parallel SystemNeed of HPC in Higher Education ResearchProblem Solving Capabilities of HPCHPC Research domainsArchitecture of HPC SystemCost of HPCNIT Silchar Supercomputing CentreConclusion

21-Aug-152NIT Silchar

Four Decades of VLSI21-Aug-15NIT Silchar5

Intel 4004 Micro-Processor

21-Aug-15NIT Silchar6

19711000 transistors1 MHz operation

21-Aug-15NIT Silchar7

Silicon WaferSingle die

Wafer

From http://www.amd.comGoing up to 12 (30cm)

What is HPC?High Performance Computing (HPC) refers to any computational activity requiring more than a single computer to execute a task.Supercomputers and computer clusters are used to solve advanced Computational Science and Engineering Research problems.High-performance computing (HPC) is the use ofparallel processingfor running advancedapplication programs efficiently, reliably and quickly.

21-Aug-15NIT Silchar10

High Performance Computing (HPC)HPC has the capacity to handle and analyze massive amounts of data at high speed.Tasks that can take months using normal computers can be done in days or even minutes. It can be used to model and solve highly complex problems in all sectors.

21-Aug-1511NIT Silchar

http://searchenterpriselinux.techtarget.com/definition/high-performance-computing11

FLOPSSupercomputers speed are measured in floating point operations per second (FLOPS) in units of megaflops (MFLOPS)(106) gigaflops (GFLOPS) (109) teraflops (TFLOPS)(1012) petaflops(PFLOPS)(1015)

21-Aug-15NIT Silchar12

FLOPS CalculationHPC world is using the following formulae for nodepeaktheoretical performance:Node performance in GFlops = (CPU speed in GHz) x (number of CPU cores) x (CPU instruction per cycle) x (number of CPUs per node)

21-Aug-15NIT Silchar13

Parallel Vs Serial Computing

Serial Computation Parallel Computation To Run on a single computer with single CPU Problem is broken into discrete instructions and are executed one after another One instruction at a time To Run on Multiple CPUs Problem is broken into discrete parts that can be solved concurrently Each part is broken down into instruct- ions which is executed simultaneously on different CPUs

21-Aug-15NIT Silchar15Need of HPC in Research

Requirement of HPCMany computational problems in science and engineering require the most powerful computers available today. The widespread deployment of multicore and many core architectures has highlighted the need to exploit parallel computing techniques.Research in high performance computing (HPC) spans algorithms, software, tools and applications that exploit modern HPC platforms.The use oflow-latency Infiniband interconnect and high performance parallel file system storage gives the best performance for intriguing large data set problems.21-Aug-15NIT Silchar16

Softwares forHigh Performance Computing21-Aug-15NIT Silchar17

Serial Software in ResearchMatlabAnsysCATIASilvaco etc..

21-Aug-1518NIT Silchar

Parallel Software in ResearchOpenCVLammpsOpenFOAMCalculixParallel Python RedMDAnd many more..

21-Aug-1519NIT Silchar

Opencv for image processing Lammps: molecular dynamicsOpenfoam aerodynamicscalculix modeling machine.Python: computer programmingRedMd: bio-informatics

19

HPC efficiently and parallel solutionsLinear Algebra: BLAS routines are vector-vector (Level 1), matrix-vector(Level 2) and matrix matrix(Level 3) operations for real and complex single and double precision data. LAPACK consists of tuned LU, Cholesky and QR factorizations, eigen value and least squares solvers.FFT(Fast Fourier Transform): Transform from 1D to multidimensional, complex to complex, real to complex, and real to real transforms of arbitrary lengths.Vector Math:Functions include computationally intensive core mathematical operations for single and double precision real and complex data types.

21-Aug-1520NIT Silchar

Cont..Statistics: Functions include random number generators and probability distributions. optimized for multicore processors. Also included are compute-intensive in and out-of-core routines to compute basic statistics, estimation of dependencies etc.

Data fitting:Functions include splines (linear, quadratic, cubic, look-up, stepwise constant) for 1-dimensional interpolation that can be used in data analytics, geometric modeling and surface approximation applications.

21-Aug-1521NIT Silchar

Cont..Tools for Solving Differential Equation: trigonometric transform routines and Poisson solverData fitting functions: For spline-based approximation of functions, derivatives and integrals of functions, and searchSupport Vector Machine(SVM): Used for Machine Learning Application to train the machine.Optimized version for both HPC System and NVIDIA.

21-Aug-1522NIT Silchar

21-Aug-15NIT Silchar23HPC Research Domains

Application Areas of Parallel Computing

Weather Forecasting Computational Fluid Dynamics Medical Imaging Structural Mechanics Bioinformatics Oil and Natural Gas Computational Chemistry Seismic Data Processing Astrophysics Earth Sciences And Many More .

HPC can also be used toDevelop and redesign productsOptimize production and delivery processesAnalyze or develop large datasetsConduct large-scale research projectsStore large amounts of data for future analysisPerform consumer trend monitoring, searching or profilingCreate computer visualizations that explain research resultsCarry out simulations and / or modeling of complex processes

21-Aug-15NIT Silchar25

Manufacturing 21-Aug-15NIT Silchar26

Good Year Tire

HPC modeling and simulation has allowed Goodyear to reduce key product design time from three years to less than one year. Tire building and testing costs from 40 percent of the companys research and design budget to 15 percent.

http://hpc4energy.org/hpc-road-map/success-stories/goodyear/index.html26

Cont.. 21-Aug-15NIT Silchar27Boeing 767

Used Oak Ridge supercomputersThe simulation exercise helped the company design a more efficient, stable aircraft wing that improves lift, reduces drag and improves fuel consumption. Cost saving.

http://hpc4energy.org/hpc-road-map/success-stories/boeing/index.html27

EntertainmentSupercomputing Boosts Disneys Big Hero 6

21-Aug-15NIT Silchar28

Bollywood Animation Movies

India's first international quality 3D animation film by Yash Raj Films released in 2007.Eka(supercomputer) used to reduce rendering times for animation frames, computer generated imagery (CGI), visual effects (vfx) and compositing in the domains of high end 3D modelling, 2D & 3D animation and game asset developmentEka manufactured by Tata sons has 117 Teraflops computing Power.Avatar,Ra-one, Bahubali for visual effects.

21-Aug-15NIT Silchar29Roadside Romeo

21-Aug-15NIT Silchar30Live Research

NASA Supercomputing System21-Aug-15NIT Silchar31

NASAs Research on Galaxy Simulation21-Aug-15NIT Silchar32

NASAs Research on HPC21-Aug-15NIT Silchar33

Learning from the April 25, 2015, Nepal earthquake:Mapping the deformation and site response

21-Aug-1534NIT SilcharIISc Banglore Research Project

Research Project of IISc computation and Simulation run on HPC system.Done by Team of Professor,PhD and M-tech Students.http://www.iisc.ernet.in/CEaS_Nepal_report_2015_web_page_final.htm34

21-Aug-15NIT Silchar35Cost of HPC System

Cost of HPC SystemCost in terms of

System Perspective Application Perspective21-Aug-1536NIT Silchar

System Perspective Cost It includes cost required to build the HPC System Cost of Node: Consist of processor RAM and Hard Disk Cost e.g SuperMicro, IBM,HP.Cost Of Storage: Cost of storage box e.g SeagateCost Of PACS: required to maintain the temperature and humidity level. e.g Uniflair.Maintenace of HPC and cost of electricity.21-Aug-1537NIT Silchar

Application Perspective CostCost of OS: RHEL, Cluster Suite.Cost of Parallel Compliers: OpenMPI, MPICH, etcCost of scheduler to run the job: PBS Scheduler.Most of the applications are opensource . 99% of the Supercomputers use Linux.

21-Aug-1538NIT Silchar

Cont.. Research Application Softwares:Lammps for molecular Dynamics.Calculix for Machine design. OpenCV for image Processing. OpenFOAM for Computational Fluid dynamics.MPQC for Computational chemistry.RedMd for genome sequence searching.And many more..

21-Aug-1539NIT Silchar

Establishment ofNITS Supercomputing Centre21-Aug-15NIT Silchar40

Establishment of HPC Centre NIT SilcharMOU was signed between NIT Silchar and CDAC Pune on 25th May 2013 to establish HPC Centre at NIT Silchar.The state-of-the-art HPC Data Centre built by Sify Technologies, Kolkata and Servers/Clusters supplied by Netweb Technologies, New Delhi by open tender.

21-Aug-15NIT Silchar41

Inauguration of NITS Supercomputing CentreNITS Supercomputing Centre: The Centre of Excellence in High Performance Computing.Inaugurated on 05th Apr 2014Honble JS&FA, Sri Yogendra Tripathy, MHRD, Govt. of India Prof. L. M. Patnaik (FIEEE), IISc, Bangalore Dr. Pradeep K. Sinha, (FIEEE, ACM Distinguished Engineer), Sr. Director, C-DAC.

21-Aug-15NIT Silchar42

Inauguration of NITS Supercomputing Centre21-Aug-15NIT Silchar43

21-Aug-15NIT Silchar44

Software ConfigurationRed Hat Enterprise Linux Server release 6.4 in all the master and compute nodes IBM Platform HPC 4.1.1.1 LSF Express 9.1.1.0 job scheduler Intel Cluster Studio

21-Aug-15NIT Silchar45

NITS Supercomputing CentreNITS Supercomputing Centre runs over 272 processors using state-of-art data center with 2 Precision Air Conditioning (PAC), grouped in 2 racks connected by high-speed optical network.

21-Aug-15NIT Silchar46

Computational Resources Utilized(Master Node)21-Aug-15NIT Silchar47

Computational Resources for Compute Nodes21-Aug-15NIT Silchar48

Latest Processors and Coaccelerator CardsNITS Supercomputing Centre is established in collaboration with C-DAC & it is one of the most powerful system in the North East India.Equipped with x86_64 bit based latest Intel Ivy Bridge processing and Accelerator (Intel Xeon Phi and Nvidia Kepler based Co-processing technologies).Interconnected with Mellanox FDR Infiniband with RHEL OS on servers.IBM Platform Computing (Job Scheduler, Cluster Manager, Integrated Portal for Job Submission) and Intel Cluster Studio having a compute power of approximately 15 Tera Flops.

21-Aug-15NIT Silchar49

Specifications of NITS Supercomputing Centre34 number of Intel Xeon Ivy bridge (E5-2650V2) processorsPeak performance of 14.94 Teraflops272 x86_64 based processing cores1.088 TB (1088 GB) of Total Memory (64 GB per Node)6 x 600 GB, 15K RPM, SAS 6Gbps hot-plug HDDs in Master Node2 x 500 GB, 7.2K RPM, Enterprise SATA hot-plug HDDs in Compute Nodes4 x Intel Xeon Phi 5110P Accelerator (8 GB, 60 Co-Processing Cores)4 x Nvidia K20X GPU (6 GB, 2688 Co-Processing Cores)84 TB SATA hot-plug HDDs configured as RAID536 Ports 56Gbps 4X FDR Infiniband as a Primary Network48-port Gigabit Ethernet as a Secondary Network48-port Gigabit Ethernet as Management NetworkVisualization/Management workstation

21-Aug-15NIT Silchar50

Activities Done16 Students of NIT Silchar (CSE & ECE) did summer internship at C-DAC Pune from 15th May - 30th June 2014.Round table meet held for academia of NE region at NIT Silchar on 4th April, 2014.Summer/Winter Hands on Trainings and Workshop on HPC are being held regularly.Joint research & PhD Guidance for Faculty of NIT Silchar.

21-Aug-15NIT Silchar51

Future ScopeInterconnecting all North East NITs through HPC facility of NIT Silchar.Facilitate the researchers/scholars/faculties of National Laboratories, Universities of NE for high-end Interdisciplinary Computational Science & Engineering Research.

21-Aug-15NIT Silchar52

ConclusionIn todays world Supercomputers are an essential part of research in higher education. High-performance computing (HPC) adds tremendous value to engineering education in diverse areas of applications. The role VLSI technology in HPC is vital.High Power Computation has influenced everybody's life.21-Aug-15NIT Silchar53

21-Aug-15NIT Silchar54Thank You!