cs5239 computer system performance evaluationteoym/cs5239-13/l0-overview.pdf · 2013. 1. 18. ·...
TRANSCRIPT
10 January 2013 CS5239 L0 - Overview 1
CS5239 Computer System Performance Evaluation
2012/13 – Semester 2www.comp.nus.edu.sg/~teoym/cs5239-13
Assoc Professor Teo Yong MengRoom: COM2, #04-39
Department of Computer ScienceNational University of SingaporeE-mail: [email protected]
Tel: 6516 2830
10 January 2013 CS5239 L0 - Overview 2
What I do? Teaching
Parallel Computing Introduction to Cloud Computing Systems Modeling & Simulation Distributed Systems Applied Parallel Computing (joint teaching with MIT) Computer Systems Engineering (joint teaching with MIT) ....
Research - parallel & distributed computing Performance evaluation Cloud computing Composability theory and simulation
10 January 2013 CS5239 L0 - Overview 3
How well a computer system performs a given job or activity.
Performance
What is hard?
Performance of a computer system is multidimensional.
Top 500 Supercomputers (Nov 2012)
mega = 106
giga = 109
tera = 1012
peta = 1015
exa = 1018
• 560K cores• 17.6 petaflop/s• 8.3 MW
Green 500 (Nov 2012)
Top 500 Supercomputers: • (Nov 2011) RIKEN’s K supercomputing = 830
MFLOPS/W (32nd in Green 500)• (Nov 2012), Titan = 2,134 MFLOPS/W (3rd in
Green 500)
Performance, Power and Frequency (1985-2010)
10 January 2013 6CS5239 L0 - Overview
number of cores
clock speed
power (W)
relative performance
number of transistors (K)
10 January 2013 CS5239 L0 - Overview 7
Why Evaluated Performance?
Goal: advance the state-of-the-art of computer architecture
10 January 2013 CS5239 L0 - Overview 8
Performance Evaluation
Rulesof
Thumb
TrendAnalysis
Performance Models
Analytical SimulationMeasurement
Complexity and CostLow High
after-the-fact
analysis
10 January 2013 CS5239 L0 - Overview 9
Three Fundamental Techniques
Measurements of actual systems
Simulations using software models
Mathematical modeling using such techniques asqueuing analysis
What will we cover?
18 January 2013 10CS3210 Parallel Computing - Course Admin
Capacity Planning
MeasurementTechniques
& Tools
Case Studies
AnalyticModeling
Techniquesscalability
10 January 2013 CS5239 L0 - Overview 11
“Measurements are not to provide numbers but insights.”
Ingrid Bucher
MEASUREMENT TECHNIQUES & TOOLS
L#03: Performance
Metrics
L#04: Workload Modeling
L#05: Instrumentation & Representation of
Measurement Data
ANALYTICAL MODELLING TECHNIQUES
L#06: Introduction &
Notation
L#07-09: Techniques
L#10: Performance Laws
& Scalability
L#11-12 Case Studies
L#07: Operational
Analysis
L#08: Analysis of
Single Queue
L#09: Analysis of Queuing Networks /
Multiple Classes
- bottleneck analysis- performance bounds
System - open, closed, hybrid Component - fixed capacity, delay,
load-dependentWorkload - single, multiple classes
10 January 2013 CS5239 L0 - Overview 13
Schedule: www.comp.nus.edu.sg/~teoym/cs5239-13/schedule.htm
10 January 2013 CS5239 L0 - Overview 14
Module Assessment
1. Continuous Assessment (60%)Test (20%)Assignment 1 (20%)Assignment 2 (20%)
2. Open Book Exam (40%) 2 hrs
10 January 2013 CS5239 L0 - Overview 15
BooksMain Textbooks The Art of Computer Systems Performance Analysis: Techniques for
Experimental Design, Measurement, Simulation and Modeling, R. Jain, John-Wiley, 1991.
Quantitative System Performance, E.D. Lazowska et al., Prentice-Hall, 1984,http://www.cs.washington.edu/homes/lazowska/qsp/.
Measuring Computer Performance - A Practitioner's Guide, D.J. Lilja, CambridgeUniversity Press, 2000.
Reference Books Capacity Planning and Performance Modeling - From Mainframes to Client-
Server Systems, Daniel A. Menasce, et al., Prentice-Hall, 1994. Capacity Planning for Web Performance – Metrics, Models and Methods, D.A.
Menasce, et al., Prentice-Hall, 1998. Simulation Modeling and Analysis, A.M. Law and W.D. Kelton, McGraw Hill, 3rd
edition, 2000. Introduction to Parallel Computing, A. Grama, et al., Addison-Wesley, 2nd Edition,
2003.
10 January 2013 CS5239 L0 - Overview 16
Everything should be made as simple as possible, but no simpler – attributed to Albert Einstein
10 January 2013 CS5239 L0 - Overview 17
Problems
• consultation hours – Wed, 9-11am, email, catch me after lectures ….