thegreenindex(tgi): …€¦ · synergy.cs.vt.edu • thegreenindex(tgi) –...
TRANSCRIPT
![Page 1: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/1.jpg)
synergy.cs.vt.edu
The Green Index (TGI): A Metric for Evalua:ng Energy Efficiency in HPC Systems
Wu Feng and Balaji Subramaniam
![Page 2: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/2.jpg)
synergy.cs.vt.edu
• Energy-‐Delay Product (EDP) – Used primarily in circuit design – Variants can be used to emphasize more on energy or
performance
• FLOPS/WaH – Used in high-‐performance compuIng – Metric for ranking in Green500 list
C. Hsu, W. Feng, J. Archuleta, “Towards Efficient SupercompuIng: A Quest for the Right Metric,” Workshop on High-‐Performance, Power-‐Aware Compu9ng (in conjuncIon with the IEEE Interna9onal Parallel & Distributed Processing), April 2005.
Metrics for Energy Efficiency
![Page 3: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/3.jpg)
synergy.cs.vt.edu
Issue with TradiIonal Metrics?
• “In fact, in many cases it has be become clear to the panel that the non-‐computaIonal aspects of the energy problem, especially the energy in data transport, will dwarf the tradiIonal computaIonal component in future.“ – DARPA-‐IPTO Exascale CompuIng Study.
Source: William J. Dally, GPU CompuIng to Exascale and Beyond, Keynote Talk at SC 2010
![Page 4: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/4.jpg)
synergy.cs.vt.edu
• LINPACK – Focus on CPU … but what about the other subsystems?
EE HPC WG – TOP500 – Green Grid – Green500 Goals • IdenIfy workloads for exercising other sub-‐systems; e.g.,
memory, storage, I/O • Refine methodology for measuring the power of
supercomputers • IdenIfy appropriate metrics for energy efficiency
Issue with Workload?
![Page 5: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/5.jpg)
synergy.cs.vt.edu
• Use mulIple benchmarks – Stress different components
• Arrive at a system-‐wide energy efficiency metric – Represent all components of the system
Our Approach: New Workload and Metric
![Page 6: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/6.jpg)
synergy.cs.vt.edu
• Different benchmarks use different metrics – HPL uses FLOPS – STREAM uses mega bytes per second (MBPS)
• How to combine these metrics? Should they be combined? – Which metric should be used? – How to arrive at a single number?
Challenges
![Page 7: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/7.jpg)
synergy.cs.vt.edu
• Methodology to represent system-‐wide energy efficiency – Use mulIple benchmarks
• Single number – Combine metrics from each of the benchmark
• Energy efficiency relaIve to a reference system – Similar to SPEC raIng
SPEC raIng = Performance of Reference System Performance of System Under Test
The Green Index (TGI)
![Page 8: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/8.jpg)
synergy.cs.vt.edu
• Calculate performance-‐to-‐power raIo* for each benchmark
EEi = Performancei Power Consumedi
• Obtain the relaIve energy efficiency (REE) w.r.t. the
reference machine. REE is dimensionless. REEi = EEi
EERefi
i represents the set of all benchmarks and Ref represents the reference machine
Algorithm To Calculate TGI
* Note: We use performance-‐to-‐power raIo as the metric of choice. However, any other efficiency metric can be used with TGI.
![Page 9: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/9.jpg)
synergy.cs.vt.edu
• For each benchmark, assign a weighIng factor (Wi) • Sum across the product of REEs and Wi to arrive at TGI for
the system
TGI = Σ Wi * REEi
Algorithm To Calculate TGI
![Page 10: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/10.jpg)
synergy.cs.vt.edu
• ArithmeIc Mean – Assign equal weights to all the benchmarks
• Geometric Mean
• Weighted ArithmeIc Mean (WAM) – Time (WI) – Energy (Wei) – Power (Wpi)
Assigning Weights (Wi)
![Page 11: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/11.jpg)
synergy.cs.vt.edu
• Time as weight
• Energy as weight
• Power as weight
Assigning Weights (Wi)
TGI
TGI
TGI
![Page 12: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/12.jpg)
synergy.cs.vt.edu
• Reference System (System G) – Two (2) Intel Xeon 5462 quad-‐core processors at 2.8 GHz
• 128 nodes à 1,024 cores
– 8GB memory – QDR InfiniBand
• System Under Test (Fire) – Two (2) AMD Opteron 6134 (Magny Cours) oct-‐core processors at
2.3 GHz • 8 nodes à 128 cores
– 32 GB of memory – QDR InfiniBand
Systems Used
![Page 13: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/13.jpg)
synergy.cs.vt.edu
• High-‐Performance LINPACK (HPL) – Stresses the CPU component of the system – Output metric: FloaIng-‐point operaIons per second (FLOPS)
• STREAM Benchmark – Stresses the memory sub-‐system – Output metric: Megabytes per second (MPBPS)
• IOZone – Stresses the I/O sub-‐system – Output metric: Megabytes per second (MPBPS)
Benchmarks Used in TGI
![Page 14: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/14.jpg)
synergy.cs.vt.edu
Energy Efficiency of Benchmarks (Fire Cluster)
![Page 15: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/15.jpg)
synergy.cs.vt.edu
The Green Index (Scalability)
![Page 16: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/16.jpg)
synergy.cs.vt.edu
The Green Index (WeighIng Factors)
![Page 17: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/17.jpg)
synergy.cs.vt.edu
• Benchmark more systems • Methodology for heterogeneous systems • Rigorous study for weight factor assignment • Adapt TGI based on applicaIon
– Assign weights based on component uIlizaIon by applicaIon? – Analyze whether the system is energy efficient for a parIcular
applicaIon
• System-‐wide à Center-‐wide – Include cooling infrastructure …
Future Work
![Page 18: TheGreenIndex(TGI): …€¦ · synergy.cs.vt.edu • TheGreenIndex(TGI) – Amethodologytoprovideinsightsintosystemwideenergy efficiency# – Comparisonwithtradionalmetrics(performancetopowerrao)#](https://reader034.vdocuments.us/reader034/viewer/2022050607/5fae00ed8fbe9f41b141b45c/html5/thumbnails/18.jpg)
synergy.cs.vt.edu
• The Green Index (TGI) – A methodology to provide insights into system-‐wide energy
efficiency – Comparison with tradiIonal metrics (performance-‐to-‐power raIo) – Preliminary analysis
For more informaIon, B. Subramaniam and W. Feng, “The Green Index: A Metric for EvaluaIng System-‐Wide Energy Efficiency in HPC Systems,” Workshop on High-‐Performance, Power-‐Aware Compu9ng (in conjuncIon with the IEEE Interna9onal Parallel & Distributed Processing), May 2012.
Summary