stanford workshop 2013 - hpc advisory council...cloudera, impala, and edw optimization (amr...

12
HPC Advisory Council Stanford Workshop 2013 Welcome!

Upload: others

Post on 21-Jun-2020

10 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

HPC Advisory Council Stanford Workshop 2013

Welcome!

Page 3: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

3

Day 1 Agenda

9:00-9:30 Opening/welcome session - (Steve Jones - Stanford, Gilad Shainer - HPCAC

9:30-10:30 Keynote: Scaling CFD and UQ codes on Sequoia (Ivan Bermejo-Moreno, Sanjeeb Bose, Joe Nichols, Curtis

Hamman, Francisco Palacios and Julien Bodart, Stanford University Predictive Science Academic Alliance

Program (PSAAP) and Center for Turbulence Research)

10:30-11:30 Keynote: Programming Models and their Designs for Exascale Systems (Dhabaleswar K. Panda, Ohio State

University)

11:30-11:50 Gold sponsors presentation: Challenges in Extreme-Scale Computing (Alan Lee, AMD)

11:50-12:10 Gold sponsors presentation: Leveraging HPC and Optimizing the IT Environment for Engineering Simulation

(Shane Moeykens, ANSYS)

12:10-13:10 Lunch and vendor exhibits

13:10-13:30 Gold sponsors presentation: Hybrid Storage Solutions (Steve Hochberg, Netapp)

13:30-14:30 Energy Efficiency and its Impact on Requirements for Future Programming Environments (John Shalf,

Lawrence Berkeley National Laboratory)

14:30-15:15 Hadoop Acceleration with RDMA (Eyal Gutkind, Mellanox)

15:15-15:45 Break and vendor exhibits

15:45-16:15 Continuous integration in software development through open-source tools (Ivan Bermejo-Moreno, Center for

Turbulence Research)

16:15-16:45 The RAMCloud project (Ankita Kejriwal, Stanford)

16:45-17:30 Lessons learnt in improving scaling of applications on large GPU clusters (Sarah Tariq, NVIDIA)

Page 4: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

4

Day 2 Agenda

9:00-9:30 HPC@Stanford: It's not Rocket Science! (Steve Jones and Ivan Bermejo-Moreno, Flow

Physics and Computational Engineering & Stanford Predictive Science Academic Alliance

Program)

9:30-10:30 Keynotes: Charm++: HPC with migratable objects (Laxmikant Kale, University of Illinois at

Urbana-Champaign)

10:30-11:30 Keynote: Accelerating Big Data with Hadoop and Memcached (Dhabaleswar K. Panda, Ohio

State University)

11:30-11:50 Gold sponsors presentation: Building a Highly Resilient and Available Lustre Storage System

(John Fragalla, Xyratex)

11:50-12:10 Gold sponsors presentation: High Performance NAS for Hadoop(Dr. Brent Welch, Panasas)

12:10-13:10 Lunch and vendor exhibits

13:10-13:40 UberCloud HPC Experiment (Burak Yenier)

13:40-14:40 Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera)

14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

15:10-15:40 Numerical Encoding Shatters Exascale's Memory Wall (Al Wegener, Samplify Systems)

15:40-16:00 Farewell and raffle

Page 5: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

5

Administration

• The workshop goals

– Education, training, solutions, futures

• 2 day workshop and a tight schedule

– We encourage live discussions

– We want to have all sessions start in time

– There are breaks for offline discussions

• Speakers – make sure we have your slides!

• Raffle

– Friday afternoon!

• Don’t forget the raffle...

Page 6: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

6

HPC Advisory Council Members

Page 7: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

7

HPC Advisory Council HPC Center

GPU Cluster Lustre

192 cores

456 cores 704 cores

384 cores

Page 8: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

8

ISC’13 – Student Cluster Competition

• University-based teams to compete and demonstrate the incredible

capabilities of state-of- the-art HPC systems and applications on the ISC’12

show-floor

• The Student Cluster Competition is designed to introduce the next

generation of students to the high performance computing world and

community

Page 9: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

9

Best Practices and Installation Guides

• The HPC Advisory Council provides best practices, that

through experience and research, have shown to improve

clustering and applications productivity

• Over 60 HPC Applications!

– Multiple benchmarks and analysis on each

– Using the latest combination of hardware equipment

• GPUs, Next Gen Intel and AMD CPUs, storage

• We encourage HPC users to provide their feedback and

suggest other application or HPC areas as candidates for

future best practices.

• Installation Guides are also available and may be found

on the HPC|Works page

– Quickly get up and running with best performance

Page 10: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

10 10

Web: www.hpcadvisorycouncil.com

Email: [email protected]

Facebook: http://www.facebook.com/HPCAdvisoryCouncil

Twitter: www.twitter.com/hpccouncil

YouTube: www.youtube.com/user/hpcadvisorycouncil

Connect with Us

Page 11: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

11

2013 HPC Advisory Council Workshops

• For more information

– www.hpcadvisorycouncil.com

[email protected]

Page 12: Stanford Workshop 2013 - HPC Advisory Council...Cloudera, Impala, and EDW optimization (Amr Awadallah, Cloudera) 14:40-15:10 The future of network-based storage (Brent Gorda, Intel)

HPC Advisory Council Stanford Workshop 2013

Welcome!