Presented by

Jack DongarraUniversity of Tennessee and

Oak Ridge National Laboratory

KOJAK and SCALASCA

2 Dongarra_KOJAK_SC07

KOJAK

• Software package for automatic performance analysis ofparallel applications− Message passing and threads (MPI, OpenMP, SHMEM, CAF)− Parallel performance− CPU and memory performance

• Collaborative research project between− Forschungszentrum Jülich, Germany− University of Tennessee, USA

• URLshttp://www.fz-juelich.de/zam/kojak/http://icl.cs.utk.edu/kojak/

3 Dongarra_KOJAK_SC07

Low-levelevent trace

High-levelprofile

Reduction

Call treeProblem

System

≡

• Automatic search for patterns of inefficient behavior

• Quantification of significance

• Data distillation

• Guaranteed to cover the entire trace

Automatic off-line trace analysis

4 Dongarra_KOJAK_SC07

Late sender patternpr

oces

s

A

time

idle

B

ENTEREXITSENDRECV

MessageLink

MPI_SEND

MPI_RECV

5 Dongarra_KOJAK_SC07

Which type ofproblem?

Where in the source code?Which call path?

Which process / thread ?

Analysis report

6 Dongarra_KOJAK_SC07

SCALASCA

• Follow-up project to KOJAK

• Started January 2006

• Funded by Helmholtz Initiative and Networking Fund

• Objective: develop a highly scalable version of KOJAK− Basic idea: parallelization of analysis− Current focus: single-threaded MPI-1 applications

• URL http://www.scalasca.org/

7 Dongarra_KOJAK_SC07

Parallel analysis with Scalasca

Trace analysisreport

Source code Automatic multilevelinstrumentation

Executable

Runtimesummary report

Execution onparallel machine

Instrumentation

Measurement

AnalysisParallel traceanalyzer

Local trace files

Unified defs + mappings

Profile browserCUBE

8 Dongarra_KOJAK_SC07

Results: SMG2000

9 Dongarra_KOJAK_SC07

Integrated Tools for high productivity

• Virtual Institute for High-Productivity Supercomputing (VI-HPS)− Funded by the Helmholtz Association of German research centers

• Focus on productivity− Advanced programming tools for integrated performance analysis and

debugging− Training and support

• VI-HPS partners and tools− Forschungszentrum Jülich, Germany (KOJAK, SCALASCA)− RWTH Aachen University, Germany (training, support)− Technische Universität Dresden, Germany (VAMPIR)− University of Tennessee (PAPI, KOJAK)

10 Dongarra_KOJAK_SC07

High productivity development cycle

Optimization

Visual trace analysis

Automatic trace

analysis

Error correction

Hardware monitoring

Execution

KOJAK /SCALASCA

VAMPIR

PAPI

MARMOT

11 Dongarra_KOJAK_SC07

Contacts

Jack Dongarra, Shirley Moore,Karl Fuerlinger, and Fengguang SongUniversity of Tennessee and Oak Ridge National Laboratory

Daniel Becker, Markus Geimer,Bernd Mohr, Felix Wolf, and Brian WylieForschungszentrum Jülich, Germany