cuda developer tools: new features and capabilities · cuda developer tools: new features and...

Rafael Campana, Nov. 19, 2019

CUDA DEVELOPER TOOLS: NEW FEATURES AND CAPABILITIES

2

DEVELOPER TOOLS PORTFOLIO

Application Development

IDE integration

Debug Gfx APIDebug CUDA

System Profiling

Graphics ProfilingCUDA Profiling

Gfx GPU crash dump

CUDA GPU crash dump

3

Nsight Eclipse EditionNsight Visual Studio Edition



IDE integration


System Profiling


Gfx GPU crash dump

CUDA GPU crash dump

4




IDE integration


System Profiling


Gfx GPU crash dump

CUDA GPU crash dump

Nsight Eclipse Editioncuda-gdbNsight Visual Studio EditionNsight Computecuda-memcheck & Compute Sanitizer APINsight Graphics

5




IDE integration


System Profiling


Gfx GPU crash dump

CUDA GPU crash dump


cuda-gdb/Nsight Eclipse EditionNsight Visual Studio EditionNsight Aftermath

6




IDE integration


System Profiling


Gfx GPU crash dump

CUDA GPU crash dump



Nsight Systems

7




IDE integration


System Profiling


Gfx GPU crash dump

CUDA GPU crash dump



Nsight Systems

Nsight Compute

Nsight Graphics

8

NVIDIA® NSIGHT™ ECLIPSE EDITION

• Plug-in to EclipseEclipse 4.7, 4.8 and 4.9 support

• Edit, build, debug CUDA-C applications

• CUDA aware source code editor – syntax highlighting, code completion and inline help

• Debugger - Seamless and simultaneous debugging of CPU and GPU code

• NVCC build integration to cross compile for various target platforms

• Docker support

Plug-in

• Documentation: https://docs.nvidia.com/cuda/nsight-eclipse-plugins-guide

https://docs.nvidia.com/cuda/nsight-eclipse-plugins-guide

9

NSIGHT VISUAL STUDIO EDITION

Visual Studio 2015, 2017 and 2019 support

Native CUDA C/C++ GPU Debugging

Source-correlated assembly debugging(SASS / PTX / SASS+PTX)

Data breakpoints for CUDA C/C++ code

Expressions in Locals, Watch and Conditionals

CUDA info view

Warp Watch

Documentation: https://developer.nvidia.com/nsight-visual-studio-edition

Plug-in

https://developer.nvidia.com/nsight-visual-studio-edition

10

CUDA-GDB

Provides the debugging features of Nsight Eclipse Edition

Command line source and assembly (SASS) level debugger

Simultaneous CPU and GPU debugging

Inspect and modify memory, register, variable state

Control program execution

Runtime GPU error detection

Support for multiple GPUs, multiple contexts, multiple kernels, Thread focus

Core dump support

Documentation : http://docs.nvidia.com/cuda/cuda-gdb

Overview

(cuda-gdb) info cuda threads breakpoint all

BlockIdx ThreadIdx Virtual PC Dev SM Wp Ln Filename Line

Kernel 0

(1,0,0) (0,0,0) 0x0000000000948e58 0 11 0 0 infoCommands.cu 12






(cuda-gdb) info cuda threads breakpoint 2 lane 1

BlockIdx ThreadIdx Virtual PC Dev SM Wp Ln Filename Line

Kernel 0


http://docs.nvidia.com/cuda/cuda-gdb

11

CUDA-GDB

Support for ARM (Server Base System Architecture) preview

Performance improvements

● Module load time (~30% faster)

Quality improvements

● Improved handling of --lineinfo debug information (OptiX)● Improved display of uniform registers (Turing)

New Features

12

CUDA-MEMCHECK

Multiple tools

memcheck : reports out of bounds/misaligned memory access errors

racecheck : identifies races on __shared__ memory

initcheck : usage of uninitialized global memory

synccheck : identify invalid usage of __syncthreads() and __syncwarp()

Documentation: http://docs.nvidia.com/cuda/cuda-memcheck/index.html

Functional correctness checking tool suite

http://docs.nvidia.com/cuda/cuda-memcheck/index.html

13

SANITIZER

Provides finer control than cuda-memcheck through APIs to analyze memory patterns

APIs are grouped in two:

Callback API – CUDA events such as memory allocations/kernel

Patching API – inserts patches for specific memory instructions

Documentation: https://docs.nvidia.com/cuda/compute-sanitizer/index.html

Samples: https://github.com/NVIDIA/compute-sanitizer-samples

API

https://docs.nvidia.com/cuda/compute-sanitizer/index.html

https://github.com/NVIDIA/compute-sanitizer-samples

14

NSIGHT SUITE OF PROFILERS

15

NSIGHT TOOLS WORKFLOW

Nsight SystemsComprehensive system-level

performance

Nsight ComputeDetailed CUDA kernel performance

Nsight GraphicsDetailed frame/render performance

Dive into top CUDA kernels by using metrics/counter

collection

Dive into graphicsframes

Start here

Re-check overall performance

Re-check overall performance

16

NSIGHT SYSTEMS

System-wide application algorithm tuningMulti-process tree support

Locate optimization opportunitiesVisualize millions of events on a very fast GUI timelineOr gaps of unused CPU and GPU time

Balance your workload across multiple CPUs and GPUsCPU algorithms, utilization, and thread stateGPU streams, kernels, memory transfers, etc

OS: Linux (x86, Tegra), Windows, MacOSX (host only)

Docs/product: https://developer.nvidia.com/nsight-systems

Overview

https://developer.nvidia.com/nsight-systems

17

Processes

and

threads

CUDA and

OpenGL API trace

Multi-GPU

Kernel and memory

transfer activities

cuDNN and

cuBLAS trace

Thread/core

migration

Thread state

18

NSIGHT SYSTEMS

● ARM (SBSA) support● ftrace collection

● NVTX correlated

to GPU

● Event table

New Features

19

NSIGHT SYSTEMSMPI API Trace

20

NSIGHT SYSTEMS

CUDA KernelBacktraces

FTrace events

New Trace Collections

21

NSIGHT SYSTEMS

FTrace

22

NSIGHT COMPUTE

Key Features:

• Interactive CUDA API debugging and kernel profiling

• Fast Data Collection

• Improved Workflow (Diff’ing Results)

• Fully Customizable (Programmable UI/Rules)

• Command Line, Standalone, IDE Integration

OS: Linux (x86, Power, Tegra), Windows, MacOSX (host only)

GPUs: Pascal, Volta, Turing

Docs/product: https://developer.nvidia.com/nsight-compute

Next-Gen Kernel Profiling Tool

https://developer.nvidia.com/nsight-compute

23NVIDIA CONFIDENTIAL. DO NOT DISTRIBUTE.

NSIGHT COMPUTEProfile Report – Details Page

Focused Sections

All Data on

Single Page

Ordered from Top-Level to

Low-Level

24

NSIGHT COMPUTESection Example

Section Headerprovides overview &

context for other sections

Section Bodyprovides additional

details (tables & charts)

Section Configcompletely data driven

add/modify/change sections

25

NSIGHT COMPUTEUnguided Analysis / Rules System

Analysis Rulesrecommendations from

nvvp and more

Rules Configcompletely data driven

add/modify/change rules

26

NSIGHT COMPUTEDiff’ing kernel runs

Metric deltacurrent values and changes

from baseline

Baselinefrom any previous profile report

(different kernel, gpu, …)

Chart differencecurrent values and

baseline values

27

NSIGHT COMPUTE

Support for PowerPC

target architecture

Support for ARM (SBSA) preview

target architecture

Profile activity command

line is shown

New Features

28

NSIGHT COMPUTE

Detailed breakdown of

high-level SOL metrics

New Features

29

NSIGHT COMPUTE

Improved help for Source page

and Details page charts

New Features

30

NSIGHT COMPUTE

The Memory Workload Analysis

chart now supports baselines

New Features

31

NSIGHT COMPUTE

Command line interface has new profiling and output controls

New Features

32

SUMMARY

Full stack of Developer Tools available across platforms and APIs

Overall user consistent experience across many platforms

Compute & Graphics API support

Lower overhead (performance and footprint)

Visit: https://developer.nvidia.com/tools-overview

https://developer.nvidia.com/tools-overview

cuda developer tools: new features and capabilities · cuda developer tools: new features and...

Documents