nervana ai overview deck april 2016

Proprietary and confidential. Do not distribute.

Overview

April 2016

MAKING MACHINES SMARTER.™


nervana is …

2

Artificial Intelligence

ON DEMAND


World class team and investors

3

…as well as leading research labs

Exceptional talent

Drawing from experience at world class technology companies…

Steve Jurvetson Matt Ocko Naveen Rao Amir Khosrowshahi

Experienced investors & board

Experienced board members

Elite investors behind industry-shaping companies


nervana is built on state of the art deep learning

4

• Features are discovered from data

• Performance improves with more data

Extract features at multiple levels of abstraction

• High degree of representational power


Deep learning techniques

Deep learning has significantly improved accuracy

5

Source: ImageNet1: ImageNet top 5 error rate

Error rate1

human performance


Implementing deep learning at scale is hard and expensive

6

Pre-process training data

Augment data

Design model

Perform hyperparameter

search

• Team of data scientists with deep learning expertise

• Enormous compute (CPUs /GPUs) and engineering resources


The nervana platform - a full stack solution

7

neon deep learning framework

nervana cloud

import train build deploy


A new processor technology …

8

• Training and inference

• Scalable distributed architecture

• Memory near computation

• Power efficient

• Unprecedented compute density


… will provide 10 to 100x gain in speed

9

ImageNet training

1: Standard Nvidia TitanX GPU 2: TitanX GPU optimized with Nervana software 3: Distributed training across multiple NervanaGPUs 4: Custom Nervana deep learning processor

Trai

n t

ime (

hours

)

0

500

1,000

1,500

2,000

CPU Single GPU NervanaGPU Multi NervanaGPU Nervana Engine

11033100

2,000

2 3 41


nervana solutions

nervana implementation libraries (MOP layer)

nervana deep learning functionscustomer algorithms

customer models nervana models

customer solution

Our software stack is easy to use and extend

10

customer data

Out of the box solutions that are easy to extend

Standard deep networks definitions

Rapid model prototyping and exploration. Model training and hyperparameter search.

Integration with H/W for training & deployment • Fastest GPU implementations • Seamless access to cloud or local CPU/GPU

HARDWARE AGNOSTIC

• Video activity recognition • Speech recognition • Time-series prediction

• Object localizer • Image classifier • Semantic parsing • Easy data ingestion

• Curated state of the art models

• Flexible deployment

• REST API for training, inference


Create solutions that are trained on YOUR data

11

neon deep learning

framework

nervana cloud

Solutions

Images

Text

Tabular

Speech

Time series

Video


Image classification and video activity detection

12

Deep learning model Potential applications

• Trained on a public dataset1 of 13K videos in 100 categories

• Training was approximately 3 times faster than competitive framework

• Can be extended to perform scene and object detection, action similarity labeling, video retrieval, anomaly detection

1: UCF101 dataset: http://crcv.ucf.edu/data/UCF101.php

• Activity detection and monitoring for security

• Drone detection and tracking for air traffic mgmt.

• Facial recognition and image based retrieval

• Sense and avoid systems for autonomous driving

• Baggage screening at airports and other public venueshttps://www.youtube.com/watch?v=ydnpgUOpdBw

http://crcv.ucf.edu/data/UCF101.php

https://www.youtube.com/watch?v=ydnpgUOpdBw


Speech to text conversion

13

1: LibriSpeech: http://www.openslr.org/12/


• Trained on a public dataset2 of 1,000 hours of English speech

• Trained in 5 days (vs. the normal 70 days) on nervana’s mGPU system

• Can be easily extended to support other languages, detect sentiment, etc.

• Speech recognition for command and control systems

• Speech to text conversion for audio surveillance

• Speech recognition and automated response for radio communication

https://youtu.be/NaqZkV_fBIM

http://www.openslr.org/12/

https://youtu.be/NaqZkV_fBIM


14


• Includes 20 Q&A types1 ranging from single supporting facts to positional reasoning and agent motivation

• Can be extended to more complex text analysis apps like theme identification and sentiment analysis

1: Facebook GRU/LSTM: https://research.facebook.com/researchers/1543934539189348

• Summarization and Identification of themes in documents, financial reports or news articles

• Q&A system for querying any large corpus of text

• Social media monitoring and sentiment analysis for intelligence and security

Natural language processing

https://research.facebook.com/researchers/1543934539189348


Why nervana?

15

Fast Easy to use Scalable

Bring your own data Cloud vs. on-premise Professional services


Why nervana?

16

Fastest deep learning framework

Fast

Wide array of out of the box DL solutions

Easy to use

Scale based on training and inference needs

Scalable

Solutions are optimized for your specific use case

Bring your own data

Available either via :

cloud service or

on-premise appliance

Cloud vs. on-premise

Industry leading in-house team

Professional services


Two distinct engagement models

17

ScopeNervana

HWNervana

SWNervana DL Team

Nervana Cloud

• Access to out of the box solutions, industry leading Nervana framework and hardware infrastructure

Full engagement

Nervana Cloud plus:

• Data science support

• Fully optimized deep learning solution


Sample Engagements

18

Description

NON-EXHAUSTIVE

Identification and measurement of crops to drive decisions for precision agriculture

Description

Analysis of speech samples from in-vehicle communications system

Applying video activity detection techniques to analyze urban surveillance data

Analysis of uploaded images to detect fraudulent activity

NLP analysis of financial documents, analyst and industry reports

Helping predict the occurrence and severity of storms in climate simulations

Transcription and analysis of customer sales calls to predict outcomes

Predicting performance of hybrid seeds from genetic, phenotype, environmental data

Enhancing exchange-traded products and detecting anomalous patterns in order books

Using NLP techniques to analyze RFPs and generate recommendations

Precision Agriculture

Asset Management

Enterprise Infrastructure

Genomics

Financial Services

Security

Sales Automation

Automotive

Online Services

Climate Science


Localize weather phenomena

TMQ

T500

T200

19


Tumor detection

Positive:

Negative:

20


Find fault lines for oil & gas exploration

21


Identify and count corn stalks

22

Positive:

Negative:

NERVANA


nervana has the fastest library

24

neon benchmarks

1: Developed by Facebook and Nvidia 2: Developed by Google SOURCE: Soumith Chintala; http://github.com/soumith/convnet-benchmarks

1

1

2

http://github.com/soumith/convnet-benchmarks


25

SOURCE: Compiled by Baidu: http://svail.github.io/

nervana has the fastest libraryneon benchmarks

http://svail.github.io/

NERVANA

nervana ai overview deck april 2016

Technology